Nov 02 21:55:02.896607 ip-10-0-142-132 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Nov 02 21:55:02.896627 ip-10-0-142-132 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Nov 02 21:55:02.896636 ip-10-0-142-132 systemd[1]: kubelet.service: Failed with result 'resources'.
Nov 02 21:55:02.896979 ip-10-0-142-132 systemd[1]: Failed to start Kubernetes Kubelet.
Nov 02 21:55:12.983736 ip-10-0-142-132 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Nov 02 21:55:12.983751 ip-10-0-142-132 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 98dda23f2df44b3b82d220e4f94df9f8 --
Nov 02 21:56:58.450291 ip-10-0-142-132 systemd[1]: Starting Kubernetes Kubelet...
Nov 02 21:56:58.900079 ip-10-0-142-132 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 21:56:58.900079 ip-10-0-142-132 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 02 21:56:58.900079 ip-10-0-142-132 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 21:56:58.900079 ip-10-0-142-132 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 21:56:58.905260 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905182    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 21:56:58.905260 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905260    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 21:56:58.905260 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905264    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 21:56:58.905352 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905267    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 21:56:58.905352 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905272    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 21:56:58.905352 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905277    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 21:56:58.905352 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905280    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 21:56:58.905352 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905283    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 21:56:58.905352 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905285    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 21:56:58.905352 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905288    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 21:56:58.905352 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905291    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 21:56:58.905352 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905294    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 21:56:58.905352 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905297    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 21:56:58.905352 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905300    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 21:56:58.905352 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905302    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 21:56:58.905352 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905305    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 21:56:58.905352 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905307    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 21:56:58.905352 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905310    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 21:56:58.905352 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905313    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 21:56:58.905352 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905316    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 21:56:58.905352 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905318    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 21:56:58.905352 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905325    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 21:56:58.905790 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905328    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 21:56:58.905790 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905330    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 21:56:58.905790 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905333    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 21:56:58.905790 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905336    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 21:56:58.905790 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905338    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 21:56:58.905790 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905341    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 21:56:58.905790 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905344    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 21:56:58.905790 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905346    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 21:56:58.905790 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905349    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 21:56:58.905790 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905352    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 21:56:58.905790 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905355    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 21:56:58.905790 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905358    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 21:56:58.905790 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905361    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 21:56:58.905790 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905364    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 21:56:58.905790 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905366    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 21:56:58.905790 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905369    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 21:56:58.905790 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905373    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 21:56:58.905790 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905376    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 21:56:58.905790 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905379    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 21:56:58.905790 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905382    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 21:56:58.906285 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905385    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 21:56:58.906285 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905387    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 21:56:58.906285 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905390    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 21:56:58.906285 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905393    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 21:56:58.906285 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905396    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 21:56:58.906285 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905399    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 21:56:58.906285 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905401    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 21:56:58.906285 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905404    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 21:56:58.906285 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905407    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 21:56:58.906285 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905409    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 21:56:58.906285 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905412    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 21:56:58.906285 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905414    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 21:56:58.906285 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905417    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 21:56:58.906285 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905420    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 21:56:58.906285 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905423    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 21:56:58.906285 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905426    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 21:56:58.906285 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905428    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 21:56:58.906285 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905431    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 21:56:58.906285 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905435    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 21:56:58.906735 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905437    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 21:56:58.906735 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905440    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 21:56:58.906735 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905443    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 21:56:58.906735 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905445    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 21:56:58.906735 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905448    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 21:56:58.906735 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905451    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 21:56:58.906735 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905453    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 21:56:58.906735 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905456    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 21:56:58.906735 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905458    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 21:56:58.906735 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905462    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 21:56:58.906735 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905465    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 21:56:58.906735 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905467    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 21:56:58.906735 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905470    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 21:56:58.906735 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905472    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 21:56:58.906735 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905475    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 21:56:58.906735 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905477    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 21:56:58.906735 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905480    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 21:56:58.906735 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905482    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 21:56:58.906735 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905485    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 21:56:58.907884 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905488    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 21:56:58.907884 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905491    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 21:56:58.907884 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905493    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 21:56:58.907884 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905496    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 21:56:58.907884 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905499    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 21:56:58.907884 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905501    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 21:56:58.907884 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905503    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 21:56:58.907884 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905507    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 21:56:58.907884 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905509    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 21:56:58.907884 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905512    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 21:56:58.907884 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905514    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 21:56:58.907884 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905517    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 21:56:58.907884 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905520    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 21:56:58.907884 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905522    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 21:56:58.907884 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905525    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 21:56:58.907884 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905528    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 21:56:58.907884 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905530    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 21:56:58.907884 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905533    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 21:56:58.907884 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905536    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 21:56:58.908342 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905538    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 21:56:58.908342 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905542    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 21:56:58.908342 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905544    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 21:56:58.908342 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905547    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 21:56:58.908342 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905549    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 21:56:58.908342 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905553    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 21:56:58.908342 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.905556    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 21:56:58.908342 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906344    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 21:56:58.908342 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906351    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 21:56:58.908342 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906354    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 21:56:58.908342 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906356    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 21:56:58.908342 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906359    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 21:56:58.908342 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906362    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 21:56:58.908342 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906365    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 21:56:58.908342 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906368    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 21:56:58.908342 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906371    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 21:56:58.908342 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906373    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 21:56:58.908342 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906376    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 21:56:58.908342 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906379    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 21:56:58.908342 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906382    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 21:56:58.908821 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906385    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 21:56:58.908821 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906388    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 21:56:58.908821 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906391    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 21:56:58.908821 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906393    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 21:56:58.908821 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906396    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 21:56:58.908821 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906399    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 21:56:58.908821 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906401    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 21:56:58.908821 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906404    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 21:56:58.908821 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906407    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 21:56:58.908821 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906409    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 21:56:58.908821 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906412    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 21:56:58.908821 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906414    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 21:56:58.908821 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906417    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 21:56:58.908821 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906420    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 21:56:58.908821 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906422    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 21:56:58.908821 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906425    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 21:56:58.908821 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906429    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 21:56:58.908821 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906432    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 21:56:58.908821 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906436    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 21:56:58.909293 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906439    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 21:56:58.909293 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906441    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 21:56:58.909293 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906444    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 21:56:58.909293 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906446    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 21:56:58.909293 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906449    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 21:56:58.909293 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906451    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 21:56:58.909293 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906454    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 21:56:58.909293 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906457    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 21:56:58.909293 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906460    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 21:56:58.909293 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906462    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 21:56:58.909293 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906465    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 21:56:58.909293 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906468    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 21:56:58.909293 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906471    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 21:56:58.909293 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906474    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 21:56:58.909293 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906477    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 21:56:58.909293 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906480    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 21:56:58.909293 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906482    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 21:56:58.909293 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906485    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 21:56:58.909293 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906488    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 21:56:58.909293 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906490    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 21:56:58.909761 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906493    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 21:56:58.909761 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906496    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 21:56:58.909761 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906498    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 21:56:58.909761 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906500    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 21:56:58.909761 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906503    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 21:56:58.909761 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906505    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 21:56:58.909761 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906508    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 21:56:58.909761 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906511    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 21:56:58.909761 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906513    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 21:56:58.909761 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906516    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 21:56:58.909761 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906518    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 21:56:58.909761 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906521    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 21:56:58.909761 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906523    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 21:56:58.909761 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906526    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 21:56:58.909761 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906528    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 21:56:58.909761 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906531    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 21:56:58.909761 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906534    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 21:56:58.909761 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906536    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 21:56:58.909761 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906540    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 21:56:58.909761 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906544    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 21:56:58.910266 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906547    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 21:56:58.910266 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906550    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 21:56:58.910266 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906552    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 21:56:58.910266 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906555    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 21:56:58.910266 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906558    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 21:56:58.910266 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906561    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 21:56:58.910266 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906563    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 21:56:58.910266 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906566    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 21:56:58.910266 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906569    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 21:56:58.910266 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906571    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 21:56:58.910266 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906574    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 21:56:58.910266 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906578    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 21:56:58.910266 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906580    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 21:56:58.910266 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906583    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 21:56:58.910266 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906586    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 21:56:58.910266 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906588    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 21:56:58.910266 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906591    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 21:56:58.910266 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906594    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 21:56:58.910266 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906596    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 21:56:58.910703 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906599    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 21:56:58.910703 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906601    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 21:56:58.910703 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906604    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 21:56:58.910703 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906606    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 21:56:58.910703 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906609    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 21:56:58.910703 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906611    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 21:56:58.910703 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906614    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 21:56:58.910703 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906617    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 21:56:58.910703 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906619    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 21:56:58.910703 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906622    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 21:56:58.910703 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906624    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 21:56:58.910703 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906627    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 21:56:58.910703 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906630    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 21:56:58.910703 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906633    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 21:56:58.910703 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.906636    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 21:56:58.910703 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907156    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 21:56:58.910703 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907163    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 21:56:58.910703 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907167    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 21:56:58.910703 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907171    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 21:56:58.910703 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907174    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 21:56:58.911187 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907177    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 21:56:58.911187 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907179    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 21:56:58.911187 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907182    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 21:56:58.911187 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907185    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 21:56:58.911187 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907187    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 21:56:58.911187 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907190    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 21:56:58.911187 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907193    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 21:56:58.911187 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907196    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 21:56:58.911187 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907198    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 21:56:58.911187 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907201    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 21:56:58.911187 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907204    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 21:56:58.911187 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907206    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 21:56:58.911187 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907209    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 21:56:58.911187 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907212    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 21:56:58.911187 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907214    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 21:56:58.911187 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907217    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 21:56:58.911187 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907219    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 21:56:58.911187 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907222    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 21:56:58.911187 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907225    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 21:56:58.911187 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907227    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 21:56:58.911656 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907230    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 21:56:58.911656 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907232    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 21:56:58.911656 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907235    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 21:56:58.911656 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907237    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 21:56:58.911656 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907240    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 21:56:58.911656 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907243    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 21:56:58.911656 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907246    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 21:56:58.911656 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907249    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 21:56:58.911656 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907251    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 21:56:58.911656 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907254    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 21:56:58.911656 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907257    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 21:56:58.911656 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907259    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 21:56:58.911656 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907262    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 21:56:58.911656 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907264    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 21:56:58.911656 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907267    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 21:56:58.911656 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907270    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 21:56:58.911656 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907273    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 21:56:58.911656 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907276    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 21:56:58.912208 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907278    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 21:56:58.912208 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907281    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 21:56:58.912208 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907283    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 21:56:58.912208 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907286    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 21:56:58.912208 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907290    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 21:56:58.912208 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907293    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 21:56:58.912208 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907296    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 21:56:58.912208 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907299    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 21:56:58.912208 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907301    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 21:56:58.912208 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907304    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 21:56:58.912208 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907306    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 21:56:58.912208 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907309    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 21:56:58.912208 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907312    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 21:56:58.912208 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907315    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 21:56:58.912208 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907317    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 21:56:58.912208 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907320    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 21:56:58.912208 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907322    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 21:56:58.912208 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907325    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 21:56:58.912208 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907327    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 21:56:58.912208 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907330    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 21:56:58.912675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907333    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 21:56:58.912675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907336    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 21:56:58.912675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907338    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 21:56:58.912675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907341    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 21:56:58.912675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907344    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 21:56:58.912675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907347    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 21:56:58.912675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907349    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 21:56:58.912675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907353    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 21:56:58.912675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907357    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 21:56:58.912675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907361    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 21:56:58.912675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907365    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 21:56:58.912675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907367    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 21:56:58.912675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907370    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 21:56:58.912675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907372    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 21:56:58.912675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907375    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 21:56:58.912675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907378    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 21:56:58.912675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907380    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 21:56:58.912675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907383    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 21:56:58.912675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907385    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 21:56:58.913155 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907388    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 21:56:58.913155 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907390    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 21:56:58.913155 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907393    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 21:56:58.913155 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907395    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 21:56:58.913155 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907398    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 21:56:58.913155 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907401    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 21:56:58.913155 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907403    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 21:56:58.913155 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907406    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 21:56:58.913155 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907409    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 21:56:58.913155 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907411    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 21:56:58.913155 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907414    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 21:56:58.913155 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907416    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 21:56:58.913155 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907419    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 21:56:58.913155 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907421    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 21:56:58.913155 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907426    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 21:56:58.913155 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907430    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 21:56:58.913155 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907432    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 21:56:58.913155 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907436    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 21:56:58.913155 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907438    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 21:56:58.913155 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907441    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907443    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907446    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907449    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.907452    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908597    2576 flags.go:64] FLAG: --address="0.0.0.0"
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908607    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908614    2576 flags.go:64] FLAG: --anonymous-auth="true"
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908619    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908628    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908631    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908636    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908640    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908643    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908647    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908650    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908654    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908657    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908660    2576 flags.go:64] FLAG: --cgroup-root=""
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908663    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908666    2576 flags.go:64] FLAG: --client-ca-file=""
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908669    2576 flags.go:64] FLAG: --cloud-provider="external"
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908672    2576 flags.go:64] FLAG: --cluster-dns="[]"
Nov 02 21:56:58.913658 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908676    2576 flags.go:64] FLAG: --cluster-domain=""
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908679    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908682    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908685    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908690    2576 flags.go:64] FLAG: --container-log-max-files="5"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908699    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908703    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908706    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908710    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908713    2576 flags.go:64] FLAG: --contention-profiling="false"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908716    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908720    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908723    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908726    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908730    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908733    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908736    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908739    2576 flags.go:64] FLAG: --enable-load-reader="false"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908744    2576 flags.go:64] FLAG: --enable-server="true"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908747    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908752    2576 flags.go:64] FLAG: --event-burst="100"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908755    2576 flags.go:64] FLAG: --event-qps="50"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908759    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908762    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 02 21:56:58.914230 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908765    2576 flags.go:64] FLAG: --eviction-hard=""
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908769    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908772    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908776    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908779    2576 flags.go:64] FLAG: --eviction-soft=""
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908782    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908785    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908788    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908791    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908794    2576 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908797    2576 flags.go:64] FLAG: --fail-swap-on="true"
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908800    2576 flags.go:64] FLAG: --feature-gates=""
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908806    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908809    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908813    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908816    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908819    2576 flags.go:64] FLAG: --healthz-port="10248"
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908823    2576 flags.go:64] FLAG: --help="false"
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908826    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908829    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908832    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908836    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908839    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 02 21:56:58.914810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908842    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908845    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908848    2576 flags.go:64] FLAG: --image-service-endpoint=""
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908852    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908855    2576 flags.go:64] FLAG: --kube-api-burst="100"
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908859    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908862    2576 flags.go:64] FLAG: --kube-api-qps="50"
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908865    2576 flags.go:64] FLAG: --kube-reserved=""
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908868    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908871    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908874    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908877    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908880    2576 flags.go:64] FLAG: --lock-file=""
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908883    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908887    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908890    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908895    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908899    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908902    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908905    2576 flags.go:64] FLAG: --logging-format="text"
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908908    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908913    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908916    2576 flags.go:64] FLAG: --manifest-url=""
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908920    2576 flags.go:64] FLAG: --manifest-url-header=""
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908924    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 02 21:56:58.915365 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908928    2576 flags.go:64] FLAG: --max-open-files="1000000"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908932    2576 flags.go:64] FLAG: --max-pods="110"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908935    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908938    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908941    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908944    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908947    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908950    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908953    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908960    2576 flags.go:64] FLAG: --node-status-max-images="50"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908964    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908967    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908970    2576 flags.go:64] FLAG: --pod-cidr=""
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908973    2576 flags.go:64] FLAG: --pod-manifest-path=""
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908976    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908980    2576 flags.go:64] FLAG: --pods-per-core="0"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908983    2576 flags.go:64] FLAG: --port="10250"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908986    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908989    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0ab9c51bea6befd5b"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908992    2576 flags.go:64] FLAG: --qos-reserved=""
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908995    2576 flags.go:64] FLAG: --read-only-port="10255"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.908998    2576 flags.go:64] FLAG: --register-node="true"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909001    2576 flags.go:64] FLAG: --register-with-taints=""
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909005    2576 flags.go:64] FLAG: --registry-burst="10"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909018    2576 flags.go:64] FLAG: --registry-qps="5"
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909023    2576 flags.go:64] FLAG: --reserved-cpus=""
Nov 02 21:56:58.915987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909027    2576 flags.go:64] FLAG: --reserved-memory=""
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909034    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909039    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909043    2576 flags.go:64] FLAG: --rotate-certificates="false"
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909046    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909049    2576 flags.go:64] FLAG: --runonce="false"
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909052    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909056    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909059    2576 flags.go:64] FLAG: --seccomp-default="false"
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909062    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909065    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909069    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909072    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909075    2576 flags.go:64] FLAG: --storage-driver-password="root"
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909078    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909081    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909085    2576 flags.go:64] FLAG: --storage-driver-user="root"
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909088    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909092    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909095    2576 flags.go:64] FLAG: --system-cgroups=""
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909098    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909103    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909106    2576 flags.go:64] FLAG: --tls-cert-file=""
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909109    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909113    2576 flags.go:64] FLAG: --tls-min-version=""
Nov 02 21:56:58.916627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909115    2576 flags.go:64] FLAG: --tls-private-key-file=""
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909118    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909121    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909125    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909127    2576 flags.go:64] FLAG: --v="2"
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909132    2576 flags.go:64] FLAG: --version="false"
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909136    2576 flags.go:64] FLAG: --vmodule=""
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909140    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909143    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909280    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909284    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909288    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909291    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909294    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909297    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909301    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909304    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909306    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909309    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909312    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909315    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 21:56:58.917276 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909317    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 21:56:58.917781 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909320    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 21:56:58.917781 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909324    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 21:56:58.917781 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909327    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 21:56:58.917781 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909330    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 21:56:58.917781 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909332    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 21:56:58.917781 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909335    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 21:56:58.917781 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909338    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 21:56:58.917781 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909341    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 21:56:58.917781 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909344    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 21:56:58.917781 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909346    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 21:56:58.917781 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909349    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 21:56:58.917781 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909352    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 21:56:58.917781 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909354    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 21:56:58.917781 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909357    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 21:56:58.917781 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909360    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 21:56:58.917781 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909363    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 21:56:58.917781 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909365    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 21:56:58.917781 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909368    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 21:56:58.917781 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909371    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 21:56:58.917781 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909375    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 21:56:58.918312 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909378    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 21:56:58.918312 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909380    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 21:56:58.918312 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909383    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 21:56:58.918312 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909385    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 21:56:58.918312 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909388    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 21:56:58.918312 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909390    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 21:56:58.918312 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909393    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 21:56:58.918312 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909396    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 21:56:58.918312 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909399    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 21:56:58.918312 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909401    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 21:56:58.918312 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909404    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 21:56:58.918312 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909407    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 21:56:58.918312 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909409    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 21:56:58.918312 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909413    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 21:56:58.918312 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909416    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 21:56:58.918312 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909419    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 21:56:58.918312 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909421    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 21:56:58.918312 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909424    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 21:56:58.918312 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909427    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 21:56:58.918312 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909429    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 21:56:58.918782 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909432    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 21:56:58.918782 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909434    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 21:56:58.918782 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909437    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 21:56:58.918782 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909440    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 21:56:58.918782 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909443    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 21:56:58.918782 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909445    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 21:56:58.918782 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909448    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 21:56:58.918782 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909451    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 21:56:58.918782 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909453    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 21:56:58.918782 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909456    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 21:56:58.918782 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909459    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 21:56:58.918782 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909463    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 21:56:58.918782 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909466    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 21:56:58.918782 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909469    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 21:56:58.918782 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909471    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 21:56:58.918782 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909474    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 21:56:58.918782 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909477    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 21:56:58.918782 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909479    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 21:56:58.918782 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909482    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 21:56:58.918782 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909486    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 21:56:58.919287 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909489    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 21:56:58.919287 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909491    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 21:56:58.919287 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909494    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 21:56:58.919287 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909497    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 21:56:58.919287 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909499    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 21:56:58.919287 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909503    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 21:56:58.919287 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909506    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 21:56:58.919287 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909508    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 21:56:58.919287 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909511    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 21:56:58.919287 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909513    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 21:56:58.919287 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909516    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 21:56:58.919287 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909520    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 21:56:58.919287 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909523    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 21:56:58.919287 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909526    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 21:56:58.919287 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909529    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 21:56:58.919287 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909532    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 21:56:58.919287 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909536    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 21:56:58.919287 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909540    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 21:56:58.919287 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909543    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 21:56:58.919722 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909546    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 21:56:58.919722 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909549    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 21:56:58.919722 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909553    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 21:56:58.919722 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909556    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 21:56:58.919722 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909559    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 21:56:58.919722 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909562    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 21:56:58.919722 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909565    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 21:56:58.919722 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909568    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 21:56:58.919722 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909570    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 21:56:58.919722 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909573    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 21:56:58.919722 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909576    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 21:56:58.919722 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909578    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 21:56:58.919722 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909581    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 21:56:58.919722 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909584    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 21:56:58.919722 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.909612    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 21:56:58.920092 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909647    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 21:56:58.920092 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909651    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 21:56:58.920092 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909654    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 21:56:58.920092 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909657    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 21:56:58.920092 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909661    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 21:56:58.920092 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909664    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 21:56:58.920092 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909667    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 21:56:58.920092 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909670    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 21:56:58.920092 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909673    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 21:56:58.920092 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909676    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 21:56:58.920092 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909678    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 21:56:58.920092 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909681    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 21:56:58.920092 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909684    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 21:56:58.920092 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909687    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 21:56:58.920092 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909689    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 21:56:58.920092 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909692    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 21:56:58.920092 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909695    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 21:56:58.920092 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909697    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 21:56:58.920092 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909700    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 21:56:58.921242 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909702    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 21:56:58.921242 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909705    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 21:56:58.921242 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909708    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 21:56:58.921242 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909711    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 21:56:58.921242 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909714    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 21:56:58.921242 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909716    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 21:56:58.921242 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909719    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 21:56:58.921242 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909722    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 21:56:58.921242 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909724    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 21:56:58.921242 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909727    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 21:56:58.921242 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909729    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 21:56:58.921242 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909732    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 21:56:58.921242 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909735    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 21:56:58.921242 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909738    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 21:56:58.921242 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909741    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 21:56:58.921242 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909743    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 21:56:58.921242 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909746    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 21:56:58.921242 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909750    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 21:56:58.921242 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909752    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 21:56:58.921242 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909755    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 21:56:58.921716 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909758    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 21:56:58.921716 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909761    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 21:56:58.921716 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909764    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 21:56:58.921716 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909767    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 21:56:58.921716 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909770    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 21:56:58.921716 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909772    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 21:56:58.921716 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909775    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 21:56:58.921716 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909778    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 21:56:58.921716 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909780    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 21:56:58.921716 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909783    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 21:56:58.921716 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909786    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 21:56:58.921716 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909788    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 21:56:58.921716 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909790    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 21:56:58.921716 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909793    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 21:56:58.921716 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909797    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 21:56:58.921716 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909800    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 21:56:58.921716 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909802    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 21:56:58.921716 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909806    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 21:56:58.921716 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909808    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 21:56:58.921716 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909811    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 21:56:58.922210 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909813    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 21:56:58.922210 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909816    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 21:56:58.922210 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909819    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 21:56:58.922210 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909821    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 21:56:58.922210 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909824    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 21:56:58.922210 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909827    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 21:56:58.922210 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909829    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 21:56:58.922210 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909832    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 21:56:58.922210 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909834    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 21:56:58.922210 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909839    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 21:56:58.922210 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909841    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 21:56:58.922210 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909844    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 21:56:58.922210 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909847    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 21:56:58.922210 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909849    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 21:56:58.922210 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909852    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 21:56:58.922210 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909855    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 21:56:58.922210 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909857    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 21:56:58.922210 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909860    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 21:56:58.922210 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909862    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 21:56:58.922210 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909865    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 21:56:58.922675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909868    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 21:56:58.922675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909871    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 21:56:58.922675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909874    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 21:56:58.922675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909877    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 21:56:58.922675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909880    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 21:56:58.922675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909882    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 21:56:58.922675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909886    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 21:56:58.922675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909889    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 21:56:58.922675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909891    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 21:56:58.922675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909894    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 21:56:58.922675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909896    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 21:56:58.922675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909899    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 21:56:58.922675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909902    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 21:56:58.922675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909904    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 21:56:58.922675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909907    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 21:56:58.922675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909909    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 21:56:58.922675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909912    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 21:56:58.922675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909914    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 21:56:58.922675 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909918    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 21:56:58.923250 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909922    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 21:56:58.923250 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909925    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 21:56:58.923250 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909940    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 21:56:58.923250 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909943    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 21:56:58.923250 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909948    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 21:56:58.923250 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909952    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 21:56:58.923250 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909955    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 21:56:58.923250 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.909958    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 21:56:58.923250 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.918613    2576 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 02 21:56:58.923250 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.918631    2576 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 02 21:56:58.923250 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.918647    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 02 21:56:58.923250 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.918652    2576 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 02 21:56:58.923250 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918708    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 21:56:58.923250 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918714    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 21:56:58.923250 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918718    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 21:56:58.923250 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918722    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 21:56:58.923250 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918725    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 21:56:58.923250 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918729    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 21:56:58.923671 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918732    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 21:56:58.923671 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918736    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 21:56:58.923671 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918739    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 21:56:58.923671 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918741    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 21:56:58.923671 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918744    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 21:56:58.923671 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918747    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 21:56:58.923671 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918749    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 21:56:58.923671 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918754    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 21:56:58.923671 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918758    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 21:56:58.923671 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918761    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 21:56:58.923671 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918764    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 21:56:58.923671 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918767    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 21:56:58.923671 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918769    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 21:56:58.923671 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918772    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 21:56:58.923671 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918775    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 21:56:58.923671 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918777    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 21:56:58.923671 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918781    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 21:56:58.923671 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918783    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 21:56:58.923671 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918786    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 21:56:58.924138 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918789    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 21:56:58.924138 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918792    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 21:56:58.924138 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918795    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 21:56:58.924138 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918798    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 21:56:58.924138 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918801    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 21:56:58.924138 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918804    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 21:56:58.924138 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918807    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 21:56:58.924138 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918809    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 21:56:58.924138 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918812    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 21:56:58.924138 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918814    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 21:56:58.924138 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918816    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 21:56:58.924138 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918819    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 21:56:58.924138 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918822    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 21:56:58.924138 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918825    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 21:56:58.924138 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918828    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 21:56:58.924138 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918830    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 21:56:58.924138 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918833    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 21:56:58.924138 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918836    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 21:56:58.924138 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918838    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 21:56:58.924138 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918841    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 21:56:58.924639 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918843    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 21:56:58.924639 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918846    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 21:56:58.924639 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918849    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 21:56:58.924639 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918851    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 21:56:58.924639 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918854    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 21:56:58.924639 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918856    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 21:56:58.924639 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918859    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 21:56:58.924639 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918862    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 21:56:58.924639 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918864    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 21:56:58.924639 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918867    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 21:56:58.924639 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918870    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 21:56:58.924639 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918872    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 21:56:58.924639 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918875    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 21:56:58.924639 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918877    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 21:56:58.924639 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918880    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 21:56:58.924639 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918882    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 21:56:58.924639 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918885    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 21:56:58.924639 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918888    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 21:56:58.924639 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918891    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 21:56:58.924639 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918894    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 21:56:58.925119 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918896    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 21:56:58.925119 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918899    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 21:56:58.925119 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918901    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 21:56:58.925119 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918904    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 21:56:58.925119 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918906    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 21:56:58.925119 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918909    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 21:56:58.925119 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918912    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 21:56:58.925119 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918914    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 21:56:58.925119 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918917    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 21:56:58.925119 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918919    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 21:56:58.925119 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918922    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 21:56:58.925119 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918925    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 21:56:58.925119 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918927    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 21:56:58.925119 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918929    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 21:56:58.925119 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918932    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 21:56:58.925119 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918935    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 21:56:58.925119 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918937    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 21:56:58.925119 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918940    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 21:56:58.925119 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918942    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 21:56:58.925119 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918944    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 21:56:58.925628 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918947    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 21:56:58.925628 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918950    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 21:56:58.925628 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918952    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 21:56:58.925628 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918955    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 21:56:58.925628 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918958    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 21:56:58.925628 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918960    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 21:56:58.925628 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918963    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 21:56:58.925628 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918965    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 21:56:58.925628 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918968    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 21:56:58.925628 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918970    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 21:56:58.925628 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918973    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 21:56:58.925628 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918976    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 21:56:58.925628 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918979    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 21:56:58.925628 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918981    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 21:56:58.925628 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918984    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 21:56:58.925628 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918986    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 21:56:58.925628 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918989    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 21:56:58.925628 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918992    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 21:56:58.925628 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918995    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 21:56:58.926297 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.918998    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 21:56:58.926297 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919001    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 21:56:58.926297 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.919044    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 21:56:58.926297 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919188    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 21:56:58.926297 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919193    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 21:56:58.926297 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919196    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 21:56:58.926297 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919199    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 21:56:58.926297 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919202    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 21:56:58.926297 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919204    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 21:56:58.926297 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919207    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 21:56:58.926297 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919210    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 21:56:58.926297 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919214    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 21:56:58.926297 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919217    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 21:56:58.926297 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919220    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 21:56:58.926297 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919223    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 21:56:58.926812 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919226    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 21:56:58.926812 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919229    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 21:56:58.926812 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919232    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 21:56:58.926812 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919234    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 21:56:58.926812 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919237    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 21:56:58.926812 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919239    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 21:56:58.926812 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919243    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 21:56:58.926812 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919247    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 21:56:58.926812 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919251    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 21:56:58.926812 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919254    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 21:56:58.926812 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919257    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 21:56:58.926812 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919259    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 21:56:58.926812 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919262    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 21:56:58.926812 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919265    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 21:56:58.926812 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919267    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 21:56:58.926812 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919270    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 21:56:58.926812 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919272    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 21:56:58.926812 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919275    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 21:56:58.926812 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919277    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 21:56:58.927427 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919280    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 21:56:58.927427 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919282    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 21:56:58.927427 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919285    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 21:56:58.927427 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919287    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 21:56:58.927427 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919290    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 21:56:58.927427 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919292    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 21:56:58.927427 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919295    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 21:56:58.927427 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919298    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 21:56:58.927427 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919301    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 21:56:58.927427 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919304    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 21:56:58.927427 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919306    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 21:56:58.927427 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919309    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 21:56:58.927427 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919311    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 21:56:58.927427 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919314    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 21:56:58.927427 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919317    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 21:56:58.927427 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919320    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 21:56:58.927427 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919322    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 21:56:58.927427 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919325    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 21:56:58.927427 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919327    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 21:56:58.927912 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919330    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 21:56:58.927912 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919332    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 21:56:58.927912 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919337    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 21:56:58.927912 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919340    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 21:56:58.927912 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919343    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 21:56:58.927912 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919345    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 21:56:58.927912 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919348    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 21:56:58.927912 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919350    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 21:56:58.927912 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919353    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 21:56:58.927912 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919355    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 21:56:58.927912 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919358    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 21:56:58.927912 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919361    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 21:56:58.927912 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919363    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 21:56:58.927912 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919366    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 21:56:58.927912 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919368    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 21:56:58.927912 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919371    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 21:56:58.927912 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919374    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 21:56:58.927912 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919376    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 21:56:58.927912 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919379    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 21:56:58.927912 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919381    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 21:56:58.928448 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919384    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 21:56:58.928448 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919386    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 21:56:58.928448 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919390    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 21:56:58.928448 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919392    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 21:56:58.928448 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919395    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 21:56:58.928448 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919397    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 21:56:58.928448 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919400    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 21:56:58.928448 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919403    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 21:56:58.928448 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919405    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 21:56:58.928448 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919408    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 21:56:58.928448 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919410    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 21:56:58.928448 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919413    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 21:56:58.928448 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919415    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 21:56:58.928448 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919418    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 21:56:58.928448 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919422    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 21:56:58.928448 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919424    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 21:56:58.928448 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919427    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 21:56:58.928448 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919430    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 21:56:58.928448 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919433    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 21:56:58.928916 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919435    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 21:56:58.928916 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919438    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 21:56:58.928916 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919441    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 21:56:58.928916 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919443    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 21:56:58.928916 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919446    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 21:56:58.928916 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919448    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 21:56:58.928916 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919451    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 21:56:58.928916 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919453    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 21:56:58.928916 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919456    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 21:56:58.928916 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919459    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 21:56:58.928916 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919461    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 21:56:58.928916 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919464    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 21:56:58.928916 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919466    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 21:56:58.928916 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919469    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 21:56:58.928916 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919471    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 21:56:58.928916 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919474    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 21:56:58.928916 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919476    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 21:56:58.929328 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.919499    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 21:56:58.929328 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919530    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 21:56:58.929328 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919534    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 21:56:58.929328 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919537    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 21:56:58.929328 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919540    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 21:56:58.929328 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919542    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 21:56:58.929328 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919545    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 21:56:58.929328 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919549    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 21:56:58.929328 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919553    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 21:56:58.929328 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919556    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 21:56:58.929328 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919561    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 21:56:58.929328 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919563    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 21:56:58.929328 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919566    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 21:56:58.929328 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919569    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 21:56:58.929328 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919572    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 21:56:58.929692 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919575    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 21:56:58.929692 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919578    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 21:56:58.929692 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919580    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 21:56:58.929692 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919583    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 21:56:58.929692 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919586    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 21:56:58.929692 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919588    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 21:56:58.929692 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919591    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 21:56:58.929692 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919594    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 21:56:58.929692 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919596    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 21:56:58.929692 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919599    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 21:56:58.929692 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919601    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 21:56:58.929692 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919604    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 21:56:58.929692 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919607    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 21:56:58.929692 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919609    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 21:56:58.929692 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919612    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 21:56:58.929692 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919614    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 21:56:58.929692 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919617    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 21:56:58.929692 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919620    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 21:56:58.929692 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919622    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 21:56:58.930146 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919625    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 21:56:58.930146 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919628    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 21:56:58.930146 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919631    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 21:56:58.930146 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919633    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 21:56:58.930146 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919636    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 21:56:58.930146 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919638    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 21:56:58.930146 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919641    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 21:56:58.930146 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919644    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 21:56:58.930146 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919648    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 21:56:58.930146 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919650    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 21:56:58.930146 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919653    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 21:56:58.930146 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919655    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 21:56:58.930146 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919658    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 21:56:58.930146 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919661    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 21:56:58.930146 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919664    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 21:56:58.930146 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919666    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 21:56:58.930146 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919669    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 21:56:58.930146 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919671    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 21:56:58.930146 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919674    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 21:56:58.930146 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919677    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 21:56:58.930610 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919680    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 21:56:58.930610 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919682    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 21:56:58.930610 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919685    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 21:56:58.930610 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919687    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 21:56:58.930610 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919690    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 21:56:58.930610 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919692    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 21:56:58.930610 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919695    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 21:56:58.930610 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919697    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 21:56:58.930610 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919700    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 21:56:58.930610 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919702    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 21:56:58.930610 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919705    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 21:56:58.930610 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919708    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 21:56:58.930610 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919710    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 21:56:58.930610 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919713    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 21:56:58.930610 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919715    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 21:56:58.930610 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919718    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 21:56:58.930610 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919721    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 21:56:58.930610 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919723    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 21:56:58.930610 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919726    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 21:56:58.930610 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919729    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 21:56:58.931173 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919732    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 21:56:58.931173 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919735    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 21:56:58.931173 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919737    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 21:56:58.931173 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919740    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 21:56:58.931173 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919744    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 21:56:58.931173 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919746    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 21:56:58.931173 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919750    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 21:56:58.931173 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919753    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 21:56:58.931173 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919755    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 21:56:58.931173 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919758    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 21:56:58.931173 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919760    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 21:56:58.931173 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919763    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 21:56:58.931173 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919766    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 21:56:58.931173 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919768    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 21:56:58.931173 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919771    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 21:56:58.931173 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919773    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 21:56:58.931173 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919776    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 21:56:58.931173 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919778    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 21:56:58.931173 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919781    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 21:56:58.931173 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919783    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 21:56:58.931666 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919786    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 21:56:58.931666 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919789    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 21:56:58.931666 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919791    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 21:56:58.931666 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919794    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 21:56:58.931666 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919797    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 21:56:58.931666 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919799    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 21:56:58.931666 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919802    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 21:56:58.931666 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919804    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 21:56:58.931666 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919807    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 21:56:58.931666 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919811    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 21:56:58.931666 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919815    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 21:56:58.931666 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919818    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 21:56:58.931666 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:56:58.919821    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 21:56:58.931666 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.919872    2576 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 02 21:56:58.931666 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.922150    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Nov 02 21:56:58.931666 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.923146    2576 server.go:1014] "Starting client certificate rotation"
Nov 02 21:56:58.931666 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.923239    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 02 21:56:58.931666 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.923283    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 02 21:56:58.932120 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.927258    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 21:56:58.932120 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.930220    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 21:56:58.943649 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.943629    2576 log.go:25] "Validated CRI v1 runtime API"
Nov 02 21:56:58.947598 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.947572    2576 log.go:25] "Validated CRI v1 image API"
Nov 02 21:56:58.948497 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.948470    2576 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 02 21:56:58.951282 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.951263    2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a72734e9-356b-46fc-9417-554082807394:/dev/nvme0n1p3 e1969d1a-8b3c-4e62-a642-b354b236e62e:/dev/nvme0n1p4]
Nov 02 21:56:58.951348 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.951281    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Nov 02 21:56:58.956313 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.956203    2576 manager.go:217] Machine: {Timestamp:2026-11-02 21:56:58.954890112 +0000 UTC m=+0.375447291 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097404 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fa387954f7b2715f81efa868ec834 SystemUUID:ec2fa387-954f-7b27-15f8-1efa868ec834 BootID:98dda23f-2df4-4b3b-82d2-20e4f94df9f8 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f5:22:ba:91 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f5:22:ba:91 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:5d:e7:77:cf:4a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 02 21:56:58.956313 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.956308    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 02 21:56:58.956434 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.956407    2576 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 02 21:56:58.957436 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.957419    2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 02 21:56:58.960073 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.960054    2576 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 02 21:56:58.960203 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.960075    2576 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-132.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 02 21:56:58.960252 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.960205    2576 topology_manager.go:143] "Creating topology manager with none policy"
Nov 02 21:56:58.960252 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.960212    2576 container_manager_linux.go:311] "Creating device plugin manager"
Nov 02 21:56:58.960252 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.960222    2576 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 02 21:56:58.961213 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.961203    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 02 21:56:58.962334 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.962325    2576 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 02 21:56:58.966762 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.966751    2576 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 02 21:56:58.966872 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.966863    2576 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 02 21:56:58.966906 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.966892    2576 kubelet.go:493] "Attempting to sync node with API server"
Nov 02 21:56:58.966906 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.966902    2576 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 02 21:56:58.966993 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.966914    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 02 21:56:58.966993 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.966923    2576 kubelet.go:405] "Adding apiserver pod source"
Nov 02 21:56:58.966993 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.966930    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 02 21:56:58.967250 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.967238    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 02 21:56:58.970185 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.970167    2576 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 02 21:56:58.977085 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.977069    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 02 21:56:58.978132 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.978119    2576 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 02 21:56:58.978188 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.978150    2576 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 02 21:56:58.978305 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.978296    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 02 21:56:58.978338 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.978311    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 02 21:56:58.978338 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.978317    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 02 21:56:58.978338 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.978322    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 02 21:56:58.978338 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.978328    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 02 21:56:58.978338 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.978333    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 02 21:56:58.979172 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.979161    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 02 21:56:58.979172 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.979171    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 02 21:56:58.979255 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.979178    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 02 21:56:58.979255 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.979185    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 02 21:56:58.979255 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.979194    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 02 21:56:58.979255 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.979203    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 02 21:56:58.980908 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.980897    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 02 21:56:58.980908 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.980909    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 02 21:56:58.984626 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.984612    2576 server.go:1263] "Started kubelet"
Nov 02 21:56:58.984734 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.984682    2576 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 02 21:56:58.984847 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.984761    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 02 21:56:58.984847 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.984835    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 02 21:56:58.985288 ip-10-0-142-132 systemd[1]: Started Kubernetes Kubelet.
Nov 02 21:56:58.986255 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.986231    2576 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 02 21:56:58.987214 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.987201    2576 server.go:317] "Adding debug handlers to kubelet server"
Nov 02 21:56:58.990404 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:58.990378    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Nov 02 21:56:58.990404 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.990391    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-132.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Nov 02 21:56:58.990404 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:58.990410    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-132.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Nov 02 21:56:58.991455 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:58.990387    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-132.us-east-2.compute.internal.18e45931179abdf7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-132.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-132.us-east-2.compute.internal,},FirstTimestamp:2026-11-02 21:56:58.984586743 +0000 UTC m=+0.405143921,LastTimestamp:2026-11-02 21:56:58.984586743 +0000 UTC m=+0.405143921,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-132.us-east-2.compute.internal,}"
Nov 02 21:56:58.992386 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:58.992367    2576 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Nov 02 21:56:58.995020 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.994994    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 02 21:56:58.995881 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.995863    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p9v6b"
Nov 02 21:56:58.996228 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.996216    2576 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 02 21:56:58.996351 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:58.996332    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-132.us-east-2.compute.internal\" not found"
Nov 02 21:56:58.997045 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.997005    2576 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 02 21:56:58.997045 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.997045    2576 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 02 21:56:58.997173 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.997118    2576 reconstruct.go:97] "Volume reconstruction finished"
Nov 02 21:56:58.997173 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.997125    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 02 21:56:58.997173 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.997128    2576 reconciler.go:29] "Reconciler: start to sync state"
Nov 02 21:56:58.997360 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.997345    2576 factory.go:55] Registering systemd factory
Nov 02 21:56:58.997412 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.997363    2576 factory.go:223] Registration of the systemd container factory successfully
Nov 02 21:56:58.997567 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.997550    2576 factory.go:153] Registering CRI-O factory
Nov 02 21:56:58.997567 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.997569    2576 factory.go:223] Registration of the crio container factory successfully
Nov 02 21:56:58.997681 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.997653    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 02 21:56:58.997681 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.997673    2576 factory.go:103] Registering Raw factory
Nov 02 21:56:58.997748 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.997693    2576 manager.go:1199] Started watching for new ooms in manager
Nov 02 21:56:58.998770 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:58.998750    2576 manager.go:319] Starting recovery of all containers
Nov 02 21:56:59.000629 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:59.000602    2576 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-132.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Nov 02 21:56:59.004518 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.004492    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p9v6b"
Nov 02 21:56:59.007623 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:59.007599    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Nov 02 21:56:59.012050 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.012030    2576 manager.go:324] Recovery completed
Nov 02 21:56:59.015814 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.015798    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 21:56:59.018115 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.018100    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 21:56:59.018185 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.018127    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 21:56:59.018185 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.018137    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 21:56:59.018660 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.018647    2576 cpu_manager.go:226] "Starting" policy="none"
Nov 02 21:56:59.018660 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.018658    2576 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 02 21:56:59.018660 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.018660    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 21:56:59.018765 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.018673    2576 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 02 21:56:59.019337 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.019323    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 21:56:59.019385 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.019351    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 21:56:59.019385 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.019366    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 21:56:59.020720 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.020707    2576 policy_none.go:50] "Start"
Nov 02 21:56:59.020720 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.020722    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 02 21:56:59.020830 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.020737    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 02 21:56:59.022763 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.022750    2576 policy_none.go:44] "Start"
Nov 02 21:56:59.023239 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:59.022103    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-132.us-east-2.compute.internal.18e45931199a5275  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-132.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-132.us-east-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-132.us-east-2.compute.internal,},FirstTimestamp:2026-11-02 21:56:59.018113653 +0000 UTC m=+0.438670832,LastTimestamp:2026-11-02 21:56:59.018113653 +0000 UTC m=+0.438670832,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-132.us-east-2.compute.internal,}"
Nov 02 21:56:59.049774 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.049750    2576 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 02 21:56:59.075153 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.052969    2576 manager.go:341] "Starting Device Plugin manager"
Nov 02 21:56:59.075153 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:59.053648    2576 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 02 21:56:59.075153 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.053668    2576 server.go:87] "Starting device plugin registration server"
Nov 02 21:56:59.075153 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.053964    2576 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 02 21:56:59.075153 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.053975    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 02 21:56:59.075153 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.054175    2576 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 02 21:56:59.075153 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.054257    2576 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 02 21:56:59.075153 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.054265    2576 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 02 21:56:59.075153 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:59.054637    2576 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 02 21:56:59.075153 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:59.054684    2576 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-132.us-east-2.compute.internal\" not found"
Nov 02 21:56:59.075153 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.066539    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 02 21:56:59.075153 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.067769    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 02 21:56:59.075153 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.067790    2576 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 02 21:56:59.075153 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.067806    2576 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 02 21:56:59.075153 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:59.067837    2576 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Nov 02 21:56:59.075153 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.070984    2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 21:56:59.155164 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.155079    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 21:56:59.155939 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.155921    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 21:56:59.155997 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.155960    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 21:56:59.155997 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.155973    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 21:56:59.155997 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.155997    2576 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:56:59.168113 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.168098    2576 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:56:59.168199 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:59.168121    2576 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-132.us-east-2.compute.internal\": node \"ip-10-0-142-132.us-east-2.compute.internal\" not found"
Nov 02 21:56:59.168199 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.168170    2576 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal"]
Nov 02 21:56:59.168313 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.168237    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 21:56:59.169103 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.169088    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 21:56:59.169172 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.169117    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 21:56:59.169172 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.169127    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 21:56:59.171351 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.171338    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 21:56:59.171506 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.171490    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:56:59.171560 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.171526    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 21:56:59.172169 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.172146    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 21:56:59.172250 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.172182    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 21:56:59.172250 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.172196    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 21:56:59.172367 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.172197    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 21:56:59.172367 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.172314    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 21:56:59.172367 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.172333    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 21:56:59.174914 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.174898    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:56:59.175004 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.174930    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 21:56:59.176973 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.176961    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 21:56:59.177053 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.176984    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 21:56:59.177053 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.176994    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 21:56:59.186491 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:59.186471    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-132.us-east-2.compute.internal\" not found"
Nov 02 21:56:59.198121 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.198100    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48ed979d025ac3d838a4955411937a4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal\" (UID: \"48ed979d025ac3d838a4955411937a4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:56:59.198225 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.198127    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48ed979d025ac3d838a4955411937a4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal\" (UID: \"48ed979d025ac3d838a4955411937a4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:56:59.198225 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.198145    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3bcc33effb8bb32f83119c817ee77244-config\") pod \"kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal\" (UID: \"3bcc33effb8bb32f83119c817ee77244\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:56:59.203583 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:59.203563    2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-132.us-east-2.compute.internal\" not found" node="ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:56:59.206283 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:59.206263    2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-132.us-east-2.compute.internal\" not found" node="ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:56:59.286771 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:59.286742    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-132.us-east-2.compute.internal\" not found"
Nov 02 21:56:59.299101 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.299079    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48ed979d025ac3d838a4955411937a4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal\" (UID: \"48ed979d025ac3d838a4955411937a4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:56:59.299182 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.299104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48ed979d025ac3d838a4955411937a4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal\" (UID: \"48ed979d025ac3d838a4955411937a4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:56:59.299182 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.299132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3bcc33effb8bb32f83119c817ee77244-config\") pod \"kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal\" (UID: \"3bcc33effb8bb32f83119c817ee77244\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:56:59.299182 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.299170    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48ed979d025ac3d838a4955411937a4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal\" (UID: \"48ed979d025ac3d838a4955411937a4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:56:59.299278 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.299183    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3bcc33effb8bb32f83119c817ee77244-config\") pod \"kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal\" (UID: \"3bcc33effb8bb32f83119c817ee77244\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:56:59.299278 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.299183    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48ed979d025ac3d838a4955411937a4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal\" (UID: \"48ed979d025ac3d838a4955411937a4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:56:59.387261 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:59.387228    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-132.us-east-2.compute.internal\" not found"
Nov 02 21:56:59.487998 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:59.487937    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-132.us-east-2.compute.internal\" not found"
Nov 02 21:56:59.509458 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.509441    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:56:59.511607 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:56:59.511591    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:56:59.588721 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:59.588580    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-132.us-east-2.compute.internal\" not found"
Nov 02 21:56:59.689158 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:56:59.689127    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-132.us-east-2.compute.internal\" not found"
Nov 02 21:57:01.219815 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:01.219796    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-132.us-east-2.compute.internal\" not found"
Nov 02 21:57:01.248250 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.248206    2576 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 21:57:01.286094 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.286073    2576 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 21:57:01.326598 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.326578    2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:57:01.337031 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.337017    2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 21:57:01.338188 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.338176    2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:57:01.348268 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.348248    2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 21:57:01.353333 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.353313    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Nov 02 21:57:01.353448 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.353425    2576 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 02 21:57:01.353493 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.353468    2576 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 02 21:57:01.353527 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.353463    2576 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 02 21:57:01.397633 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.397607    2576 apiserver.go:52] "Watching apiserver"
Nov 02 21:57:01.416453 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.416434    2576 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 02 21:57:01.416693 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.416678    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-2njd6","kube-system/konnectivity-agent-fssjr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal","openshift-multus/network-metrics-daemon-qhm2w","openshift-network-diagnostics/network-check-target-s4zr8","openshift-ovn-kubernetes/ovnkube-node-gcbjt","openshift-cluster-node-tuning-operator/tuned-qg8mq","openshift-dns/node-resolver-kk66k","openshift-image-registry/node-ca-q9zww","openshift-multus/multus-additional-cni-plugins-rnjhr","openshift-multus/multus-t24vc","kube-system/global-pull-secret-syncer-g8bvh","kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal"]
Nov 02 21:57:01.418986 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.418966    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q9zww"
Nov 02 21:57:01.421073 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.421055    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:01.421168 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:01.421129    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bvh" podUID="0ad960f5-ae8d-43ed-950f-b6f93be7e101"
Nov 02 21:57:01.422926 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.422906    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 02 21:57:01.422926 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.422922    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 02 21:57:01.423154 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.422927    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 02 21:57:01.423154 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.423010    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dx8bh\""
Nov 02 21:57:01.423309 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.423274    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.425236 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.425208    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.425328 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.425299    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Nov 02 21:57:01.427290 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.427273    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:01.427383 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:01.427341    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhm2w" podUID="0272e533-4834-4d8e-a907-5c341eb20edb"
Nov 02 21:57:01.430058 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.430040    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.432235 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.432203    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kk66k"
Nov 02 21:57:01.433447 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.433422    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfgw6\" (UniqueName: \"kubernetes.io/projected/8778cf51-2f98-409f-855c-60002cb0504c-kube-api-access-kfgw6\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.433447 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.433448    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-modprobe-d\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.433568 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.433466    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-socket-dir-parent\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.433568 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.433491    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-daemon-config\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.433568 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.433547    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqzvz\" (UniqueName: \"kubernetes.io/projected/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-kube-api-access-vqzvz\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.433658 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.433600    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0ad960f5-ae8d-43ed-950f-b6f93be7e101-kubelet-config\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:01.433689 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.433644    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-sysconfig\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.433721 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.433687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-kubernetes\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.433755 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.433723    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj729\" (UniqueName: \"kubernetes.io/projected/0272e533-4834-4d8e-a907-5c341eb20edb-kube-api-access-qj729\") pod \"network-metrics-daemon-qhm2w\" (UID: \"0272e533-4834-4d8e-a907-5c341eb20edb\") " pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:01.433755 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.433743    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-etc-kubernetes\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.433839 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.433759    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2da733e7-c5c3-4170-b3c1-1817068ee620-host\") pod \"node-ca-q9zww\" (UID: \"2da733e7-c5c3-4170-b3c1-1817068ee620\") " pod="openshift-image-registry/node-ca-q9zww"
Nov 02 21:57:01.433839 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.433795    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0ad960f5-ae8d-43ed-950f-b6f93be7e101-dbus\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:01.433839 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.433833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-sys-fs\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.433968 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.433864    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-run\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.433968 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.433884    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-tmp\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.433968 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.433900    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-run-netns\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.433968 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.433929    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-var-lib-kubelet\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.433968 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.433950    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-conf-dir\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.434284 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.433985    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-etc-selinux\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.434284 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434013    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-cni-dir\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.434284 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-cnibin\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.434284 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434054    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2da733e7-c5c3-4170-b3c1-1817068ee620-serviceca\") pod \"node-ca-q9zww\" (UID: \"2da733e7-c5c3-4170-b3c1-1817068ee620\") " pod="openshift-image-registry/node-ca-q9zww"
Nov 02 21:57:01.434284 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-sysctl-d\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.434284 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434090    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs\") pod \"network-metrics-daemon-qhm2w\" (UID: \"0272e533-4834-4d8e-a907-5c341eb20edb\") " pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:01.434284 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434109    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-run-multus-certs\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.434284 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434128    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gggb5\" (UniqueName: \"kubernetes.io/projected/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-kube-api-access-gggb5\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.434284 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434143    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:01.434284 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-socket-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.434284 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434193    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-device-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.434284 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434211    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-systemd\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.434284 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-host\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.434923 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434327    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-hostroot\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.434923 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434361    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-lib-modules\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.434923 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434397    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-var-lib-kubelet\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.434923 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434422    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-tuned\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.434923 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434446    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-system-cni-dir\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.434923 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434482    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-var-lib-cni-bin\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.434923 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6vwb\" (UniqueName: \"kubernetes.io/projected/2da733e7-c5c3-4170-b3c1-1817068ee620-kube-api-access-c6vwb\") pod \"node-ca-q9zww\" (UID: \"2da733e7-c5c3-4170-b3c1-1817068ee620\") " pod="openshift-image-registry/node-ca-q9zww"
Nov 02 21:57:01.434923 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434548    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.434923 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434557    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.434923 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434576    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-registration-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.434923 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-sysctl-conf\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.434923 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-sys\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.434923 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434657    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-cni-binary-copy\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.434923 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-run-k8s-cni-cncf-io\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.434923 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.434722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-var-lib-cni-multus\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.437342 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.437296    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fssjr"
Nov 02 21:57:01.437869 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.437850    2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 02 21:57:01.441395 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.441374    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2njd6"
Nov 02 21:57:01.442281 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.442235    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-01 21:52:00 +0000 UTC" deadline="2028-07-20 07:19:48.247340798 +0000 UTC"
Nov 02 21:57:01.442281 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.442280    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15009h22m46.805064717s"
Nov 02 21:57:01.444051 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.444034    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.446821 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.446803    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:01.446898 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:01.446852    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4zr8" podUID="4debe5f2-cdbd-4b57-9af4-f984df529ff2"
Nov 02 21:57:01.455060 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.455041    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2jp25"
Nov 02 21:57:01.465348 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.465326    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2jp25"
Nov 02 21:57:01.524404 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.524381    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 02 21:57:01.524563 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.524426    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 02 21:57:01.524563 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.524439    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 02 21:57:01.524563 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.524508    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 02 21:57:01.524563 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.524544    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 02 21:57:01.524734 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.524567    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 02 21:57:01.524734 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.524576    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 02 21:57:01.524734 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.524597    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wtxk8\""
Nov 02 21:57:01.524734 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.524380    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 02 21:57:01.524734 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.524506    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 02 21:57:01.524734 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.524626    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 02 21:57:01.524734 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.524650    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 02 21:57:01.524734 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.524706    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 02 21:57:01.527199 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.526164    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4qcf6\""
Nov 02 21:57:01.527199 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.526251    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 02 21:57:01.527199 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.526280    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 02 21:57:01.527199 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.526452    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5tk4z\""
Nov 02 21:57:01.527199 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.526598    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 02 21:57:01.527199 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.526772    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 02 21:57:01.527199 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.526910    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 02 21:57:01.527199 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.527067    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 02 21:57:01.527199 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.527075    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 02 21:57:01.527199 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.527108    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 02 21:57:01.527742 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.527261    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 02 21:57:01.527742 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.527466    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7q497\""
Nov 02 21:57:01.527742 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.527520    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 02 21:57:01.527742 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.527727    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 02 21:57:01.527905 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.527788    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 02 21:57:01.527905 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.527863    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-447sr\""
Nov 02 21:57:01.527998 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.527911    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gf8xp\""
Nov 02 21:57:01.528045 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.528026    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-n7kkn\""
Nov 02 21:57:01.528290 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.528267    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-sd22g\""
Nov 02 21:57:01.530631 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.530325    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 02 21:57:01.535003 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.534978    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-cni-binary-copy\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.535113 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535014    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-run-k8s-cni-cncf-io\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.535113 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535037    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a7ce469-5b88-4552-bb1f-66a901701d43-hosts-file\") pod \"node-resolver-kk66k\" (UID: \"8a7ce469-5b88-4552-bb1f-66a901701d43\") " pod="openshift-dns/node-resolver-kk66k"
Nov 02 21:57:01.535193 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535146    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-modprobe-d\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.535193 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535183    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-socket-dir-parent\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.535345 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535203    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-run-k8s-cni-cncf-io\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.535345 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535212    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84d08f21-69d0-417b-a9cf-37f80bb4e332-cnibin\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.535345 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535256    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84d08f21-69d0-417b-a9cf-37f80bb4e332-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.535345 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535282    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/84d08f21-69d0-417b-a9cf-37f80bb4e332-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.535345 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535306    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79c8e674-3d99-4644-bf32-199d1de151a6-agent-certs\") pod \"konnectivity-agent-fssjr\" (UID: \"79c8e674-3d99-4644-bf32-199d1de151a6\") " pod="kube-system/konnectivity-agent-fssjr"
Nov 02 21:57:01.535345 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535315    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-modprobe-d\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.535345 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535329    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-systemd-units\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.535684 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0ad960f5-ae8d-43ed-950f-b6f93be7e101-kubelet-config\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:01.535684 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535401    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-sysconfig\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.535684 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535426    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj729\" (UniqueName: \"kubernetes.io/projected/0272e533-4834-4d8e-a907-5c341eb20edb-kube-api-access-qj729\") pod \"network-metrics-daemon-qhm2w\" (UID: \"0272e533-4834-4d8e-a907-5c341eb20edb\") " pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:01.535684 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535439    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-socket-dir-parent\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.535684 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535475    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-etc-kubernetes\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.535684 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535507    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0ad960f5-ae8d-43ed-950f-b6f93be7e101-kubelet-config\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:01.535684 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535517    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-sysconfig\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.535684 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535536    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-run\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.535684 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535555    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-tmp\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.535684 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535604    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-run-netns\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.535684 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535604    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-cni-binary-copy\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.535684 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535626    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-etc-openvswitch\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.535684 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535661    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-etc-kubernetes\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.536349 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535712    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-run-netns\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.536349 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535738    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1c203060-df7f-4287-b699-9fb6666b6c17-env-overrides\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.536349 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535769    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1c203060-df7f-4287-b699-9fb6666b6c17-ovnkube-script-lib\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.536349 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535807    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-cni-dir\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.536349 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535819    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-run\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.536349 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535845    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2da733e7-c5c3-4170-b3c1-1817068ee620-serviceca\") pod \"node-ca-q9zww\" (UID: \"2da733e7-c5c3-4170-b3c1-1817068ee620\") " pod="openshift-image-registry/node-ca-q9zww"
Nov 02 21:57:01.536349 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535870    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-node-log\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.536349 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535921    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-cni-dir\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.536349 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535928    2576 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 02 21:57:01.536349 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.535966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-cni-bin\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.536349 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536003    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-sysctl-d\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.536349 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536043    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-run-multus-certs\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.536349 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536079    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gggb5\" (UniqueName: \"kubernetes.io/projected/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-kube-api-access-gggb5\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.536349 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536103    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-run-openvswitch\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.536349 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536143    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/84d08f21-69d0-417b-a9cf-37f80bb4e332-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.536349 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536170    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9b9d\" (UniqueName: \"kubernetes.io/projected/8a7ce469-5b88-4552-bb1f-66a901701d43-kube-api-access-k9b9d\") pod \"node-resolver-kk66k\" (UID: \"8a7ce469-5b88-4552-bb1f-66a901701d43\") " pod="openshift-dns/node-resolver-kk66k"
Nov 02 21:57:01.536349 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536251    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-run-ovn-kubernetes\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.536349 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536260    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-run-multus-certs\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.537016 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536299    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1c203060-df7f-4287-b699-9fb6666b6c17-ovnkube-config\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.537016 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536306    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2da733e7-c5c3-4170-b3c1-1817068ee620-serviceca\") pod \"node-ca-q9zww\" (UID: \"2da733e7-c5c3-4170-b3c1-1817068ee620\") " pod="openshift-image-registry/node-ca-q9zww"
Nov 02 21:57:01.537016 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536322    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-slash\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.537016 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536350    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-lib-modules\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.537016 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536351    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-sysctl-d\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.537016 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536396    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-var-lib-kubelet\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.537016 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536489    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-var-lib-kubelet\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.537016 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536514    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-system-cni-dir\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.537016 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536529    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-lib-modules\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.537016 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536540    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-var-lib-cni-bin\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.537016 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536571    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6vwb\" (UniqueName: \"kubernetes.io/projected/2da733e7-c5c3-4170-b3c1-1817068ee620-kube-api-access-c6vwb\") pod \"node-ca-q9zww\" (UID: \"2da733e7-c5c3-4170-b3c1-1817068ee620\") " pod="openshift-image-registry/node-ca-q9zww"
Nov 02 21:57:01.537016 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536573    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-var-lib-cni-bin\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.537016 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536609    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-system-cni-dir\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.537016 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536675    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-log-socket\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.537016 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.537016 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-registration-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.537016 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536728    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-sysctl-conf\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.537835 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-sys\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.537835 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536794    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-registration-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.537835 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536796    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.537835 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536795    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-sys\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.537835 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536829    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-var-lib-cni-multus\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.537835 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536852    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh5cr\" (UniqueName: \"kubernetes.io/projected/02c98483-aa0a-483b-9e76-d578115bae14-kube-api-access-hh5cr\") pod \"iptables-alerter-2njd6\" (UID: \"02c98483-aa0a-483b-9e76-d578115bae14\") " pod="openshift-network-operator/iptables-alerter-2njd6"
Nov 02 21:57:01.537835 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7f9j\" (UniqueName: \"kubernetes.io/projected/1c203060-df7f-4287-b699-9fb6666b6c17-kube-api-access-s7f9j\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.537835 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536889    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-sysctl-conf\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.537835 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536896    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a7ce469-5b88-4552-bb1f-66a901701d43-tmp-dir\") pod \"node-resolver-kk66k\" (UID: \"8a7ce469-5b88-4552-bb1f-66a901701d43\") " pod="openshift-dns/node-resolver-kk66k"
Nov 02 21:57:01.537835 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536930    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-var-lib-cni-multus\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.537835 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.536992    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfgw6\" (UniqueName: \"kubernetes.io/projected/8778cf51-2f98-409f-855c-60002cb0504c-kube-api-access-kfgw6\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.537835 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537051    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-daemon-config\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.537835 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537081    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-run-systemd\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.537835 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537116    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqzvz\" (UniqueName: \"kubernetes.io/projected/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-kube-api-access-vqzvz\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.537835 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537138    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-kubernetes\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.537835 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537162    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2da733e7-c5c3-4170-b3c1-1817068ee620-host\") pod \"node-ca-q9zww\" (UID: \"2da733e7-c5c3-4170-b3c1-1817068ee620\") " pod="openshift-image-registry/node-ca-q9zww"
Nov 02 21:57:01.537835 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537182    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-kubelet\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.538704 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537275    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2da733e7-c5c3-4170-b3c1-1817068ee620-host\") pod \"node-ca-q9zww\" (UID: \"2da733e7-c5c3-4170-b3c1-1817068ee620\") " pod="openshift-image-registry/node-ca-q9zww"
Nov 02 21:57:01.538704 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537427    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-kubernetes\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.538704 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537466    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-run-ovn\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.538704 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537494    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c203060-df7f-4287-b699-9fb6666b6c17-ovn-node-metrics-cert\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.538704 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537496    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-daemon-config\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.538704 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537535    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0ad960f5-ae8d-43ed-950f-b6f93be7e101-dbus\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:01.538704 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-sys-fs\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.538704 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537603    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-var-lib-kubelet\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.538704 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-conf-dir\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.538704 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537628    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-sys-fs\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.538704 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537602    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0ad960f5-ae8d-43ed-950f-b6f93be7e101-dbus\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:01.538704 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537640    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/02c98483-aa0a-483b-9e76-d578115bae14-iptables-alerter-script\") pod \"iptables-alerter-2njd6\" (UID: \"02c98483-aa0a-483b-9e76-d578115bae14\") " pod="openshift-network-operator/iptables-alerter-2njd6"
Nov 02 21:57:01.538704 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537662    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-var-lib-kubelet\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.538704 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537680    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.538704 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537695    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-conf-dir\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.538704 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m55vd\" (UniqueName: \"kubernetes.io/projected/84d08f21-69d0-417b-a9cf-37f80bb4e332-kube-api-access-m55vd\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.538704 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537744    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79c8e674-3d99-4644-bf32-199d1de151a6-konnectivity-ca\") pod \"konnectivity-agent-fssjr\" (UID: \"79c8e674-3d99-4644-bf32-199d1de151a6\") " pod="kube-system/konnectivity-agent-fssjr"
Nov 02 21:57:01.539514 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-etc-selinux\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.539514 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537816    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-cnibin\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.539514 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537838    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs\") pod \"network-metrics-daemon-qhm2w\" (UID: \"0272e533-4834-4d8e-a907-5c341eb20edb\") " pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:01.539514 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537858    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-etc-selinux\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.539514 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537894    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-cnibin\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.539514 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:01.537909    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 21:57:01.539514 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537927    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-run-netns\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.539514 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.537968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-cni-netd\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.539514 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:01.537991    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs podName:0272e533-4834-4d8e-a907-5c341eb20edb nodeName:}" failed. No retries permitted until 2026-11-02 21:57:02.037970903 +0000 UTC m=+2.028321341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs") pod "network-metrics-daemon-qhm2w" (UID: "0272e533-4834-4d8e-a907-5c341eb20edb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 21:57:01.539514 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.538068    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:01.539514 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.538096    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-socket-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.539514 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.538119    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-device-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.539514 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.538141    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-systemd\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.539514 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:01.538177    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 21:57:01.539514 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.538232    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-host\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.539514 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:01.538239    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret podName:0ad960f5-ae8d-43ed-950f-b6f93be7e101 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:02.038208281 +0000 UTC m=+2.028558715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret") pod "global-pull-secret-syncer-g8bvh" (UID: "0ad960f5-ae8d-43ed-950f-b6f93be7e101") : object "kube-system"/"original-pull-secret" not registered
Nov 02 21:57:01.539514 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.538163    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-host\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.540359 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.538249    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-socket-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.540359 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.538275    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-device-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.540359 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.538276    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-hostroot\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.540359 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.538300    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-systemd\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.540359 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.538304    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84d08f21-69d0-417b-a9cf-37f80bb4e332-system-cni-dir\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.540359 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.538306    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-hostroot\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.540359 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.538327    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84d08f21-69d0-417b-a9cf-37f80bb4e332-cni-binary-copy\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.540359 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.538356    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-tuned\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.540359 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.538406    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02c98483-aa0a-483b-9e76-d578115bae14-host-slash\") pod \"iptables-alerter-2njd6\" (UID: \"02c98483-aa0a-483b-9e76-d578115bae14\") " pod="openshift-network-operator/iptables-alerter-2njd6"
Nov 02 21:57:01.540359 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.538435    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-var-lib-openvswitch\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.540359 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.538458    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl7lz\" (UniqueName: \"kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz\") pod \"network-check-target-s4zr8\" (UID: \"4debe5f2-cdbd-4b57-9af4-f984df529ff2\") " pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:01.540883 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.540546    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-tmp\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.541102 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.540903    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-tuned\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.544102 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.544047    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj729\" (UniqueName: \"kubernetes.io/projected/0272e533-4834-4d8e-a907-5c341eb20edb-kube-api-access-qj729\") pod \"network-metrics-daemon-qhm2w\" (UID: \"0272e533-4834-4d8e-a907-5c341eb20edb\") " pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:01.546777 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.546753    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6vwb\" (UniqueName: \"kubernetes.io/projected/2da733e7-c5c3-4170-b3c1-1817068ee620-kube-api-access-c6vwb\") pod \"node-ca-q9zww\" (UID: \"2da733e7-c5c3-4170-b3c1-1817068ee620\") " pod="openshift-image-registry/node-ca-q9zww"
Nov 02 21:57:01.546869 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.546835    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqzvz\" (UniqueName: \"kubernetes.io/projected/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-kube-api-access-vqzvz\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.546869 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.546850    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gggb5\" (UniqueName: \"kubernetes.io/projected/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-kube-api-access-gggb5\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.547302 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.547284    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfgw6\" (UniqueName: \"kubernetes.io/projected/8778cf51-2f98-409f-855c-60002cb0504c-kube-api-access-kfgw6\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.638900 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.638874    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-kubelet\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.638900 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.638902    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-run-ovn\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.639081 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.638918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c203060-df7f-4287-b699-9fb6666b6c17-ovn-node-metrics-cert\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.639081 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.638935    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/02c98483-aa0a-483b-9e76-d578115bae14-iptables-alerter-script\") pod \"iptables-alerter-2njd6\" (UID: \"02c98483-aa0a-483b-9e76-d578115bae14\") " pod="openshift-network-operator/iptables-alerter-2njd6"
Nov 02 21:57:01.639081 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.638953    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.639081 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.638985    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m55vd\" (UniqueName: \"kubernetes.io/projected/84d08f21-69d0-417b-a9cf-37f80bb4e332-kube-api-access-m55vd\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.639081 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.638983    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-run-ovn\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.639081 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.638996    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-kubelet\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.639081 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639008    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79c8e674-3d99-4644-bf32-199d1de151a6-konnectivity-ca\") pod \"konnectivity-agent-fssjr\" (UID: \"79c8e674-3d99-4644-bf32-199d1de151a6\") " pod="kube-system/konnectivity-agent-fssjr"
Nov 02 21:57:01.639081 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639033    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.639081 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639058    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-run-netns\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.639081 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639085    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-cni-netd\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.639554 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639131    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84d08f21-69d0-417b-a9cf-37f80bb4e332-system-cni-dir\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.639554 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639147    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84d08f21-69d0-417b-a9cf-37f80bb4e332-cni-binary-copy\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.639554 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639151    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-run-netns\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.639554 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639162    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02c98483-aa0a-483b-9e76-d578115bae14-host-slash\") pod \"iptables-alerter-2njd6\" (UID: \"02c98483-aa0a-483b-9e76-d578115bae14\") " pod="openshift-network-operator/iptables-alerter-2njd6"
Nov 02 21:57:01.639554 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639192    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02c98483-aa0a-483b-9e76-d578115bae14-host-slash\") pod \"iptables-alerter-2njd6\" (UID: \"02c98483-aa0a-483b-9e76-d578115bae14\") " pod="openshift-network-operator/iptables-alerter-2njd6"
Nov 02 21:57:01.639554 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639195    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-var-lib-openvswitch\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.639554 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639232    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84d08f21-69d0-417b-a9cf-37f80bb4e332-system-cni-dir\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.639554 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639240    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7lz\" (UniqueName: \"kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz\") pod \"network-check-target-s4zr8\" (UID: \"4debe5f2-cdbd-4b57-9af4-f984df529ff2\") " pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:01.639554 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639249    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-var-lib-openvswitch\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.639554 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639275    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a7ce469-5b88-4552-bb1f-66a901701d43-hosts-file\") pod \"node-resolver-kk66k\" (UID: \"8a7ce469-5b88-4552-bb1f-66a901701d43\") " pod="openshift-dns/node-resolver-kk66k"
Nov 02 21:57:01.639554 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639306    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84d08f21-69d0-417b-a9cf-37f80bb4e332-cnibin\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.639554 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84d08f21-69d0-417b-a9cf-37f80bb4e332-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.639554 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639277    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-cni-netd\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.639554 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639354    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/84d08f21-69d0-417b-a9cf-37f80bb4e332-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.639554 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639381    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79c8e674-3d99-4644-bf32-199d1de151a6-agent-certs\") pod \"konnectivity-agent-fssjr\" (UID: \"79c8e674-3d99-4644-bf32-199d1de151a6\") " pod="kube-system/konnectivity-agent-fssjr"
Nov 02 21:57:01.639554 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639387    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84d08f21-69d0-417b-a9cf-37f80bb4e332-cnibin\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.639554 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639391    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a7ce469-5b88-4552-bb1f-66a901701d43-hosts-file\") pod \"node-resolver-kk66k\" (UID: \"8a7ce469-5b88-4552-bb1f-66a901701d43\") " pod="openshift-dns/node-resolver-kk66k"
Nov 02 21:57:01.640343 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639404    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-systemd-units\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.640343 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639433    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-etc-openvswitch\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.640343 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639499    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1c203060-df7f-4287-b699-9fb6666b6c17-env-overrides\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.640343 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1c203060-df7f-4287-b699-9fb6666b6c17-ovnkube-script-lib\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.640343 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-node-log\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.640343 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639568    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84d08f21-69d0-417b-a9cf-37f80bb4e332-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.640343 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639574    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-cni-bin\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.640343 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639609    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-cni-bin\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.640343 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639620    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-run-openvswitch\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.640343 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639633    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79c8e674-3d99-4644-bf32-199d1de151a6-konnectivity-ca\") pod \"konnectivity-agent-fssjr\" (UID: \"79c8e674-3d99-4644-bf32-199d1de151a6\") " pod="kube-system/konnectivity-agent-fssjr"
Nov 02 21:57:01.640343 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639648    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/84d08f21-69d0-417b-a9cf-37f80bb4e332-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.640343 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639650    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-systemd-units\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.640343 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639685    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9b9d\" (UniqueName: \"kubernetes.io/projected/8a7ce469-5b88-4552-bb1f-66a901701d43-kube-api-access-k9b9d\") pod \"node-resolver-kk66k\" (UID: \"8a7ce469-5b88-4552-bb1f-66a901701d43\") " pod="openshift-dns/node-resolver-kk66k"
Nov 02 21:57:01.640343 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639688    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-run-openvswitch\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.640343 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-run-ovn-kubernetes\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.640343 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639741    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1c203060-df7f-4287-b699-9fb6666b6c17-ovnkube-config\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.640343 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639754    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-etc-openvswitch\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.641133 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639765    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-slash\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.641133 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639794    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-log-socket\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.641133 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh5cr\" (UniqueName: \"kubernetes.io/projected/02c98483-aa0a-483b-9e76-d578115bae14-kube-api-access-hh5cr\") pod \"iptables-alerter-2njd6\" (UID: \"02c98483-aa0a-483b-9e76-d578115bae14\") " pod="openshift-network-operator/iptables-alerter-2njd6"
Nov 02 21:57:01.641133 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639845    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7f9j\" (UniqueName: \"kubernetes.io/projected/1c203060-df7f-4287-b699-9fb6666b6c17-kube-api-access-s7f9j\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.641133 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639867    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a7ce469-5b88-4552-bb1f-66a901701d43-tmp-dir\") pod \"node-resolver-kk66k\" (UID: \"8a7ce469-5b88-4552-bb1f-66a901701d43\") " pod="openshift-dns/node-resolver-kk66k"
Nov 02 21:57:01.641133 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639892    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-run-systemd\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.641133 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639886    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84d08f21-69d0-417b-a9cf-37f80bb4e332-cni-binary-copy\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.641133 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.639941    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-run-ovn-kubernetes\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.641133 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.640034    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/84d08f21-69d0-417b-a9cf-37f80bb4e332-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.641133 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.640149    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-log-socket\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.641133 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.640270    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-slash\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.641133 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.640318    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-run-systemd\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.641133 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.640393    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a7ce469-5b88-4552-bb1f-66a901701d43-tmp-dir\") pod \"node-resolver-kk66k\" (UID: \"8a7ce469-5b88-4552-bb1f-66a901701d43\") " pod="openshift-dns/node-resolver-kk66k"
Nov 02 21:57:01.641133 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.640440    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/84d08f21-69d0-417b-a9cf-37f80bb4e332-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.641133 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.640447    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-node-log\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.641133 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.640753    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1c203060-df7f-4287-b699-9fb6666b6c17-ovnkube-config\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.641133 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.640813    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1c203060-df7f-4287-b699-9fb6666b6c17-ovnkube-script-lib\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.641897 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.640867    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1c203060-df7f-4287-b699-9fb6666b6c17-env-overrides\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.641897 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.640928    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/02c98483-aa0a-483b-9e76-d578115bae14-iptables-alerter-script\") pod \"iptables-alerter-2njd6\" (UID: \"02c98483-aa0a-483b-9e76-d578115bae14\") " pod="openshift-network-operator/iptables-alerter-2njd6"
Nov 02 21:57:01.641993 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.641978    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79c8e674-3d99-4644-bf32-199d1de151a6-agent-certs\") pod \"konnectivity-agent-fssjr\" (UID: \"79c8e674-3d99-4644-bf32-199d1de151a6\") " pod="kube-system/konnectivity-agent-fssjr"
Nov 02 21:57:01.642034 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.642009    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c203060-df7f-4287-b699-9fb6666b6c17-ovn-node-metrics-cert\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.642603 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:57:01.642579    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bcc33effb8bb32f83119c817ee77244.slice/crio-9cb2256f1d2af9eb3465c01d9bfe57bdbda5e7c0d4a3407e077c52d7bdd0877e WatchSource:0}: Error finding container 9cb2256f1d2af9eb3465c01d9bfe57bdbda5e7c0d4a3407e077c52d7bdd0877e: Status 404 returned error can't find the container with id 9cb2256f1d2af9eb3465c01d9bfe57bdbda5e7c0d4a3407e077c52d7bdd0877e
Nov 02 21:57:01.643547 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:57:01.643530    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48ed979d025ac3d838a4955411937a4b.slice/crio-6a016f0733425b28c300eda2cadfe4ce444b8c76ae459731a6185ecb670e9b3e WatchSource:0}: Error finding container 6a016f0733425b28c300eda2cadfe4ce444b8c76ae459731a6185ecb670e9b3e: Status 404 returned error can't find the container with id 6a016f0733425b28c300eda2cadfe4ce444b8c76ae459731a6185ecb670e9b3e
Nov 02 21:57:01.644862 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:01.644845    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 21:57:01.644862 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:01.644865    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 21:57:01.644968 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:01.644876    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jl7lz for pod openshift-network-diagnostics/network-check-target-s4zr8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 21:57:01.644968 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:01.644935    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz podName:4debe5f2-cdbd-4b57-9af4-f984df529ff2 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:02.144922619 +0000 UTC m=+2.135273038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jl7lz" (UniqueName: "kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz") pod "network-check-target-s4zr8" (UID: "4debe5f2-cdbd-4b57-9af4-f984df529ff2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 21:57:01.646983 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.646964    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m55vd\" (UniqueName: \"kubernetes.io/projected/84d08f21-69d0-417b-a9cf-37f80bb4e332-kube-api-access-m55vd\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.647775 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.647754    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7f9j\" (UniqueName: \"kubernetes.io/projected/1c203060-df7f-4287-b699-9fb6666b6c17-kube-api-access-s7f9j\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.648144 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.648106    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9b9d\" (UniqueName: \"kubernetes.io/projected/8a7ce469-5b88-4552-bb1f-66a901701d43-kube-api-access-k9b9d\") pod \"node-resolver-kk66k\" (UID: \"8a7ce469-5b88-4552-bb1f-66a901701d43\") " pod="openshift-dns/node-resolver-kk66k"
Nov 02 21:57:01.648689 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.648673    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 21:57:01.648851 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.648835    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh5cr\" (UniqueName: \"kubernetes.io/projected/02c98483-aa0a-483b-9e76-d578115bae14-kube-api-access-hh5cr\") pod \"iptables-alerter-2njd6\" (UID: \"02c98483-aa0a-483b-9e76-d578115bae14\") " pod="openshift-network-operator/iptables-alerter-2njd6"
Nov 02 21:57:01.748903 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.748835    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q9zww"
Nov 02 21:57:01.758622 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:57:01.758598    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da733e7_c5c3_4170_b3c1_1817068ee620.slice/crio-5e2abcd9f09d8ce60186c4cc7ad1e875096974fff3d7f2696f25e7565ca2419e WatchSource:0}: Error finding container 5e2abcd9f09d8ce60186c4cc7ad1e875096974fff3d7f2696f25e7565ca2419e: Status 404 returned error can't find the container with id 5e2abcd9f09d8ce60186c4cc7ad1e875096974fff3d7f2696f25e7565ca2419e
Nov 02 21:57:01.768359 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.768342    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:57:01.768439 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.768414    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:57:01.778850 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:57:01.778824    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8778cf51_2f98_409f_855c_60002cb0504c.slice/crio-ecddfcfb89279612dc47ce67924bc4cd4f9d0cdb698fd61fe3db7bc19a47dccf WatchSource:0}: Error finding container ecddfcfb89279612dc47ce67924bc4cd4f9d0cdb698fd61fe3db7bc19a47dccf: Status 404 returned error can't find the container with id ecddfcfb89279612dc47ce67924bc4cd4f9d0cdb698fd61fe3db7bc19a47dccf
Nov 02 21:57:01.779458 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:57:01.779430    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bf5775a_f2f1_4a1f_a259_71a4e9e58bcc.slice/crio-d453e14ee3247905ded676a33c754485a0f2e832e30450924ae1bb5b8e4fcbbb WatchSource:0}: Error finding container d453e14ee3247905ded676a33c754485a0f2e832e30450924ae1bb5b8e4fcbbb: Status 404 returned error can't find the container with id d453e14ee3247905ded676a33c754485a0f2e832e30450924ae1bb5b8e4fcbbb
Nov 02 21:57:01.780664 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.780647    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t24vc"
Nov 02 21:57:01.788814 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:57:01.788791    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ff33c25_9556_45d7_8f7b_ca8f45a35c86.slice/crio-ffd06d38137ca6866ffbc023bdcef223f05cbe283e2bb0a3aca63d6ef51d6f6e WatchSource:0}: Error finding container ffd06d38137ca6866ffbc023bdcef223f05cbe283e2bb0a3aca63d6ef51d6f6e: Status 404 returned error can't find the container with id ffd06d38137ca6866ffbc023bdcef223f05cbe283e2bb0a3aca63d6ef51d6f6e
Nov 02 21:57:01.804767 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.804732    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kk66k"
Nov 02 21:57:01.812968 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:57:01.812941    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7ce469_5b88_4552_bb1f_66a901701d43.slice/crio-219da624c562cfd1d677dce98cf027fc7f35f7997a837805ad8508f4cde55fa7 WatchSource:0}: Error finding container 219da624c562cfd1d677dce98cf027fc7f35f7997a837805ad8508f4cde55fa7: Status 404 returned error can't find the container with id 219da624c562cfd1d677dce98cf027fc7f35f7997a837805ad8508f4cde55fa7
Nov 02 21:57:01.841358 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.841334    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:01.843451 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.843434    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fssjr"
Nov 02 21:57:01.851320 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:57:01.851294    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c203060_df7f_4287_b699_9fb6666b6c17.slice/crio-ecf275fb3cbf9215368eae87c3d62b457f2acceb7456057a7b25ceb8fa7386cf WatchSource:0}: Error finding container ecf275fb3cbf9215368eae87c3d62b457f2acceb7456057a7b25ceb8fa7386cf: Status 404 returned error can't find the container with id ecf275fb3cbf9215368eae87c3d62b457f2acceb7456057a7b25ceb8fa7386cf
Nov 02 21:57:01.853362 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:57:01.853344    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c8e674_3d99_4644_bf32_199d1de151a6.slice/crio-50fde3f5535230faaf9a733db5200794720237e10ce2d005d78e0401da40a28e WatchSource:0}: Error finding container 50fde3f5535230faaf9a733db5200794720237e10ce2d005d78e0401da40a28e: Status 404 returned error can't find the container with id 50fde3f5535230faaf9a733db5200794720237e10ce2d005d78e0401da40a28e
Nov 02 21:57:01.861604 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.861589    2576 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 21:57:01.868679 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.868661    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2njd6"
Nov 02 21:57:01.876976 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:57:01.876959    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c98483_aa0a_483b_9e76_d578115bae14.slice/crio-8ea1662581010af275cece56f47eb0dc3e7a3e178a9800b5405199d875e89ae3 WatchSource:0}: Error finding container 8ea1662581010af275cece56f47eb0dc3e7a3e178a9800b5405199d875e89ae3: Status 404 returned error can't find the container with id 8ea1662581010af275cece56f47eb0dc3e7a3e178a9800b5405199d875e89ae3
Nov 02 21:57:01.886441 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:01.886425    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:57:01.895625 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:57:01.895606    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84d08f21_69d0_417b_a9cf_37f80bb4e332.slice/crio-19a0166b7b57f1314231357853b58cff5e8e3a71946dbef05a399c9d0e819f62 WatchSource:0}: Error finding container 19a0166b7b57f1314231357853b58cff5e8e3a71946dbef05a399c9d0e819f62: Status 404 returned error can't find the container with id 19a0166b7b57f1314231357853b58cff5e8e3a71946dbef05a399c9d0e819f62
Nov 02 21:57:02.043483 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:02.043425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs\") pod \"network-metrics-daemon-qhm2w\" (UID: \"0272e533-4834-4d8e-a907-5c341eb20edb\") " pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:02.043483 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:02.043455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:02.043613 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:02.043565    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 21:57:02.043613 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:02.043577    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 21:57:02.043674 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:02.043613    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs podName:0272e533-4834-4d8e-a907-5c341eb20edb nodeName:}" failed. No retries permitted until 2026-11-02 21:57:03.04359935 +0000 UTC m=+3.033949783 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs") pod "network-metrics-daemon-qhm2w" (UID: "0272e533-4834-4d8e-a907-5c341eb20edb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 21:57:02.043674 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:02.043656    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret podName:0ad960f5-ae8d-43ed-950f-b6f93be7e101 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:03.043638442 +0000 UTC m=+3.033988860 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret") pod "global-pull-secret-syncer-g8bvh" (UID: "0ad960f5-ae8d-43ed-950f-b6f93be7e101") : object "kube-system"/"original-pull-secret" not registered
Nov 02 21:57:02.244555 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:02.244524    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7lz\" (UniqueName: \"kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz\") pod \"network-check-target-s4zr8\" (UID: \"4debe5f2-cdbd-4b57-9af4-f984df529ff2\") " pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:02.244707 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:02.244667    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 21:57:02.244707 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:02.244682    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 21:57:02.244707 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:02.244691    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jl7lz for pod openshift-network-diagnostics/network-check-target-s4zr8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 21:57:02.244863 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:02.244741    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz podName:4debe5f2-cdbd-4b57-9af4-f984df529ff2 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:03.244727771 +0000 UTC m=+3.235078190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jl7lz" (UniqueName: "kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz") pod "network-check-target-s4zr8" (UID: "4debe5f2-cdbd-4b57-9af4-f984df529ff2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 21:57:02.468709 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:02.468553    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 21:52:01 +0000 UTC" deadline="2028-04-11 16:44:43.696726209 +0000 UTC"
Nov 02 21:57:02.468709 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:02.468620    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12618h47m41.228110561s"
Nov 02 21:57:02.527112 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:02.526996    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fssjr" event={"ID":"79c8e674-3d99-4644-bf32-199d1de151a6","Type":"ContainerStarted","Data":"50fde3f5535230faaf9a733db5200794720237e10ce2d005d78e0401da40a28e"}
Nov 02 21:57:02.531209 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:02.531173    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt" event={"ID":"1c203060-df7f-4287-b699-9fb6666b6c17","Type":"ContainerStarted","Data":"ecf275fb3cbf9215368eae87c3d62b457f2acceb7456057a7b25ceb8fa7386cf"}
Nov 02 21:57:02.543318 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:02.543158    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kk66k" event={"ID":"8a7ce469-5b88-4552-bb1f-66a901701d43","Type":"ContainerStarted","Data":"219da624c562cfd1d677dce98cf027fc7f35f7997a837805ad8508f4cde55fa7"}
Nov 02 21:57:02.546645 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:02.546563    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t24vc" event={"ID":"8ff33c25-9556-45d7-8f7b-ca8f45a35c86","Type":"ContainerStarted","Data":"ffd06d38137ca6866ffbc023bdcef223f05cbe283e2bb0a3aca63d6ef51d6f6e"}
Nov 02 21:57:02.550008 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:02.549903    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw" event={"ID":"8778cf51-2f98-409f-855c-60002cb0504c","Type":"ContainerStarted","Data":"ecddfcfb89279612dc47ce67924bc4cd4f9d0cdb698fd61fe3db7bc19a47dccf"}
Nov 02 21:57:02.559479 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:02.559447    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rnjhr" event={"ID":"84d08f21-69d0-417b-a9cf-37f80bb4e332","Type":"ContainerStarted","Data":"19a0166b7b57f1314231357853b58cff5e8e3a71946dbef05a399c9d0e819f62"}
Nov 02 21:57:02.564325 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:02.564304    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2njd6" event={"ID":"02c98483-aa0a-483b-9e76-d578115bae14","Type":"ContainerStarted","Data":"8ea1662581010af275cece56f47eb0dc3e7a3e178a9800b5405199d875e89ae3"}
Nov 02 21:57:02.580802 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:02.580706    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qg8mq" event={"ID":"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc","Type":"ContainerStarted","Data":"d453e14ee3247905ded676a33c754485a0f2e832e30450924ae1bb5b8e4fcbbb"}
Nov 02 21:57:02.591070 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:02.591041    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q9zww" event={"ID":"2da733e7-c5c3-4170-b3c1-1817068ee620","Type":"ContainerStarted","Data":"5e2abcd9f09d8ce60186c4cc7ad1e875096974fff3d7f2696f25e7565ca2419e"}
Nov 02 21:57:02.594992 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:02.594909    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal" event={"ID":"3bcc33effb8bb32f83119c817ee77244","Type":"ContainerStarted","Data":"9cb2256f1d2af9eb3465c01d9bfe57bdbda5e7c0d4a3407e077c52d7bdd0877e"}
Nov 02 21:57:02.605689 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:02.605578    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal" event={"ID":"48ed979d025ac3d838a4955411937a4b","Type":"ContainerStarted","Data":"6a016f0733425b28c300eda2cadfe4ce444b8c76ae459731a6185ecb670e9b3e"}
Nov 02 21:57:02.869808 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:02.869704    2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 21:57:03.050197 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:03.050162    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs\") pod \"network-metrics-daemon-qhm2w\" (UID: \"0272e533-4834-4d8e-a907-5c341eb20edb\") " pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:03.050197 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:03.050196    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:03.050471 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:03.050334    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 21:57:03.050471 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:03.050379    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 21:57:03.050471 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:03.050396    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs podName:0272e533-4834-4d8e-a907-5c341eb20edb nodeName:}" failed. No retries permitted until 2026-11-02 21:57:05.050377819 +0000 UTC m=+5.040728254 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs") pod "network-metrics-daemon-qhm2w" (UID: "0272e533-4834-4d8e-a907-5c341eb20edb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 21:57:03.050471 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:03.050414    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret podName:0ad960f5-ae8d-43ed-950f-b6f93be7e101 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:05.050403974 +0000 UTC m=+5.040754407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret") pod "global-pull-secret-syncer-g8bvh" (UID: "0ad960f5-ae8d-43ed-950f-b6f93be7e101") : object "kube-system"/"original-pull-secret" not registered
Nov 02 21:57:03.252589 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:03.252512    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7lz\" (UniqueName: \"kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz\") pod \"network-check-target-s4zr8\" (UID: \"4debe5f2-cdbd-4b57-9af4-f984df529ff2\") " pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:03.252754 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:03.252721    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 21:57:03.252754 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:03.252740    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 21:57:03.252754 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:03.252754    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jl7lz for pod openshift-network-diagnostics/network-check-target-s4zr8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 21:57:03.252909 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:03.252808    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz podName:4debe5f2-cdbd-4b57-9af4-f984df529ff2 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:05.252790504 +0000 UTC m=+5.243140926 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jl7lz" (UniqueName: "kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz") pod "network-check-target-s4zr8" (UID: "4debe5f2-cdbd-4b57-9af4-f984df529ff2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 21:57:03.469353 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:03.469258    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 21:52:01 +0000 UTC" deadline="2028-05-05 06:04:55.093954456 +0000 UTC"
Nov 02 21:57:03.469353 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:03.469303    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13184h7m51.624658606s"
Nov 02 21:57:03.485565 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:03.485529    2576 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 21:57:03.499187 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:03.499159    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:03.499374 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:03.499304    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bvh" podUID="0ad960f5-ae8d-43ed-950f-b6f93be7e101"
Nov 02 21:57:03.499700 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:03.499679    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:03.499814 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:03.499783    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhm2w" podUID="0272e533-4834-4d8e-a907-5c341eb20edb"
Nov 02 21:57:03.499873 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:03.499852    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:03.499928 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:03.499918    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4zr8" podUID="4debe5f2-cdbd-4b57-9af4-f984df529ff2"
Nov 02 21:57:04.368242 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:04.368200    2576 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 21:57:05.070970 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:05.070927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs\") pod \"network-metrics-daemon-qhm2w\" (UID: \"0272e533-4834-4d8e-a907-5c341eb20edb\") " pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:05.070970 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:05.070960    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:05.071660 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:05.071083    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 21:57:05.071660 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:05.071141    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret podName:0ad960f5-ae8d-43ed-950f-b6f93be7e101 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:09.07112449 +0000 UTC m=+9.061474924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret") pod "global-pull-secret-syncer-g8bvh" (UID: "0ad960f5-ae8d-43ed-950f-b6f93be7e101") : object "kube-system"/"original-pull-secret" not registered
Nov 02 21:57:05.071660 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:05.071474    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 21:57:05.071660 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:05.071513    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs podName:0272e533-4834-4d8e-a907-5c341eb20edb nodeName:}" failed. No retries permitted until 2026-11-02 21:57:09.071501242 +0000 UTC m=+9.061851674 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs") pod "network-metrics-daemon-qhm2w" (UID: "0272e533-4834-4d8e-a907-5c341eb20edb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 21:57:05.272687 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:05.272286    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7lz\" (UniqueName: \"kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz\") pod \"network-check-target-s4zr8\" (UID: \"4debe5f2-cdbd-4b57-9af4-f984df529ff2\") " pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:05.272687 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:05.272472    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 21:57:05.272687 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:05.272494    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 21:57:05.272687 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:05.272507    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jl7lz for pod openshift-network-diagnostics/network-check-target-s4zr8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 21:57:05.272687 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:05.272559    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz podName:4debe5f2-cdbd-4b57-9af4-f984df529ff2 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:09.272542124 +0000 UTC m=+9.262892559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jl7lz" (UniqueName: "kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz") pod "network-check-target-s4zr8" (UID: "4debe5f2-cdbd-4b57-9af4-f984df529ff2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 21:57:05.499605 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:05.499254    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:05.499605 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:05.499340    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:05.499605 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:05.499451    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bvh" podUID="0ad960f5-ae8d-43ed-950f-b6f93be7e101"
Nov 02 21:57:05.500006 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:05.499945    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4zr8" podUID="4debe5f2-cdbd-4b57-9af4-f984df529ff2"
Nov 02 21:57:05.500094 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:05.500046    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:05.500161 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:05.500144    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhm2w" podUID="0272e533-4834-4d8e-a907-5c341eb20edb"
Nov 02 21:57:06.626430 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:06.626197    2576 generic.go:356] "Generic (PLEG): container finished" podID="84d08f21-69d0-417b-a9cf-37f80bb4e332" containerID="9a58159f483b45cfddbdd415850c50ad5a0bdcb415697aff018edf83a7395ca6" exitCode=0
Nov 02 21:57:06.627421 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:06.627395    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rnjhr" event={"ID":"84d08f21-69d0-417b-a9cf-37f80bb4e332","Type":"ContainerDied","Data":"9a58159f483b45cfddbdd415850c50ad5a0bdcb415697aff018edf83a7395ca6"}
Nov 02 21:57:06.630177 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:06.630023    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal" event={"ID":"3bcc33effb8bb32f83119c817ee77244","Type":"ContainerStarted","Data":"ae5a617265733bae796b479e7614c41e3ced2a59c8ba9e3eddb0a0ac4edac548"}
Nov 02 21:57:06.636821 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:06.636354    2576 generic.go:356] "Generic (PLEG): container finished" podID="48ed979d025ac3d838a4955411937a4b" containerID="1fec51599f27ad5f33ed7ba20fb889e9f3e35a2b0f9e99224f215f741a3b764e" exitCode=0
Nov 02 21:57:06.636821 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:06.636387    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal" event={"ID":"48ed979d025ac3d838a4955411937a4b","Type":"ContainerDied","Data":"1fec51599f27ad5f33ed7ba20fb889e9f3e35a2b0f9e99224f215f741a3b764e"}
Nov 02 21:57:07.499287 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:07.498456    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:07.499287 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:07.498613    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhm2w" podUID="0272e533-4834-4d8e-a907-5c341eb20edb"
Nov 02 21:57:07.499287 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:07.498987    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:07.499287 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:07.499074    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4zr8" podUID="4debe5f2-cdbd-4b57-9af4-f984df529ff2"
Nov 02 21:57:07.499287 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:07.499124    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:07.499287 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:07.499190    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bvh" podUID="0ad960f5-ae8d-43ed-950f-b6f93be7e101"
Nov 02 21:57:07.642250 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:07.641595    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q9zww" event={"ID":"2da733e7-c5c3-4170-b3c1-1817068ee620","Type":"ContainerStarted","Data":"b1a2159757e900bf0426ca6d557c1b14fedbc8beb87588a40a69b372b2a0b02e"}
Nov 02 21:57:07.647333 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:07.647246    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal" event={"ID":"48ed979d025ac3d838a4955411937a4b","Type":"ContainerStarted","Data":"50e066023e045662a7538ab54d6705ac8e5e91c6d7d060e5fa0f9e03df0a852b"}
Nov 02 21:57:07.650654 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:07.650382    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fssjr" event={"ID":"79c8e674-3d99-4644-bf32-199d1de151a6","Type":"ContainerStarted","Data":"a81570879f6a89a8842055b3ac8ad58065cc238f6747a323905e49a6b3235208"}
Nov 02 21:57:07.657455 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:07.656899    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal" podStartSLOduration=6.65688373 podStartE2EDuration="6.65688373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:57:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:57:06.679482495 +0000 UTC m=+6.669832936" watchObservedRunningTime="2026-11-02 21:57:07.65688373 +0000 UTC m=+7.647234179"
Nov 02 21:57:07.674862 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:07.674335    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q9zww" podStartSLOduration=2.317330543 podStartE2EDuration="7.674319218s" totalImagesPullingTime="5.356988675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:57:07.6573146 +0000 UTC m=+7.647665041" watchObservedRunningTime="2026-11-02 21:57:07.674319218 +0000 UTC m=+7.664669661"
Nov 02 21:57:07.674862 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:07.674726    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fssjr" podStartSLOduration=3.040280177 podStartE2EDuration="7.674715404s" totalImagesPullingTime="4.634435227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:57:07.673572741 +0000 UTC m=+7.663923183" watchObservedRunningTime="2026-11-02 21:57:07.674715404 +0000 UTC m=+7.665065845"
Nov 02 21:57:08.657810 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:08.657770    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw" event={"ID":"8778cf51-2f98-409f-855c-60002cb0504c","Type":"ContainerStarted","Data":"7ac9c4beda1e7d7d653d200673c7775452f6516492e3e0f60b0e15a9cf7d5c16"}
Nov 02 21:57:09.105815 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:09.105781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs\") pod \"network-metrics-daemon-qhm2w\" (UID: \"0272e533-4834-4d8e-a907-5c341eb20edb\") " pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:09.105985 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:09.105828    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:09.105985 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:09.105943    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 21:57:09.106087 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:09.105988    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret podName:0ad960f5-ae8d-43ed-950f-b6f93be7e101 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:17.105976847 +0000 UTC m=+17.096327267 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret") pod "global-pull-secret-syncer-g8bvh" (UID: "0ad960f5-ae8d-43ed-950f-b6f93be7e101") : object "kube-system"/"original-pull-secret" not registered
Nov 02 21:57:09.106087 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:09.106028    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 21:57:09.106087 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:09.106048    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs podName:0272e533-4834-4d8e-a907-5c341eb20edb nodeName:}" failed. No retries permitted until 2026-11-02 21:57:17.106041979 +0000 UTC m=+17.096392397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs") pod "network-metrics-daemon-qhm2w" (UID: "0272e533-4834-4d8e-a907-5c341eb20edb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 21:57:09.307069 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:09.306570    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7lz\" (UniqueName: \"kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz\") pod \"network-check-target-s4zr8\" (UID: \"4debe5f2-cdbd-4b57-9af4-f984df529ff2\") " pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:09.307069 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:09.306691    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 21:57:09.307069 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:09.306707    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 21:57:09.307069 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:09.306716    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jl7lz for pod openshift-network-diagnostics/network-check-target-s4zr8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 21:57:09.307069 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:09.306759    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz podName:4debe5f2-cdbd-4b57-9af4-f984df529ff2 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:17.306746975 +0000 UTC m=+17.297097406 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jl7lz" (UniqueName: "kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz") pod "network-check-target-s4zr8" (UID: "4debe5f2-cdbd-4b57-9af4-f984df529ff2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 21:57:09.498714 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:09.498678    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:09.498856 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:09.498815    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4zr8" podUID="4debe5f2-cdbd-4b57-9af4-f984df529ff2"
Nov 02 21:57:09.499188 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:09.499170    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:09.499307 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:09.499287    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bvh" podUID="0ad960f5-ae8d-43ed-950f-b6f93be7e101"
Nov 02 21:57:09.499364 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:09.499357    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:09.499460 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:09.499442    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhm2w" podUID="0272e533-4834-4d8e-a907-5c341eb20edb"
Nov 02 21:57:09.616525 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:09.616480    2576 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 02 21:57:09.662481 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:09.662445    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw" event={"ID":"8778cf51-2f98-409f-855c-60002cb0504c","Type":"ContainerStarted","Data":"0a613dda8a400f080c2283cb801a8033a8f4547629c661cfe801b9ba3616be64"}
Nov 02 21:57:09.975468 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:09.974806    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fssjr"
Nov 02 21:57:09.975783 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:09.975765    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fssjr"
Nov 02 21:57:09.989667 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:09.989620    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal" podStartSLOduration=8.989607955 podStartE2EDuration="8.989607955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:57:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:57:07.689572141 +0000 UTC m=+7.679922599" watchObservedRunningTime="2026-11-02 21:57:09.989607955 +0000 UTC m=+9.979958394"
Nov 02 21:57:10.415787 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:10.415761    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fssjr"
Nov 02 21:57:10.416271 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:10.416248    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fssjr"
Nov 02 21:57:10.490253 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:10.489441    2576 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-02T21:57:09.616500551Z","UUID":"b72dafe2-fa56-4d28-82fe-85e9700bb7f0","Handler":null,"Name":"","Endpoint":""}
Nov 02 21:57:10.494783 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:10.494381    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 02 21:57:10.494783 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:10.494412    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 02 21:57:10.666882 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:10.666614    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kk66k" event={"ID":"8a7ce469-5b88-4552-bb1f-66a901701d43","Type":"ContainerStarted","Data":"07aeff67d9b1b267a1519a8675036f29382c91f605607616ba8cc662329f752f"}
Nov 02 21:57:10.668590 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:10.668560    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t24vc" event={"ID":"8ff33c25-9556-45d7-8f7b-ca8f45a35c86","Type":"ContainerStarted","Data":"a1b4bc3d3d362532040fd98ff619ccb7be44d2ffad91fc464a3385b19cf6afdb"}
Nov 02 21:57:10.670676 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:10.670648    2576 generic.go:356] "Generic (PLEG): container finished" podID="84d08f21-69d0-417b-a9cf-37f80bb4e332" containerID="09243965903bc98c988ff968db86c69d1a75a3413297b913854a1a4c2abfbfee" exitCode=0
Nov 02 21:57:10.670833 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:10.670724    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rnjhr" event={"ID":"84d08f21-69d0-417b-a9cf-37f80bb4e332","Type":"ContainerDied","Data":"09243965903bc98c988ff968db86c69d1a75a3413297b913854a1a4c2abfbfee"}
Nov 02 21:57:10.682401 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:10.682344    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-kk66k" podStartSLOduration=2.33651374 podStartE2EDuration="10.682329812s" totalImagesPullingTime="8.345816072s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:57:10.681923056 +0000 UTC m=+10.672273498" watchObservedRunningTime="2026-11-02 21:57:10.682329812 +0000 UTC m=+10.672680274"
Nov 02 21:57:10.699327 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:10.699249    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-t24vc" podStartSLOduration=2.6407483320000003 podStartE2EDuration="10.699192699s" totalImagesPullingTime="8.058444367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:57:10.69824619 +0000 UTC m=+10.688596641" watchObservedRunningTime="2026-11-02 21:57:10.699192699 +0000 UTC m=+10.689543149"
Nov 02 21:57:11.498567 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:11.498538    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:11.498709 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:11.498586    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:11.498709 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:11.498654    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:11.498709 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:11.498666    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bvh" podUID="0ad960f5-ae8d-43ed-950f-b6f93be7e101"
Nov 02 21:57:11.498864 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:11.498741    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhm2w" podUID="0272e533-4834-4d8e-a907-5c341eb20edb"
Nov 02 21:57:11.498864 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:11.498824    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4zr8" podUID="4debe5f2-cdbd-4b57-9af4-f984df529ff2"
Nov 02 21:57:11.675023 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:11.674949    2576 generic.go:356] "Generic (PLEG): container finished" podID="84d08f21-69d0-417b-a9cf-37f80bb4e332" containerID="cd1965b08c4ee30d631c432bd3d6ae156a6cdd58942fb99c98609b639c1d7f84" exitCode=0
Nov 02 21:57:11.675551 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:11.675035    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rnjhr" event={"ID":"84d08f21-69d0-417b-a9cf-37f80bb4e332","Type":"ContainerDied","Data":"cd1965b08c4ee30d631c432bd3d6ae156a6cdd58942fb99c98609b639c1d7f84"}
Nov 02 21:57:11.676750 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:11.676722    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2njd6" event={"ID":"02c98483-aa0a-483b-9e76-d578115bae14","Type":"ContainerStarted","Data":"2c17cd5a7bd9fe7e7b158865e02113c42e6abd522fca66add447b0f2f1bcc93e"}
Nov 02 21:57:11.679121 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:11.679099    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw" event={"ID":"8778cf51-2f98-409f-855c-60002cb0504c","Type":"ContainerStarted","Data":"94cd11b0f6d58ea652bb93b2797fa0830a54d431a528adca831f5069a05ee4d2"}
Nov 02 21:57:11.712313 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:11.712265    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw" podStartSLOduration=3.190919685 podStartE2EDuration="11.712249944s" totalImagesPullingTime="8.521330259s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:57:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:57:11.711683733 +0000 UTC m=+11.702034175" watchObservedRunningTime="2026-11-02 21:57:11.712249944 +0000 UTC m=+11.702600386"
Nov 02 21:57:12.684148 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:12.684060    2576 generic.go:356] "Generic (PLEG): container finished" podID="84d08f21-69d0-417b-a9cf-37f80bb4e332" containerID="3aed05f12a7fbf160c7caf655aa1a99c4b14030d8751a0d8fea782a8f2375b98" exitCode=0
Nov 02 21:57:12.684737 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:12.684161    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rnjhr" event={"ID":"84d08f21-69d0-417b-a9cf-37f80bb4e332","Type":"ContainerDied","Data":"3aed05f12a7fbf160c7caf655aa1a99c4b14030d8751a0d8fea782a8f2375b98"}
Nov 02 21:57:12.685720 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:12.685695    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qg8mq" event={"ID":"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc","Type":"ContainerStarted","Data":"3e4c3144df36d9ddf9fd29e44241c779625bcfb2d87c68889c7788d445c213ec"}
Nov 02 21:57:12.712186 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:12.712146    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2njd6" podStartSLOduration=4.566162245 podStartE2EDuration="12.712136135s" totalImagesPullingTime="8.14597389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:57:11.724721983 +0000 UTC m=+11.715072423" watchObservedRunningTime="2026-11-02 21:57:12.712136135 +0000 UTC m=+12.702486553"
Nov 02 21:57:12.728892 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:12.728854    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qg8mq" podStartSLOduration=2.743622726 podStartE2EDuration="12.728842934s" totalImagesPullingTime="9.985220208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:57:12.728404688 +0000 UTC m=+12.718755128" watchObservedRunningTime="2026-11-02 21:57:12.728842934 +0000 UTC m=+12.719193375"
Nov 02 21:57:13.499023 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:13.498993    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:13.499199 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:13.499026    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:13.499199 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:13.499114    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:13.499199 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:13.499122    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhm2w" podUID="0272e533-4834-4d8e-a907-5c341eb20edb"
Nov 02 21:57:13.499199 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:13.499186    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bvh" podUID="0ad960f5-ae8d-43ed-950f-b6f93be7e101"
Nov 02 21:57:13.499424 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:13.499273    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4zr8" podUID="4debe5f2-cdbd-4b57-9af4-f984df529ff2"
Nov 02 21:57:14.692670 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:14.692424    2576 generic.go:356] "Generic (PLEG): container finished" podID="84d08f21-69d0-417b-a9cf-37f80bb4e332" containerID="69c7edc49c97b14c165801b9ed40cdb4e0512d82bb7db5049b5e70a1aefb377c" exitCode=0
Nov 02 21:57:14.692670 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:14.692512    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rnjhr" event={"ID":"84d08f21-69d0-417b-a9cf-37f80bb4e332","Type":"ContainerDied","Data":"69c7edc49c97b14c165801b9ed40cdb4e0512d82bb7db5049b5e70a1aefb377c"}
Nov 02 21:57:15.499203 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:15.499169    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:15.499397 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:15.499311    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:15.499397 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:15.499324    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhm2w" podUID="0272e533-4834-4d8e-a907-5c341eb20edb"
Nov 02 21:57:15.499515 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:15.499411    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4zr8" podUID="4debe5f2-cdbd-4b57-9af4-f984df529ff2"
Nov 02 21:57:15.499515 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:15.499460    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:15.499602 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:15.499526    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bvh" podUID="0ad960f5-ae8d-43ed-950f-b6f93be7e101"
Nov 02 21:57:15.698595 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:15.698559    2576 generic.go:356] "Generic (PLEG): container finished" podID="84d08f21-69d0-417b-a9cf-37f80bb4e332" containerID="b254b54a1fa5a05ad740f20deb0c0ccd211e7d80625e9fbea257d246b17ede12" exitCode=0
Nov 02 21:57:15.699090 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:15.698626    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rnjhr" event={"ID":"84d08f21-69d0-417b-a9cf-37f80bb4e332","Type":"ContainerDied","Data":"b254b54a1fa5a05ad740f20deb0c0ccd211e7d80625e9fbea257d246b17ede12"}
Nov 02 21:57:16.711129 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:16.711092    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rnjhr" event={"ID":"84d08f21-69d0-417b-a9cf-37f80bb4e332","Type":"ContainerStarted","Data":"fc0d03bbe21b777ca07dad4c93a2ed4c8815f5da949bbdbdaf16637354b60915"}
Nov 02 21:57:16.734296 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:16.734242    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rnjhr" podStartSLOduration=7.109188758 podStartE2EDuration="16.734210332s" totalImagesPullingTime="9.625021574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:57:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:57:16.733711003 +0000 UTC m=+16.724061443" watchObservedRunningTime="2026-11-02 21:57:16.734210332 +0000 UTC m=+16.724560775"
Nov 02 21:57:17.163169 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:17.163091    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs\") pod \"network-metrics-daemon-qhm2w\" (UID: \"0272e533-4834-4d8e-a907-5c341eb20edb\") " pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:17.163169 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:17.163127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:17.163400 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:17.163258    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 21:57:17.163400 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:17.163319    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret podName:0ad960f5-ae8d-43ed-950f-b6f93be7e101 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:33.163302307 +0000 UTC m=+33.153652726 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret") pod "global-pull-secret-syncer-g8bvh" (UID: "0ad960f5-ae8d-43ed-950f-b6f93be7e101") : object "kube-system"/"original-pull-secret" not registered
Nov 02 21:57:17.163400 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:17.163258    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 21:57:17.163400 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:17.163395    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs podName:0272e533-4834-4d8e-a907-5c341eb20edb nodeName:}" failed. No retries permitted until 2026-11-02 21:57:33.163383034 +0000 UTC m=+33.153733469 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs") pod "network-metrics-daemon-qhm2w" (UID: "0272e533-4834-4d8e-a907-5c341eb20edb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 21:57:17.364309 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:17.364270    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7lz\" (UniqueName: \"kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz\") pod \"network-check-target-s4zr8\" (UID: \"4debe5f2-cdbd-4b57-9af4-f984df529ff2\") " pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:17.364493 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:17.364447    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 21:57:17.364493 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:17.364469    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 21:57:17.364493 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:17.364479    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jl7lz for pod openshift-network-diagnostics/network-check-target-s4zr8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 21:57:17.364650 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:17.364548    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz podName:4debe5f2-cdbd-4b57-9af4-f984df529ff2 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:33.364528905 +0000 UTC m=+33.354879355 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jl7lz" (UniqueName: "kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz") pod "network-check-target-s4zr8" (UID: "4debe5f2-cdbd-4b57-9af4-f984df529ff2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 21:57:17.498482 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:17.498409    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:17.498482 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:17.498443    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:17.498482 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:17.498453    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:17.498706 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:17.498525    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bvh" podUID="0ad960f5-ae8d-43ed-950f-b6f93be7e101"
Nov 02 21:57:17.498706 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:17.498596    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4zr8" podUID="4debe5f2-cdbd-4b57-9af4-f984df529ff2"
Nov 02 21:57:17.498706 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:17.498654    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhm2w" podUID="0272e533-4834-4d8e-a907-5c341eb20edb"
Nov 02 21:57:19.499012 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:19.498977    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:19.499012 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:19.499002    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:19.499473 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:19.499028    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:19.499473 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:19.499115    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bvh" podUID="0ad960f5-ae8d-43ed-950f-b6f93be7e101"
Nov 02 21:57:19.499473 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:19.499247    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhm2w" podUID="0272e533-4834-4d8e-a907-5c341eb20edb"
Nov 02 21:57:19.499473 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:19.499327    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4zr8" podUID="4debe5f2-cdbd-4b57-9af4-f984df529ff2"
Nov 02 21:57:20.721203 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:20.721175    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt" event={"ID":"1c203060-df7f-4287-b699-9fb6666b6c17","Type":"ContainerStarted","Data":"14d685372cc5ae3df8f18c58cee9b3b3230c508761581259a58d4357e310a10e"}
Nov 02 21:57:20.721501 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:20.721283    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt" event={"ID":"1c203060-df7f-4287-b699-9fb6666b6c17","Type":"ContainerStarted","Data":"c30a131850b23dffcdf74a3545a0a7c04e3ef6622d5ee1b0a8757b0bae668c55"}
Nov 02 21:57:20.721501 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:20.721314    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt" event={"ID":"1c203060-df7f-4287-b699-9fb6666b6c17","Type":"ContainerStarted","Data":"b8314afd619b4d440bfa36e13d5392e80cd561ded18b85edc558074af9f29f5b"}
Nov 02 21:57:20.721501 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:20.721342    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt" event={"ID":"1c203060-df7f-4287-b699-9fb6666b6c17","Type":"ContainerStarted","Data":"42958ae3994f8a49844930309a8d880dede82a097de41f3d49e7f042cd217c01"}
Nov 02 21:57:21.498193 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:21.498163    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:21.498420 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:21.498197    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:21.498420 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:21.498269    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4zr8" podUID="4debe5f2-cdbd-4b57-9af4-f984df529ff2"
Nov 02 21:57:21.498420 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:21.498314    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bvh" podUID="0ad960f5-ae8d-43ed-950f-b6f93be7e101"
Nov 02 21:57:21.498420 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:21.498371    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:21.498586 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:21.498465    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhm2w" podUID="0272e533-4834-4d8e-a907-5c341eb20edb"
Nov 02 21:57:21.725853 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:21.725815    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt" event={"ID":"1c203060-df7f-4287-b699-9fb6666b6c17","Type":"ContainerStarted","Data":"6b11ad6baa3aa7865ab48f8b689ed863f63e30a5cf8bf0aec1581a99298fcd62"}
Nov 02 21:57:21.726283 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:21.725888    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt" event={"ID":"1c203060-df7f-4287-b699-9fb6666b6c17","Type":"ContainerStarted","Data":"29ab895c02401ec188726ec84056209e75e9948c0b2a449971a476eabd4321e0"}
Nov 02 21:57:23.498159 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:23.498131    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:23.498670 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:23.498131    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:23.498670 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:23.498266    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhm2w" podUID="0272e533-4834-4d8e-a907-5c341eb20edb"
Nov 02 21:57:23.498670 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:23.498131    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:23.498670 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:23.498309    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4zr8" podUID="4debe5f2-cdbd-4b57-9af4-f984df529ff2"
Nov 02 21:57:23.498670 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:23.498383    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bvh" podUID="0ad960f5-ae8d-43ed-950f-b6f93be7e101"
Nov 02 21:57:23.732099 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:23.732067    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt" event={"ID":"1c203060-df7f-4287-b699-9fb6666b6c17","Type":"ContainerStarted","Data":"ee8c22301c8386f64b4699142bc39a146fc082084e1402605b958e322af05ca7"}
Nov 02 21:57:25.498633 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:25.498598    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:25.498633 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:25.498627    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:25.499344 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:25.498697    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhm2w" podUID="0272e533-4834-4d8e-a907-5c341eb20edb"
Nov 02 21:57:25.499344 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:25.498745    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:25.499344 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:25.498828    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bvh" podUID="0ad960f5-ae8d-43ed-950f-b6f93be7e101"
Nov 02 21:57:25.499344 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:25.498872    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4zr8" podUID="4debe5f2-cdbd-4b57-9af4-f984df529ff2"
Nov 02 21:57:25.739822 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:25.739787    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt" event={"ID":"1c203060-df7f-4287-b699-9fb6666b6c17","Type":"ContainerStarted","Data":"859360532d27491ac6927d290ce24d9eaf54173f183bf36bbf97b8520a71e725"}
Nov 02 21:57:25.740062 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:25.740043    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:25.740141 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:25.740128    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:25.740204 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:25.740182    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:25.755006 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:25.754949    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:25.755108 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:25.755054    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:25.765075 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:25.765037    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt" podStartSLOduration=7.1420913089999996 podStartE2EDuration="25.76502616s" totalImagesPullingTime="18.622934851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:57:25.763179127 +0000 UTC m=+25.753529573" watchObservedRunningTime="2026-11-02 21:57:25.76502616 +0000 UTC m=+25.755376600"
Nov 02 21:57:26.556259 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:26.556073    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g8bvh"]
Nov 02 21:57:26.556708 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:26.556350    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:26.556708 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:26.556460    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bvh" podUID="0ad960f5-ae8d-43ed-950f-b6f93be7e101"
Nov 02 21:57:26.558985 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:26.558957    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qhm2w"]
Nov 02 21:57:26.559109 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:26.559068    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:26.559203 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:26.559181    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhm2w" podUID="0272e533-4834-4d8e-a907-5c341eb20edb"
Nov 02 21:57:26.560406 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:26.560376    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s4zr8"]
Nov 02 21:57:26.560540 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:26.560498    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:26.560623 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:26.560601    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4zr8" podUID="4debe5f2-cdbd-4b57-9af4-f984df529ff2"
Nov 02 21:57:28.499232 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:28.499198    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:28.499620 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:28.499201    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:28.499620 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:28.499332    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:28.499620 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:28.499336    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4zr8" podUID="4debe5f2-cdbd-4b57-9af4-f984df529ff2"
Nov 02 21:57:28.499620 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:28.499406    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bvh" podUID="0ad960f5-ae8d-43ed-950f-b6f93be7e101"
Nov 02 21:57:28.499620 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:28.499472    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhm2w" podUID="0272e533-4834-4d8e-a907-5c341eb20edb"
Nov 02 21:57:30.500000 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:30.499969    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:30.500493 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:30.500074    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:30.500493 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:30.500086    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhm2w" podUID="0272e533-4834-4d8e-a907-5c341eb20edb"
Nov 02 21:57:30.500493 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:30.500180    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4zr8" podUID="4debe5f2-cdbd-4b57-9af4-f984df529ff2"
Nov 02 21:57:30.500493 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:30.500196    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:30.500493 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:30.500286    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bvh" podUID="0ad960f5-ae8d-43ed-950f-b6f93be7e101"
Nov 02 21:57:32.498453 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:32.498415    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:32.498453 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:32.498438    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:32.498982 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:32.498547    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhm2w" podUID="0272e533-4834-4d8e-a907-5c341eb20edb"
Nov 02 21:57:32.498982 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:32.498593    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:32.498982 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:32.498699    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bvh" podUID="0ad960f5-ae8d-43ed-950f-b6f93be7e101"
Nov 02 21:57:32.498982 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:32.498766    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4zr8" podUID="4debe5f2-cdbd-4b57-9af4-f984df529ff2"
Nov 02 21:57:33.185659 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.185626    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs\") pod \"network-metrics-daemon-qhm2w\" (UID: \"0272e533-4834-4d8e-a907-5c341eb20edb\") " pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:33.185659 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.185660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:33.185898 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:33.185793    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 21:57:33.185898 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:33.185822    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 21:57:33.185898 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:33.185862    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs podName:0272e533-4834-4d8e-a907-5c341eb20edb nodeName:}" failed. No retries permitted until 2026-11-02 21:58:05.185840834 +0000 UTC m=+65.176191274 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs") pod "network-metrics-daemon-qhm2w" (UID: "0272e533-4834-4d8e-a907-5c341eb20edb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 21:57:33.185898 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:33.185883    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret podName:0ad960f5-ae8d-43ed-950f-b6f93be7e101 nodeName:}" failed. No retries permitted until 2026-11-02 21:58:05.185872045 +0000 UTC m=+65.176222470 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret") pod "global-pull-secret-syncer-g8bvh" (UID: "0ad960f5-ae8d-43ed-950f-b6f93be7e101") : object "kube-system"/"original-pull-secret" not registered
Nov 02 21:57:33.332775 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.332743    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeReady"
Nov 02 21:57:33.332915 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.332875    2576 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Nov 02 21:57:33.372348 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.372322    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rjf77"]
Nov 02 21:57:33.387314 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.387081    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7lz\" (UniqueName: \"kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz\") pod \"network-check-target-s4zr8\" (UID: \"4debe5f2-cdbd-4b57-9af4-f984df529ff2\") " pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:33.387314 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:33.387231    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 21:57:33.387314 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:33.387254    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 21:57:33.387314 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:33.387266    2576 projected.go:196] Error preparing data for projected volume kube-api-access-jl7lz for pod openshift-network-diagnostics/network-check-target-s4zr8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 21:57:33.387314 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:33.387318    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz podName:4debe5f2-cdbd-4b57-9af4-f984df529ff2 nodeName:}" failed. No retries permitted until 2026-11-02 21:58:05.387302276 +0000 UTC m=+65.377652697 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jl7lz" (UniqueName: "kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz") pod "network-check-target-s4zr8" (UID: "4debe5f2-cdbd-4b57-9af4-f984df529ff2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 21:57:33.396782 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.396762    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gkz57"]
Nov 02 21:57:33.396924 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.396881    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rjf77"
Nov 02 21:57:33.400818 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.400798    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 02 21:57:33.400944 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.400858    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bqhdf\""
Nov 02 21:57:33.401028 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.401013    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 02 21:57:33.413240 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.413199    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rjf77"]
Nov 02 21:57:33.413240 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.413212    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gkz57"
Nov 02 21:57:33.413354 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.413275    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gkz57"]
Nov 02 21:57:33.488108 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.488034    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39fb3387-3347-4028-837b-a93354d07835-config-volume\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:57:33.488108 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.488071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36caef13-1364-4809-af05-58a3a2042ccc-cert\") pod \"ingress-canary-gkz57\" (UID: \"36caef13-1364-4809-af05-58a3a2042ccc\") " pod="openshift-ingress-canary/ingress-canary-gkz57"
Nov 02 21:57:33.488108 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.488093    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:57:33.488400 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.488194    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39fb3387-3347-4028-837b-a93354d07835-tmp-dir\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:57:33.488400 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.488346    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdc99\" (UniqueName: \"kubernetes.io/projected/36caef13-1364-4809-af05-58a3a2042ccc-kube-api-access-kdc99\") pod \"ingress-canary-gkz57\" (UID: \"36caef13-1364-4809-af05-58a3a2042ccc\") " pod="openshift-ingress-canary/ingress-canary-gkz57"
Nov 02 21:57:33.488400 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.488389    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f42cc\" (UniqueName: \"kubernetes.io/projected/39fb3387-3347-4028-837b-a93354d07835-kube-api-access-f42cc\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:57:33.505360 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.505334    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 02 21:57:33.505732 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.505423    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 02 21:57:33.505732 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.505485    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-b8hrl\""
Nov 02 21:57:33.505732 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.505569    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 02 21:57:33.588971 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.588943    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36caef13-1364-4809-af05-58a3a2042ccc-cert\") pod \"ingress-canary-gkz57\" (UID: \"36caef13-1364-4809-af05-58a3a2042ccc\") " pod="openshift-ingress-canary/ingress-canary-gkz57"
Nov 02 21:57:33.589078 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.588979    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:57:33.589078 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.589005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39fb3387-3347-4028-837b-a93354d07835-tmp-dir\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:57:33.589078 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.589057    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdc99\" (UniqueName: \"kubernetes.io/projected/36caef13-1364-4809-af05-58a3a2042ccc-kube-api-access-kdc99\") pod \"ingress-canary-gkz57\" (UID: \"36caef13-1364-4809-af05-58a3a2042ccc\") " pod="openshift-ingress-canary/ingress-canary-gkz57"
Nov 02 21:57:33.589245 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.589089    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f42cc\" (UniqueName: \"kubernetes.io/projected/39fb3387-3347-4028-837b-a93354d07835-kube-api-access-f42cc\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:57:33.589245 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:33.589115    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 02 21:57:33.589245 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.589116    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39fb3387-3347-4028-837b-a93354d07835-config-volume\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:57:33.589245 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:33.589172    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls podName:39fb3387-3347-4028-837b-a93354d07835 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:34.089155484 +0000 UTC m=+34.079505922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls") pod "dns-default-rjf77" (UID: "39fb3387-3347-4028-837b-a93354d07835") : secret "dns-default-metrics-tls" not found
Nov 02 21:57:33.589476 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.589458    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39fb3387-3347-4028-837b-a93354d07835-tmp-dir\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:57:33.589754 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.589738    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39fb3387-3347-4028-837b-a93354d07835-config-volume\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:57:33.592604 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.592588    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36caef13-1364-4809-af05-58a3a2042ccc-cert\") pod \"ingress-canary-gkz57\" (UID: \"36caef13-1364-4809-af05-58a3a2042ccc\") " pod="openshift-ingress-canary/ingress-canary-gkz57"
Nov 02 21:57:33.597184 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.597163    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f42cc\" (UniqueName: \"kubernetes.io/projected/39fb3387-3347-4028-837b-a93354d07835-kube-api-access-f42cc\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:57:33.597404 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.597387    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdc99\" (UniqueName: \"kubernetes.io/projected/36caef13-1364-4809-af05-58a3a2042ccc-kube-api-access-kdc99\") pod \"ingress-canary-gkz57\" (UID: \"36caef13-1364-4809-af05-58a3a2042ccc\") " pod="openshift-ingress-canary/ingress-canary-gkz57"
Nov 02 21:57:33.745725 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:33.745646    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gkz57"
Nov 02 21:57:34.073602 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:34.073404    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gkz57"]
Nov 02 21:57:34.077399 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:57:34.077372    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36caef13_1364_4809_af05_58a3a2042ccc.slice/crio-0ae0d0867caa07842cd173ccd0aca0c2f9c35f5c97476b9396eea1de6ed6b6f1 WatchSource:0}: Error finding container 0ae0d0867caa07842cd173ccd0aca0c2f9c35f5c97476b9396eea1de6ed6b6f1: Status 404 returned error can't find the container with id 0ae0d0867caa07842cd173ccd0aca0c2f9c35f5c97476b9396eea1de6ed6b6f1
Nov 02 21:57:34.092669 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:34.092647    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:57:34.092802 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:34.092785    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 02 21:57:34.092857 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:34.092839    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls podName:39fb3387-3347-4028-837b-a93354d07835 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:35.092825103 +0000 UTC m=+35.083175523 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls") pod "dns-default-rjf77" (UID: "39fb3387-3347-4028-837b-a93354d07835") : secret "dns-default-metrics-tls" not found
Nov 02 21:57:34.502199 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:34.502120    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:57:34.502363 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:34.502237    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:57:34.502363 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:34.502263    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:57:34.506481 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:34.506460    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 02 21:57:34.506797 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:34.506528    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 02 21:57:34.507611 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:34.507590    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-9dzjg\""
Nov 02 21:57:34.507611 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:34.507606    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 02 21:57:34.507921 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:34.507902    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 02 21:57:34.508019 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:34.507934    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vjf48\""
Nov 02 21:57:34.508019 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:34.507996    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-6t4jd\""
Nov 02 21:57:34.762709 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:34.762636    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gkz57" event={"ID":"36caef13-1364-4809-af05-58a3a2042ccc","Type":"ContainerStarted","Data":"0ae0d0867caa07842cd173ccd0aca0c2f9c35f5c97476b9396eea1de6ed6b6f1"}
Nov 02 21:57:35.100688 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:35.100601    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:57:35.100851 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:35.100772    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 02 21:57:35.100851 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:35.100846    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls podName:39fb3387-3347-4028-837b-a93354d07835 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:37.100825715 +0000 UTC m=+37.091176154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls") pod "dns-default-rjf77" (UID: "39fb3387-3347-4028-837b-a93354d07835") : secret "dns-default-metrics-tls" not found
Nov 02 21:57:35.820725 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:35.820683    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:35.974409 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:35.974375    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:36.522507 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:36.522477    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:36.595511 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:36.595433    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:37.115556 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.115525    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:57:37.115961 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:37.115648    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 02 21:57:37.115961 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:37.115698    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls podName:39fb3387-3347-4028-837b-a93354d07835 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:41.115686583 +0000 UTC m=+41.106037003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls") pod "dns-default-rjf77" (UID: "39fb3387-3347-4028-837b-a93354d07835") : secret "dns-default-metrics-tls" not found
Nov 02 21:57:37.481941 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.481912    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ff49f"]
Nov 02 21:57:37.501892 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.501863    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-k9qbf-96c98"]
Nov 02 21:57:37.502046 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.501958    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:37.509113 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.509089    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 02 21:57:37.509253 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.509164    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 02 21:57:37.510309 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.510292    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 02 21:57:37.510381 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.510342    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 02 21:57:37.510441 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.510421    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9v8fd\""
Nov 02 21:57:37.511942 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.511912    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:37.517880 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.517860    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ff49f"]
Nov 02 21:57:37.517965 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.517907    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-k9qbf-96c98"]
Nov 02 21:57:37.517965 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.517956    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:57:37.611850 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.611770    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Nov 02 21:57:37.611984 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.611854    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rv85s\""
Nov 02 21:57:37.615917 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.615889    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:37.617943 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.617929    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Nov 02 21:57:37.619075 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.619055    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24a682dd-9873-4861-a837-3df17b108c00-service-ca-bundle\") pod \"periodic-gathering-k9qbf-96c98\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") " pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:57:37.619122 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.619109    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2ba252e-e593-41ec-badb-6c7c98c725a2-data-volume\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:37.619205 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.619192    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:37.619251 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.619231    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm6lb\" (UniqueName: \"kubernetes.io/projected/24a682dd-9873-4861-a837-3df17b108c00-kube-api-access-qm6lb\") pod \"periodic-gathering-k9qbf-96c98\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") " pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:57:37.619283 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.619253    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2ba252e-e593-41ec-badb-6c7c98c725a2-crio-socket\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:37.619349 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.619330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx2zc\" (UniqueName: \"kubernetes.io/projected/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-api-access-hx2zc\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:37.619381 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.619362    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/24a682dd-9873-4861-a837-3df17b108c00-archives-path\") pod \"periodic-gathering-k9qbf-96c98\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") " pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:57:37.619433 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.619419    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2ba252e-e593-41ec-badb-6c7c98c725a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:37.619465 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.619441    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24a682dd-9873-4861-a837-3df17b108c00-trusted-ca-bundle\") pod \"periodic-gathering-k9qbf-96c98\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") " pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:57:37.720501 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.720474    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24a682dd-9873-4861-a837-3df17b108c00-service-ca-bundle\") pod \"periodic-gathering-k9qbf-96c98\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") " pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:57:37.720593 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.720526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2ba252e-e593-41ec-badb-6c7c98c725a2-data-volume\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:37.720649 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.720636    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:37.720684 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.720660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm6lb\" (UniqueName: \"kubernetes.io/projected/24a682dd-9873-4861-a837-3df17b108c00-kube-api-access-qm6lb\") pod \"periodic-gathering-k9qbf-96c98\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") " pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:57:37.720722 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.720680    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2ba252e-e593-41ec-badb-6c7c98c725a2-crio-socket\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:37.720759 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.720735    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx2zc\" (UniqueName: \"kubernetes.io/projected/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-api-access-hx2zc\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:37.720797 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.720763    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/24a682dd-9873-4861-a837-3df17b108c00-archives-path\") pod \"periodic-gathering-k9qbf-96c98\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") " pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:57:37.720847 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.720792    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2ba252e-e593-41ec-badb-6c7c98c725a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:37.720847 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.720817    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2ba252e-e593-41ec-badb-6c7c98c725a2-data-volume\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:37.720847 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.720819    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24a682dd-9873-4861-a837-3df17b108c00-trusted-ca-bundle\") pod \"periodic-gathering-k9qbf-96c98\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") " pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:57:37.720979 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.720892    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2ba252e-e593-41ec-badb-6c7c98c725a2-crio-socket\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:37.720979 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:37.720954    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 02 21:57:37.721075 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:37.721031    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-rbac-proxy-cm podName:e2ba252e-e593-41ec-badb-6c7c98c725a2 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:38.221012338 +0000 UTC m=+38.211362777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ff49f" (UID: "e2ba252e-e593-41ec-badb-6c7c98c725a2") : configmap "kube-rbac-proxy" not found
Nov 02 21:57:37.721075 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:37.721037    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 02 21:57:37.721170 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:37.721110    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2ba252e-e593-41ec-badb-6c7c98c725a2-insights-runtime-extractor-tls podName:e2ba252e-e593-41ec-badb-6c7c98c725a2 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:38.221091853 +0000 UTC m=+38.211442287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2ba252e-e593-41ec-badb-6c7c98c725a2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ff49f" (UID: "e2ba252e-e593-41ec-badb-6c7c98c725a2") : secret "insights-runtime-extractor-tls" not found
Nov 02 21:57:37.721170 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.721149    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/24a682dd-9873-4861-a837-3df17b108c00-archives-path\") pod \"periodic-gathering-k9qbf-96c98\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") " pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:57:37.721254 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.721198    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24a682dd-9873-4861-a837-3df17b108c00-service-ca-bundle\") pod \"periodic-gathering-k9qbf-96c98\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") " pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:57:37.721683 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.721660    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24a682dd-9873-4861-a837-3df17b108c00-trusted-ca-bundle\") pod \"periodic-gathering-k9qbf-96c98\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") " pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:57:37.729882 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.729863    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx2zc\" (UniqueName: \"kubernetes.io/projected/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-api-access-hx2zc\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:37.730012 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.729990    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm6lb\" (UniqueName: \"kubernetes.io/projected/24a682dd-9873-4861-a837-3df17b108c00-kube-api-access-qm6lb\") pod \"periodic-gathering-k9qbf-96c98\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") " pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:57:37.771106 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.771083    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gkz57" event={"ID":"36caef13-1364-4809-af05-58a3a2042ccc","Type":"ContainerStarted","Data":"67885c8e0ad6e2ade0f2d9d5886e7542455ef634633139362420eff6b3ea411d"}
Nov 02 21:57:37.785524 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.785486    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gkz57" podStartSLOduration=1.534842064 podStartE2EDuration="4.785474026s" totalImagesPullingTime="3.250631962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:57:37.784949418 +0000 UTC m=+37.775299846" watchObservedRunningTime="2026-11-02 21:57:37.785474026 +0000 UTC m=+37.775824466"
Nov 02 21:57:37.870995 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:37.870926    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:57:38.167946 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:38.167696    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-k9qbf-96c98"]
Nov 02 21:57:38.171019 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:57:38.170993    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a682dd_9873_4861_a837_3df17b108c00.slice/crio-5548146444ddb24a0fff976de1a1d31118a465d60e0be93b3605fa6f7ebc14a3 WatchSource:0}: Error finding container 5548146444ddb24a0fff976de1a1d31118a465d60e0be93b3605fa6f7ebc14a3: Status 404 returned error can't find the container with id 5548146444ddb24a0fff976de1a1d31118a465d60e0be93b3605fa6f7ebc14a3
Nov 02 21:57:38.225117 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:38.225094    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:38.225234 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:38.225147    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2ba252e-e593-41ec-badb-6c7c98c725a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:38.225234 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:38.225166    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 02 21:57:38.225234 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:38.225230    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-rbac-proxy-cm podName:e2ba252e-e593-41ec-badb-6c7c98c725a2 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:39.225202683 +0000 UTC m=+39.215553103 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ff49f" (UID: "e2ba252e-e593-41ec-badb-6c7c98c725a2") : configmap "kube-rbac-proxy" not found
Nov 02 21:57:38.225359 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:38.225298    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 02 21:57:38.225394 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:38.225360    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2ba252e-e593-41ec-badb-6c7c98c725a2-insights-runtime-extractor-tls podName:e2ba252e-e593-41ec-badb-6c7c98c725a2 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:39.22534339 +0000 UTC m=+39.215693814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2ba252e-e593-41ec-badb-6c7c98c725a2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ff49f" (UID: "e2ba252e-e593-41ec-badb-6c7c98c725a2") : secret "insights-runtime-extractor-tls" not found
Nov 02 21:57:38.331370 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:38.331344    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-j7ldn"]
Nov 02 21:57:38.346095 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:38.346069    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:38.347931 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:38.347905    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-j7ldn"]
Nov 02 21:57:38.348051 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:38.348034    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-j7ldn"
Nov 02 21:57:38.356078 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:38.356058    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Nov 02 21:57:38.356207 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:38.356058    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Nov 02 21:57:38.356207 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:38.356186    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-g9f57\""
Nov 02 21:57:38.452512 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:38.452447    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:38.527873 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:38.527850    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nctrd\" (UniqueName: \"kubernetes.io/projected/ee77ac04-78e3-47e8-bfc4-9e2ab5f2bb0f-kube-api-access-nctrd\") pod \"migrator-66df5d496b-j7ldn\" (UID: \"ee77ac04-78e3-47e8-bfc4-9e2ab5f2bb0f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-j7ldn"
Nov 02 21:57:38.556428 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:38.556405    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:38.629133 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:38.629103    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nctrd\" (UniqueName: \"kubernetes.io/projected/ee77ac04-78e3-47e8-bfc4-9e2ab5f2bb0f-kube-api-access-nctrd\") pod \"migrator-66df5d496b-j7ldn\" (UID: \"ee77ac04-78e3-47e8-bfc4-9e2ab5f2bb0f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-j7ldn"
Nov 02 21:57:38.637141 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:38.637118    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nctrd\" (UniqueName: \"kubernetes.io/projected/ee77ac04-78e3-47e8-bfc4-9e2ab5f2bb0f-kube-api-access-nctrd\") pod \"migrator-66df5d496b-j7ldn\" (UID: \"ee77ac04-78e3-47e8-bfc4-9e2ab5f2bb0f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-j7ldn"
Nov 02 21:57:38.669145 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:38.669118    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-j7ldn"
Nov 02 21:57:38.775522 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:38.775490    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-k9qbf-96c98" event={"ID":"24a682dd-9873-4861-a837-3df17b108c00","Type":"ContainerStarted","Data":"5548146444ddb24a0fff976de1a1d31118a465d60e0be93b3605fa6f7ebc14a3"}
Nov 02 21:57:38.951709 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:38.951685    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-j7ldn"]
Nov 02 21:57:38.954428 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:57:38.954395    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee77ac04_78e3_47e8_bfc4_9e2ab5f2bb0f.slice/crio-d4ad79638c9cb202e76fb7c9e146c8a9be239f52cdf301e0b3d4d6490a3d1673 WatchSource:0}: Error finding container d4ad79638c9cb202e76fb7c9e146c8a9be239f52cdf301e0b3d4d6490a3d1673: Status 404 returned error can't find the container with id d4ad79638c9cb202e76fb7c9e146c8a9be239f52cdf301e0b3d4d6490a3d1673
Nov 02 21:57:39.201342 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.201270    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:39.235402 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.235373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:39.235559 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.235412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2ba252e-e593-41ec-badb-6c7c98c725a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:39.235559 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:39.235523    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 02 21:57:39.235559 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:39.235544    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 02 21:57:39.235717 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:39.235600    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-rbac-proxy-cm podName:e2ba252e-e593-41ec-badb-6c7c98c725a2 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:41.235578752 +0000 UTC m=+41.225929175 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ff49f" (UID: "e2ba252e-e593-41ec-badb-6c7c98c725a2") : configmap "kube-rbac-proxy" not found
Nov 02 21:57:39.235717 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:39.235620    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2ba252e-e593-41ec-badb-6c7c98c725a2-insights-runtime-extractor-tls podName:e2ba252e-e593-41ec-badb-6c7c98c725a2 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:41.235610409 +0000 UTC m=+41.225960832 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2ba252e-e593-41ec-badb-6c7c98c725a2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ff49f" (UID: "e2ba252e-e593-41ec-badb-6c7c98c725a2") : secret "insights-runtime-extractor-tls" not found
Nov 02 21:57:39.298200 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.298176    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:39.397894 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.397868    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:39.400713 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.400681    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-x2z8k"]
Nov 02 21:57:39.434759 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.434734    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-x2z8k"]
Nov 02 21:57:39.434892 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.434821    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-x2z8k"
Nov 02 21:57:39.438698 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.438677    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Nov 02 21:57:39.439835 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.439798    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Nov 02 21:57:39.439940 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.439857    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Nov 02 21:57:39.439940 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.439880    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-p696k\""
Nov 02 21:57:39.439940 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.439930    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Nov 02 21:57:39.538276 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.538185    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d776db87-e7da-4eee-8116-19220c6e61c6-signing-cabundle\") pod \"service-ca-5fffc97bdf-x2z8k\" (UID: \"d776db87-e7da-4eee-8116-19220c6e61c6\") " pod="openshift-service-ca/service-ca-5fffc97bdf-x2z8k"
Nov 02 21:57:39.538276 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.538270    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d776db87-e7da-4eee-8116-19220c6e61c6-signing-key\") pod \"service-ca-5fffc97bdf-x2z8k\" (UID: \"d776db87-e7da-4eee-8116-19220c6e61c6\") " pod="openshift-service-ca/service-ca-5fffc97bdf-x2z8k"
Nov 02 21:57:39.538456 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.538337    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pcpq\" (UniqueName: \"kubernetes.io/projected/d776db87-e7da-4eee-8116-19220c6e61c6-kube-api-access-8pcpq\") pod \"service-ca-5fffc97bdf-x2z8k\" (UID: \"d776db87-e7da-4eee-8116-19220c6e61c6\") " pod="openshift-service-ca/service-ca-5fffc97bdf-x2z8k"
Nov 02 21:57:39.638956 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.638923    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pcpq\" (UniqueName: \"kubernetes.io/projected/d776db87-e7da-4eee-8116-19220c6e61c6-kube-api-access-8pcpq\") pod \"service-ca-5fffc97bdf-x2z8k\" (UID: \"d776db87-e7da-4eee-8116-19220c6e61c6\") " pod="openshift-service-ca/service-ca-5fffc97bdf-x2z8k"
Nov 02 21:57:39.639144 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.639005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d776db87-e7da-4eee-8116-19220c6e61c6-signing-cabundle\") pod \"service-ca-5fffc97bdf-x2z8k\" (UID: \"d776db87-e7da-4eee-8116-19220c6e61c6\") " pod="openshift-service-ca/service-ca-5fffc97bdf-x2z8k"
Nov 02 21:57:39.639144 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.639058    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d776db87-e7da-4eee-8116-19220c6e61c6-signing-key\") pod \"service-ca-5fffc97bdf-x2z8k\" (UID: \"d776db87-e7da-4eee-8116-19220c6e61c6\") " pod="openshift-service-ca/service-ca-5fffc97bdf-x2z8k"
Nov 02 21:57:39.639935 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.639911    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d776db87-e7da-4eee-8116-19220c6e61c6-signing-cabundle\") pod \"service-ca-5fffc97bdf-x2z8k\" (UID: \"d776db87-e7da-4eee-8116-19220c6e61c6\") " pod="openshift-service-ca/service-ca-5fffc97bdf-x2z8k"
Nov 02 21:57:39.642089 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.642068    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d776db87-e7da-4eee-8116-19220c6e61c6-signing-key\") pod \"service-ca-5fffc97bdf-x2z8k\" (UID: \"d776db87-e7da-4eee-8116-19220c6e61c6\") " pod="openshift-service-ca/service-ca-5fffc97bdf-x2z8k"
Nov 02 21:57:39.649913 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.649888    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pcpq\" (UniqueName: \"kubernetes.io/projected/d776db87-e7da-4eee-8116-19220c6e61c6-kube-api-access-8pcpq\") pod \"service-ca-5fffc97bdf-x2z8k\" (UID: \"d776db87-e7da-4eee-8116-19220c6e61c6\") " pod="openshift-service-ca/service-ca-5fffc97bdf-x2z8k"
Nov 02 21:57:39.695789 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.695723    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:39.758922 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.758898    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-x2z8k"
Nov 02 21:57:39.779767 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:39.779736    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-j7ldn" event={"ID":"ee77ac04-78e3-47e8-bfc4-9e2ab5f2bb0f","Type":"ContainerStarted","Data":"d4ad79638c9cb202e76fb7c9e146c8a9be239f52cdf301e0b3d4d6490a3d1673"}
Nov 02 21:57:40.046670 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:40.046637    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-x2z8k"]
Nov 02 21:57:40.049434 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:57:40.049404    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd776db87_e7da_4eee_8116_19220c6e61c6.slice/crio-38c42907d619c842321ffc439dad5f5bd86b3af191a43a7c2a30c85e006da46a WatchSource:0}: Error finding container 38c42907d619c842321ffc439dad5f5bd86b3af191a43a7c2a30c85e006da46a: Status 404 returned error can't find the container with id 38c42907d619c842321ffc439dad5f5bd86b3af191a43a7c2a30c85e006da46a
Nov 02 21:57:40.159313 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:40.159239    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:40.783681 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:40.783632    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-x2z8k" event={"ID":"d776db87-e7da-4eee-8116-19220c6e61c6","Type":"ContainerStarted","Data":"38c42907d619c842321ffc439dad5f5bd86b3af191a43a7c2a30c85e006da46a"}
Nov 02 21:57:41.152442 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:41.152184    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:57:41.152594 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:41.152349    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 02 21:57:41.152594 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:41.152547    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls podName:39fb3387-3347-4028-837b-a93354d07835 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:49.152526513 +0000 UTC m=+49.142876941 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls") pod "dns-default-rjf77" (UID: "39fb3387-3347-4028-837b-a93354d07835") : secret "dns-default-metrics-tls" not found
Nov 02 21:57:41.253337 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:41.253299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2ba252e-e593-41ec-badb-6c7c98c725a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:41.253539 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:41.253415    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:41.253539 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:41.253468    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 02 21:57:41.253539 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:41.253488    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 02 21:57:41.253692 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:41.253546    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-rbac-proxy-cm podName:e2ba252e-e593-41ec-badb-6c7c98c725a2 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:45.253527195 +0000 UTC m=+45.243877629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ff49f" (UID: "e2ba252e-e593-41ec-badb-6c7c98c725a2") : configmap "kube-rbac-proxy" not found
Nov 02 21:57:41.253692 ip-10-0-142-132 kubenswrapper[2576]: E1102 21:57:41.253563    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2ba252e-e593-41ec-badb-6c7c98c725a2-insights-runtime-extractor-tls podName:e2ba252e-e593-41ec-badb-6c7c98c725a2 nodeName:}" failed. No retries permitted until 2026-11-02 21:57:45.253554814 +0000 UTC m=+45.243905246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2ba252e-e593-41ec-badb-6c7c98c725a2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ff49f" (UID: "e2ba252e-e593-41ec-badb-6c7c98c725a2") : secret "insights-runtime-extractor-tls" not found
Nov 02 21:57:41.642243 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:41.642158    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:41.787557 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:41.787525    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-j7ldn" event={"ID":"ee77ac04-78e3-47e8-bfc4-9e2ab5f2bb0f","Type":"ContainerStarted","Data":"2d0764d69236e77a089820513172d2b6b369112d57e60e24fc8e12a9ef2eca6b"}
Nov 02 21:57:41.802106 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:41.802051    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-j7ldn" podStartSLOduration=2.024368804 podStartE2EDuration="3.80203656s" totalImagesPullingTime="1.777667756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:57:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:57:41.801535379 +0000 UTC m=+41.791885831" watchObservedRunningTime="2026-11-02 21:57:41.80203656 +0000 UTC m=+41.792387001"
Nov 02 21:57:41.979612 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:41.979580    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:42.084700 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:42.084643    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:42.790827 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:42.790795    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-k9qbf-96c98" event={"ID":"24a682dd-9873-4861-a837-3df17b108c00","Type":"ContainerStarted","Data":"bea4d587d47a65c50b26d141637840e833ec557eb16c7b97dded5675cb223b53"}
Nov 02 21:57:42.809859 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:42.809819    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-k9qbf-96c98" podStartSLOduration=2.109090172 podStartE2EDuration="5.80980547s" totalImagesPullingTime="3.700715298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:57:42.807905375 +0000 UTC m=+42.798255817" watchObservedRunningTime="2026-11-02 21:57:42.80980547 +0000 UTC m=+42.800155945"
Nov 02 21:57:43.125424 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:43.125338    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:43.420639 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:43.420546    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:43.510839 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:43.510805    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:43.608491 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:43.608459    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:43.711361 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:43.711276    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:43.795570 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:43.795102    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-x2z8k" event={"ID":"d776db87-e7da-4eee-8116-19220c6e61c6","Type":"ContainerStarted","Data":"021523ce3d99998fa1aaca14d9c6689ef4c123745f795e4cdc9cbbb2f3cb6985"}
Nov 02 21:57:43.812131 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:43.812071    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-x2z8k" podStartSLOduration=2.072018697 podStartE2EDuration="4.812056002s" totalImagesPullingTime="2.740037305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:57:43.811538319 +0000 UTC m=+43.801888790" watchObservedRunningTime="2026-11-02 21:57:43.812056002 +0000 UTC m=+43.802406442"
Nov 02 21:57:43.882556 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:43.882524    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:44.900174 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:44.900139    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:44.975942 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:44.975915    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:45.069368 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:45.069341    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:45.274901 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:45.274832    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:45.285008 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:45.284981    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:45.285116 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:45.285033    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2ba252e-e593-41ec-badb-6c7c98c725a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:45.285527 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:45.285510    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:45.288659 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:45.288483    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2ba252e-e593-41ec-badb-6c7c98c725a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:45.355789 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:45.355763    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:57:45.414767 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:45.414741    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:45.513308 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:45.513280    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:45.634395 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:45.634370    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ff49f"]
Nov 02 21:57:45.636937 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:57:45.636904    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2ba252e_e593_41ec_badb_6c7c98c725a2.slice/crio-202407eace618277a127e9921b28bed64d00988d8cba676edfe3ec153c682097 WatchSource:0}: Error finding container 202407eace618277a127e9921b28bed64d00988d8cba676edfe3ec153c682097: Status 404 returned error can't find the container with id 202407eace618277a127e9921b28bed64d00988d8cba676edfe3ec153c682097
Nov 02 21:57:45.675151 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:45.675122    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:45.801627 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:45.801593    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ff49f" event={"ID":"e2ba252e-e593-41ec-badb-6c7c98c725a2","Type":"ContainerStarted","Data":"b1c703c8998c5169b8597a4e6d28ebc36d2405f019da442705ade8a4b647e94c"}
Nov 02 21:57:45.801800 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:45.801661    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ff49f" event={"ID":"e2ba252e-e593-41ec-badb-6c7c98c725a2","Type":"ContainerStarted","Data":"202407eace618277a127e9921b28bed64d00988d8cba676edfe3ec153c682097"}
Nov 02 21:57:45.861656 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:45.861631    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kk66k_8a7ce469-5b88-4552-bb1f-66a901701d43/dns-node-resolver/0.log"
Nov 02 21:57:45.873633 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:45.873597    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:46.399034 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:46.399012    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:46.806013 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:46.805937    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ff49f" event={"ID":"e2ba252e-e593-41ec-badb-6c7c98c725a2","Type":"ContainerStarted","Data":"a21d6c1c352a6d51f697824ddebf34a519b834e681f4c78edbf91403a26ba87c"}
Nov 02 21:57:47.063355 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:47.063271    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q9zww_2da733e7-c5c3-4170-b3c1-1817068ee620/node-ca/0.log"
Nov 02 21:57:47.074061 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:47.074029    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:47.279075 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:47.279040    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:47.462257 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:47.462198    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gkz57_36caef13-1364-4809-af05-58a3a2042ccc/serve-healthcheck-canary/0.log"
Nov 02 21:57:47.469381 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:47.469355    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:47.673953 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:47.673911    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:47.862987 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:47.862968    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-j7ldn_ee77ac04-78e3-47e8-bfc4-9e2ab5f2bb0f/migrator/0.log"
Nov 02 21:57:47.866969 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:47.866940    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:48.161506 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:48.161478    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:48.812717 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:48.812686    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ff49f" event={"ID":"e2ba252e-e593-41ec-badb-6c7c98c725a2","Type":"ContainerStarted","Data":"c980ae1212841f7b128eaac4755fa4fe946d699caae906e4774e2fe7062edc9a"}
Nov 02 21:57:48.832200 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:48.832157    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ff49f" podStartSLOduration=9.789122215 podStartE2EDuration="11.832141377s" totalImagesPullingTime="2.043019162s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 21:57:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:57:48.831694771 +0000 UTC m=+48.822045229" watchObservedRunningTime="2026-11-02 21:57:48.832141377 +0000 UTC m=+48.822491822"
Nov 02 21:57:49.074228 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:49.074136    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:49.212932 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:49.212899    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:57:49.215314 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:49.215295    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:57:49.265459 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:49.265431    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:49.331889 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:49.331830    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rjf77"
Nov 02 21:57:49.473520 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:49.473491    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:49.597953 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:49.597880    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rjf77"]
Nov 02 21:57:49.600920 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:57:49.600889    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39fb3387_3347_4028_837b_a93354d07835.slice/crio-fab7fe7d6a5e3f8fc20791d6875880030ebaee6c0ad925d6ee3be31f35194e58 WatchSource:0}: Error finding container fab7fe7d6a5e3f8fc20791d6875880030ebaee6c0ad925d6ee3be31f35194e58: Status 404 returned error can't find the container with id fab7fe7d6a5e3f8fc20791d6875880030ebaee6c0ad925d6ee3be31f35194e58
Nov 02 21:57:49.674539 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:49.674509    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:49.817019 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:49.816984    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rjf77" event={"ID":"39fb3387-3347-4028-837b-a93354d07835","Type":"ContainerStarted","Data":"fab7fe7d6a5e3f8fc20791d6875880030ebaee6c0ad925d6ee3be31f35194e58"}
Nov 02 21:57:49.869927 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:49.869895    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:51.075176 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:51.075141    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:51.269127 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:51.269086    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:51.469904 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:51.469874    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:51.672530 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:51.672501    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:51.824989 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:51.824912    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rjf77" event={"ID":"39fb3387-3347-4028-837b-a93354d07835","Type":"ContainerStarted","Data":"f421a47c32d66953147064f24d6a95883c25f3fc55b688593321eceb335e3b99"}
Nov 02 21:57:51.825137 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:51.824991    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rjf77" event={"ID":"39fb3387-3347-4028-837b-a93354d07835","Type":"ContainerStarted","Data":"6ba158bf503f63b4af986d35bbf152ec87f3cf2e6169c7e855b6d46df09f9338"}
Nov 02 21:57:51.825137 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:51.825062    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rjf77"
Nov 02 21:57:51.841691 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:51.841641    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-rjf77" podStartSLOduration=17.336572834 podStartE2EDuration="18.841627694s" totalImagesPullingTime="1.50505486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:57:51.83970082 +0000 UTC m=+51.830051280" watchObservedRunningTime="2026-11-02 21:57:51.841627694 +0000 UTC m=+51.831978146"
Nov 02 21:57:51.872393 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:51.872364    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:53.075824 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:53.075786    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:53.299439 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:53.299366    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:53.474503 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:53.474470    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:53.675740 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:53.675707    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:53.880289 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:53.880260    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:54.595404 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:54.595369    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:55.207059 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:55.207025    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:55.306368 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:55.306340    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:55.408511 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:55.408477    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:55.508124 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:55.508052    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:56.385314 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:56.385283    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:56.486552 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:56.486522    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:56.587105 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:56.587075    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:56.687713 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:56.687641    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:56.787963 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:56.787932    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:56.888804 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:56.888779    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:56.989150 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:56.989088    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:57.113793 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:57.113765    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:57.314456 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:57.314390    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:57.383952 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:57.383925    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:57.754671 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:57.754647    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:57:58.663559 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.663525    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65946b4b6f-qtvpw"]
Nov 02 21:57:58.666163 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.666137    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:58.666754 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.666739    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.683143 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.683116    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65946b4b6f-qtvpw"]
Nov 02 21:57:58.685577 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.685548    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Nov 02 21:57:58.698128 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.698103    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/932238d8-80c1-420e-b437-83525c2df2e8-image-registry-private-configuration\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.698267 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.698145    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/932238d8-80c1-420e-b437-83525c2df2e8-registry-tls\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.698267 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.698177    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/932238d8-80c1-420e-b437-83525c2df2e8-ca-trust-extracted\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.698378 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.698265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/932238d8-80c1-420e-b437-83525c2df2e8-bound-sa-token\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.698432 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.698416    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/932238d8-80c1-420e-b437-83525c2df2e8-registry-certificates\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.698475 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.698448    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/932238d8-80c1-420e-b437-83525c2df2e8-trusted-ca\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.698525 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.698472    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crdwd\" (UniqueName: \"kubernetes.io/projected/932238d8-80c1-420e-b437-83525c2df2e8-kube-api-access-crdwd\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.698579 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.698561    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/932238d8-80c1-420e-b437-83525c2df2e8-installation-pull-secrets\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.770796 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.770761    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Nov 02 21:57:58.771139 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.771011    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Nov 02 21:57:58.771139 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.771062    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6vj4v\""
Nov 02 21:57:58.771139 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.771078    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Nov 02 21:57:58.798989 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.798968    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/932238d8-80c1-420e-b437-83525c2df2e8-installation-pull-secrets\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.799073 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.799004    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/932238d8-80c1-420e-b437-83525c2df2e8-image-registry-private-configuration\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.799073 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.799040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/932238d8-80c1-420e-b437-83525c2df2e8-registry-tls\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.799147 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.799097    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/932238d8-80c1-420e-b437-83525c2df2e8-ca-trust-extracted\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.799147 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.799125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/932238d8-80c1-420e-b437-83525c2df2e8-bound-sa-token\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.799251 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.799157    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/932238d8-80c1-420e-b437-83525c2df2e8-registry-certificates\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.799251 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.799189    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/932238d8-80c1-420e-b437-83525c2df2e8-trusted-ca\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.799251 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.799233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crdwd\" (UniqueName: \"kubernetes.io/projected/932238d8-80c1-420e-b437-83525c2df2e8-kube-api-access-crdwd\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.799667 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.799644    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/932238d8-80c1-420e-b437-83525c2df2e8-ca-trust-extracted\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.800091 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.800069    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/932238d8-80c1-420e-b437-83525c2df2e8-registry-certificates\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.800425 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.800403    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/932238d8-80c1-420e-b437-83525c2df2e8-trusted-ca\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.801493 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.801475    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/932238d8-80c1-420e-b437-83525c2df2e8-installation-pull-secrets\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.801577 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.801497    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/932238d8-80c1-420e-b437-83525c2df2e8-image-registry-private-configuration\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.801577 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.801572    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/932238d8-80c1-420e-b437-83525c2df2e8-registry-tls\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.809026 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.809002    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/932238d8-80c1-420e-b437-83525c2df2e8-bound-sa-token\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.809123 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.809054    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crdwd\" (UniqueName: \"kubernetes.io/projected/932238d8-80c1-420e-b437-83525c2df2e8-kube-api-access-crdwd\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:58.844057 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.844031    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:58.978021 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:58.977957    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:59.259663 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:59.259591    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65946b4b6f-qtvpw"]
Nov 02 21:57:59.263741 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:57:59.263714    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod932238d8_80c1_420e_b437_83525c2df2e8.slice/crio-d1c4f8c66505fd2527b24bd32465c3f0976d4668be26d7509f4e8c89058b68a3 WatchSource:0}: Error finding container d1c4f8c66505fd2527b24bd32465c3f0976d4668be26d7509f4e8c89058b68a3: Status 404 returned error can't find the container with id d1c4f8c66505fd2527b24bd32465c3f0976d4668be26d7509f4e8c89058b68a3
Nov 02 21:57:59.848877 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:59.848846    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw" event={"ID":"932238d8-80c1-420e-b437-83525c2df2e8","Type":"ContainerStarted","Data":"3b0b47ae0ff70a94f2b915926dcb706cc8821beb1edafd10a530f152f8f242d9"}
Nov 02 21:57:59.849264 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:59.848893    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw" event={"ID":"932238d8-80c1-420e-b437-83525c2df2e8","Type":"ContainerStarted","Data":"d1c4f8c66505fd2527b24bd32465c3f0976d4668be26d7509f4e8c89058b68a3"}
Nov 02 21:57:59.849264 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:59.848922    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:57:59.863080 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:59.863056    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:57:59.869159 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:59.869123    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw" podStartSLOduration=1.869111001 podStartE2EDuration="1.869111001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:57:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:57:59.867655187 +0000 UTC m=+59.858005621" watchObservedRunningTime="2026-11-02 21:57:59.869111001 +0000 UTC m=+59.859461441"
Nov 02 21:57:59.964316 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:57:59.964290    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:00.122139 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:00.122110    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:01.830030 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:01.829996    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rjf77"
Nov 02 21:58:05.246352 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.246307    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs\") pod \"network-metrics-daemon-qhm2w\" (UID: \"0272e533-4834-4d8e-a907-5c341eb20edb\") " pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:58:05.246782 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.246380    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:58:05.249591 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.249573    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 02 21:58:05.250660 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.250645    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 02 21:58:05.258866 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.258835    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:58:05.258990 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.258959    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs\") pod \"network-metrics-daemon-qhm2w\" (UID: \"0272e533-4834-4d8e-a907-5c341eb20edb\") " pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:58:05.447557 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.447513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7lz\" (UniqueName: \"kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz\") pod \"network-check-target-s4zr8\" (UID: \"4debe5f2-cdbd-4b57-9af4-f984df529ff2\") " pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:58:05.450189 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.450171    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 02 21:58:05.459578 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.459556    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vjf48\""
Nov 02 21:58:05.460569 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.460555    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 02 21:58:05.467665 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.467649    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:58:05.471047 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.471024    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl7lz\" (UniqueName: \"kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz\") pod \"network-check-target-s4zr8\" (UID: \"4debe5f2-cdbd-4b57-9af4-f984df529ff2\") " pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:58:05.473413 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.473399    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-6t4jd\""
Nov 02 21:58:05.481502 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.481481    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:58:05.490275 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.490177    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-9dzjg\""
Nov 02 21:58:05.498425 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.498377    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:58:05.740636 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.740559    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qhm2w"]
Nov 02 21:58:05.743337 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:58:05.743306    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0272e533_4834_4d8e_a907_5c341eb20edb.slice/crio-cec26a4f2936c04e0eb737d39e2651897a0fb058eca50b7b3dfe4a1993862f8e WatchSource:0}: Error finding container cec26a4f2936c04e0eb737d39e2651897a0fb058eca50b7b3dfe4a1993862f8e: Status 404 returned error can't find the container with id cec26a4f2936c04e0eb737d39e2651897a0fb058eca50b7b3dfe4a1993862f8e
Nov 02 21:58:05.769317 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.769242    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g8bvh"]
Nov 02 21:58:05.772029 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:58:05.771993    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ad960f5_ae8d_43ed_950f_b6f93be7e101.slice/crio-d6102dfa9d56608ea6eaacafe5a5170b33e53cf3c8cf3c56f8b30a111568b01d WatchSource:0}: Error finding container d6102dfa9d56608ea6eaacafe5a5170b33e53cf3c8cf3c56f8b30a111568b01d: Status 404 returned error can't find the container with id d6102dfa9d56608ea6eaacafe5a5170b33e53cf3c8cf3c56f8b30a111568b01d
Nov 02 21:58:05.789576 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.789552    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s4zr8"]
Nov 02 21:58:05.792391 ip-10-0-142-132 kubenswrapper[2576]: W1102 21:58:05.792365    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4debe5f2_cdbd_4b57_9af4_f984df529ff2.slice/crio-a6f582f4487009251e6cc3bc9cd49536d272b9c58e684f7fb55ad804f5354382 WatchSource:0}: Error finding container a6f582f4487009251e6cc3bc9cd49536d272b9c58e684f7fb55ad804f5354382: Status 404 returned error can't find the container with id a6f582f4487009251e6cc3bc9cd49536d272b9c58e684f7fb55ad804f5354382
Nov 02 21:58:05.867171 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.867137    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qhm2w" event={"ID":"0272e533-4834-4d8e-a907-5c341eb20edb","Type":"ContainerStarted","Data":"cec26a4f2936c04e0eb737d39e2651897a0fb058eca50b7b3dfe4a1993862f8e"}
Nov 02 21:58:05.868339 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.868318    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s4zr8" event={"ID":"4debe5f2-cdbd-4b57-9af4-f984df529ff2","Type":"ContainerStarted","Data":"a6f582f4487009251e6cc3bc9cd49536d272b9c58e684f7fb55ad804f5354382"}
Nov 02 21:58:05.869419 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:05.869396    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g8bvh" event={"ID":"0ad960f5-ae8d-43ed-950f-b6f93be7e101","Type":"ContainerStarted","Data":"d6102dfa9d56608ea6eaacafe5a5170b33e53cf3c8cf3c56f8b30a111568b01d"}
Nov 02 21:58:06.448063 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:06.448018    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:06.523238 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:06.522954    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:06.594202 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:06.594171    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:07.878620 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:07.878587    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qhm2w" event={"ID":"0272e533-4834-4d8e-a907-5c341eb20edb","Type":"ContainerStarted","Data":"fc571c60dd4876a5138bc9a5db580722ebd338d48ef7c1b552e9dd92c6102cb8"}
Nov 02 21:58:07.879173 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:07.878645    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qhm2w" event={"ID":"0272e533-4834-4d8e-a907-5c341eb20edb","Type":"ContainerStarted","Data":"ef11b20aa815c664d9a34ac39ba8ed5246bea68d6d42a649d147b23ec6b65c0d"}
Nov 02 21:58:07.896395 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:07.896340    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qhm2w" podStartSLOduration=66.676841332 podStartE2EDuration="1m7.896322793s" totalImagesPullingTime="1.219481461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:58:07.893562953 +0000 UTC m=+67.883913396" watchObservedRunningTime="2026-11-02 21:58:07.896322793 +0000 UTC m=+67.886673235"
Nov 02 21:58:08.512644 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:08.512608    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:09.862916 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:09.862878    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:09.887137 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:09.887023    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s4zr8" event={"ID":"4debe5f2-cdbd-4b57-9af4-f984df529ff2","Type":"ContainerStarted","Data":"9e438854ea17f23e2dd10cb35bf87f7fbfa3da3f9e8d033e41e9ec4084fdd9c5"}
Nov 02 21:58:09.887137 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:09.887105    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:58:09.902897 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:09.902852    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s4zr8" podStartSLOduration=65.485824666 podStartE2EDuration="1m8.902839686s" totalImagesPullingTime="3.41701502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:58:09.901678682 +0000 UTC m=+69.892029124" watchObservedRunningTime="2026-11-02 21:58:09.902839686 +0000 UTC m=+69.893190128"
Nov 02 21:58:10.349364 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:10.349278    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:10.423274 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:10.423242    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:10.762881 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:10.762847    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:10.832426 ip-10-0-142-132 kubenswrapper[2576]: I1102 21:58:10.832350    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:10.883391 ip-10-0-142-132 systemd[1]: Stopping Kubernetes Kubelet...
Nov 02 21:58:10.901591 ip-10-0-142-132 systemd[1]: kubelet.service: Deactivated successfully.
Nov 02 21:58:10.901760 ip-10-0-142-132 systemd[1]: Stopped Kubernetes Kubelet.
Nov 02 21:58:10.901924 ip-10-0-142-132 systemd[1]: kubelet.service: Consumed 3.430s CPU time.
Nov 02 21:58:10.912854 ip-10-0-142-132 systemd[1]: Starting Kubernetes Kubelet...
Nov 02 21:58:10.971875 ip-10-0-142-132 kubenswrapper[5076]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 21:58:10.971875 ip-10-0-142-132 kubenswrapper[5076]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 02 21:58:10.971875 ip-10-0-142-132 kubenswrapper[5076]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 21:58:10.971875 ip-10-0-142-132 kubenswrapper[5076]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 21:58:10.973827 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973759    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 21:58:10.973827 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973826    5076 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 21:58:10.973827 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973830    5076 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 21:58:10.973936 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973834    5076 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 21:58:10.973936 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973837    5076 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 21:58:10.973936 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973840    5076 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 21:58:10.973936 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973843    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 21:58:10.973936 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973845    5076 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 21:58:10.973936 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973849    5076 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 21:58:10.973936 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973851    5076 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 21:58:10.973936 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973854    5076 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 21:58:10.973936 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973856    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 21:58:10.973936 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973860    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 21:58:10.973936 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973869    5076 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 21:58:10.973936 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973873    5076 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 21:58:10.973936 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973876    5076 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 21:58:10.973936 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973879    5076 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 21:58:10.973936 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973881    5076 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 21:58:10.973936 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973884    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 21:58:10.973936 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973887    5076 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 21:58:10.973936 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973890    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 21:58:10.973936 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973893    5076 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 21:58:10.973936 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973896    5076 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 21:58:10.974517 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973898    5076 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 21:58:10.974517 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973902    5076 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 21:58:10.974517 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973904    5076 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 21:58:10.974517 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973907    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 21:58:10.974517 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973910    5076 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 21:58:10.974517 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973912    5076 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 21:58:10.974517 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973915    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 21:58:10.974517 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973918    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 21:58:10.974517 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973920    5076 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 21:58:10.974517 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973923    5076 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 21:58:10.974517 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973926    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 21:58:10.974517 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973928    5076 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 21:58:10.974517 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973931    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 21:58:10.974517 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973933    5076 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 21:58:10.974517 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973936    5076 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 21:58:10.974517 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973939    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 21:58:10.974517 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973942    5076 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 21:58:10.974517 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973944    5076 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 21:58:10.974517 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973948    5076 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 21:58:10.975093 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973951    5076 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 21:58:10.975093 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973954    5076 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 21:58:10.975093 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973957    5076 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 21:58:10.975093 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973959    5076 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 21:58:10.975093 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973962    5076 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 21:58:10.975093 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973965    5076 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 21:58:10.975093 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973967    5076 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 21:58:10.975093 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973970    5076 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 21:58:10.975093 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973972    5076 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 21:58:10.975093 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973975    5076 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 21:58:10.975093 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973977    5076 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 21:58:10.975093 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973980    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 21:58:10.975093 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973983    5076 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 21:58:10.975093 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973986    5076 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 21:58:10.975093 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973989    5076 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 21:58:10.975093 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973992    5076 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 21:58:10.975093 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973994    5076 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 21:58:10.975093 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.973997    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 21:58:10.975093 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974000    5076 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 21:58:10.975600 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974003    5076 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 21:58:10.975600 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974005    5076 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 21:58:10.975600 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974008    5076 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 21:58:10.975600 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974011    5076 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 21:58:10.975600 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974013    5076 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 21:58:10.975600 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974016    5076 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 21:58:10.975600 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974018    5076 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 21:58:10.975600 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974022    5076 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 21:58:10.975600 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974026    5076 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 21:58:10.975600 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974030    5076 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 21:58:10.975600 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974032    5076 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 21:58:10.975600 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974035    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 21:58:10.975600 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974038    5076 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 21:58:10.975600 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974041    5076 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 21:58:10.975600 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974043    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 21:58:10.975600 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974047    5076 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 21:58:10.975600 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974049    5076 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 21:58:10.975600 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974052    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 21:58:10.975600 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974055    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 21:58:10.976109 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974058    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 21:58:10.976109 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974061    5076 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 21:58:10.976109 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974063    5076 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 21:58:10.976109 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974066    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 21:58:10.976109 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974068    5076 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 21:58:10.976109 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974071    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 21:58:10.976109 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974073    5076 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 21:58:10.976109 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974076    5076 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 21:58:10.976109 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974079    5076 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 21:58:10.976109 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974082    5076 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 21:58:10.976109 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974085    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 21:58:10.976109 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974087    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 21:58:10.976109 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974091    5076 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 21:58:10.976109 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974096    5076 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 21:58:10.976109 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974099    5076 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 21:58:10.976109 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974103    5076 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 21:58:10.976109 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974105    5076 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 21:58:10.976109 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974108    5076 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 21:58:10.976109 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974111    5076 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 21:58:10.976609 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974113    5076 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 21:58:10.976609 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974116    5076 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 21:58:10.976609 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974119    5076 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 21:58:10.976609 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974121    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 21:58:10.976609 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974124    5076 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 21:58:10.976609 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974127    5076 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 21:58:10.976609 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974129    5076 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 21:58:10.976609 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974867    5076 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 21:58:10.976609 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974875    5076 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 21:58:10.976609 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974879    5076 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 21:58:10.976609 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974883    5076 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 21:58:10.976609 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974886    5076 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 21:58:10.976609 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974889    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 21:58:10.976609 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974892    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 21:58:10.976609 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974894    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 21:58:10.976609 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974897    5076 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 21:58:10.976609 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974900    5076 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 21:58:10.976609 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974903    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 21:58:10.976609 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974906    5076 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 21:58:10.977091 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974909    5076 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 21:58:10.977091 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974912    5076 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 21:58:10.977091 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974915    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 21:58:10.977091 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974917    5076 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 21:58:10.977091 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974920    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 21:58:10.977091 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974923    5076 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 21:58:10.977091 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974926    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 21:58:10.977091 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974928    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 21:58:10.977091 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974931    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 21:58:10.977091 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974934    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 21:58:10.977091 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974936    5076 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 21:58:10.977091 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974939    5076 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 21:58:10.977091 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974941    5076 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 21:58:10.977091 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974944    5076 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 21:58:10.977091 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974946    5076 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 21:58:10.977091 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974949    5076 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 21:58:10.977091 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974952    5076 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 21:58:10.977091 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974955    5076 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 21:58:10.977091 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974957    5076 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 21:58:10.977091 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974960    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 21:58:10.977621 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974962    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 21:58:10.977621 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974965    5076 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 21:58:10.977621 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974968    5076 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 21:58:10.977621 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974970    5076 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 21:58:10.977621 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974973    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 21:58:10.977621 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974976    5076 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 21:58:10.977621 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974979    5076 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 21:58:10.977621 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974981    5076 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 21:58:10.977621 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974984    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 21:58:10.977621 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974986    5076 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 21:58:10.977621 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974989    5076 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 21:58:10.977621 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974991    5076 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 21:58:10.977621 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974995    5076 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 21:58:10.977621 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.974998    5076 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 21:58:10.977621 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975000    5076 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 21:58:10.977621 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975003    5076 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 21:58:10.977621 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975006    5076 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 21:58:10.977621 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975008    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 21:58:10.977621 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975011    5076 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 21:58:10.977621 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975013    5076 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 21:58:10.978134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975015    5076 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 21:58:10.978134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975018    5076 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 21:58:10.978134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975021    5076 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 21:58:10.978134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975025    5076 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 21:58:10.978134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975030    5076 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 21:58:10.978134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975033    5076 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 21:58:10.978134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975036    5076 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 21:58:10.978134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975039    5076 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 21:58:10.978134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975042    5076 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 21:58:10.978134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975045    5076 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 21:58:10.978134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975047    5076 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 21:58:10.978134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975050    5076 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 21:58:10.978134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975053    5076 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 21:58:10.978134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975055    5076 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 21:58:10.978134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975058    5076 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 21:58:10.978134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975060    5076 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 21:58:10.978134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975063    5076 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 21:58:10.978134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975066    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 21:58:10.978134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975069    5076 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 21:58:10.978134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975071    5076 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 21:58:10.978650 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975074    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 21:58:10.978650 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975077    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 21:58:10.978650 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975079    5076 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 21:58:10.978650 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975082    5076 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 21:58:10.978650 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975085    5076 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 21:58:10.978650 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975087    5076 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 21:58:10.978650 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975090    5076 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 21:58:10.978650 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975092    5076 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 21:58:10.978650 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975095    5076 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 21:58:10.978650 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975098    5076 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 21:58:10.978650 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975101    5076 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 21:58:10.978650 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975103    5076 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 21:58:10.978650 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975106    5076 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 21:58:10.978650 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975109    5076 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 21:58:10.978650 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975112    5076 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 21:58:10.978650 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975114    5076 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 21:58:10.978650 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975117    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 21:58:10.978650 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975120    5076 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 21:58:10.978650 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975122    5076 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 21:58:10.979116 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975125    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 21:58:10.979116 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975128    5076 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 21:58:10.979116 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975130    5076 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 21:58:10.979116 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975133    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 21:58:10.979116 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975136    5076 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 21:58:10.979116 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975138    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 21:58:10.979116 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975141    5076 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 21:58:10.979116 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975143    5076 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 21:58:10.979116 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975146    5076 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 21:58:10.979116 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975149    5076 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 21:58:10.979116 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975152    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 21:58:10.979116 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975155    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 21:58:10.979116 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975158    5076 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 21:58:10.979116 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975161    5076 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 21:58:10.979116 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975163    5076 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 21:58:10.979116 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975660    5076 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 21:58:10.979116 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975666    5076 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 21:58:10.979116 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975669    5076 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 21:58:10.979116 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975672    5076 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 21:58:10.979599 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975675    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 21:58:10.979599 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975678    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 21:58:10.979599 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975681    5076 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 21:58:10.979599 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975684    5076 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 21:58:10.979599 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975687    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 21:58:10.979599 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975689    5076 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 21:58:10.979599 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975692    5076 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 21:58:10.979599 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975695    5076 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 21:58:10.979599 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975697    5076 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 21:58:10.979599 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975700    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 21:58:10.979599 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975703    5076 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 21:58:10.979599 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975706    5076 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 21:58:10.979599 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975709    5076 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 21:58:10.979599 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975711    5076 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 21:58:10.979599 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975714    5076 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 21:58:10.979599 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975716    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 21:58:10.979599 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975719    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 21:58:10.979599 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975722    5076 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 21:58:10.979599 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975725    5076 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 21:58:10.980073 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975727    5076 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 21:58:10.980073 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975748    5076 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 21:58:10.980073 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975751    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 21:58:10.980073 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975754    5076 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 21:58:10.980073 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975757    5076 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 21:58:10.980073 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975766    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 21:58:10.980073 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975770    5076 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 21:58:10.980073 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975772    5076 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 21:58:10.980073 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975775    5076 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 21:58:10.980073 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975778    5076 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 21:58:10.980073 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975780    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 21:58:10.980073 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975783    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 21:58:10.980073 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975785    5076 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 21:58:10.980073 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975788    5076 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 21:58:10.980073 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975791    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 21:58:10.980073 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975793    5076 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 21:58:10.980073 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975796    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 21:58:10.980073 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975798    5076 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 21:58:10.980073 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975801    5076 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 21:58:10.980073 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975804    5076 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 21:58:10.980635 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975806    5076 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 21:58:10.980635 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975809    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 21:58:10.980635 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975811    5076 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 21:58:10.980635 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975814    5076 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 21:58:10.980635 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975816    5076 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 21:58:10.980635 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975819    5076 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 21:58:10.980635 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975821    5076 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 21:58:10.980635 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975824    5076 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 21:58:10.980635 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975826    5076 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 21:58:10.980635 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975829    5076 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 21:58:10.980635 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975832    5076 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 21:58:10.980635 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975835    5076 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 21:58:10.980635 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975839    5076 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 21:58:10.980635 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975844    5076 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 21:58:10.980635 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975847    5076 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 21:58:10.980635 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975850    5076 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 21:58:10.980635 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975853    5076 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 21:58:10.980635 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975858    5076 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 21:58:10.980635 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975866    5076 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 21:58:10.980635 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975869    5076 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 21:58:10.981134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975872    5076 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 21:58:10.981134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975874    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 21:58:10.981134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975877    5076 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 21:58:10.981134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975879    5076 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 21:58:10.981134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975882    5076 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 21:58:10.981134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975885    5076 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 21:58:10.981134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975888    5076 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 21:58:10.981134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975890    5076 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 21:58:10.981134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975893    5076 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 21:58:10.981134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975895    5076 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 21:58:10.981134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975898    5076 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 21:58:10.981134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975901    5076 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 21:58:10.981134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975903    5076 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 21:58:10.981134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975906    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 21:58:10.981134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975909    5076 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 21:58:10.981134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975911    5076 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 21:58:10.981134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975914    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 21:58:10.981134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975916    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 21:58:10.981134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975919    5076 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 21:58:10.981134 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975921    5076 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 21:58:10.981639 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975924    5076 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 21:58:10.981639 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975927    5076 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 21:58:10.981639 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975929    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 21:58:10.981639 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975932    5076 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 21:58:10.981639 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975937    5076 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 21:58:10.981639 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975941    5076 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 21:58:10.981639 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975944    5076 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 21:58:10.981639 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975947    5076 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 21:58:10.981639 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975949    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 21:58:10.981639 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975953    5076 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 21:58:10.981639 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975956    5076 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 21:58:10.981639 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975964    5076 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 21:58:10.981639 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975967    5076 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 21:58:10.981639 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975970    5076 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 21:58:10.981639 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975972    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 21:58:10.981639 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975975    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 21:58:10.981639 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975978    5076 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 21:58:10.981639 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975980    5076 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 21:58:10.981639 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975983    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975986    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975989    5076 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975992    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.975994    5076 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976086    5076 flags.go:64] FLAG: --address="0.0.0.0"
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976097    5076 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976111    5076 flags.go:64] FLAG: --anonymous-auth="true"
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976116    5076 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976121    5076 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976124    5076 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976128    5076 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976133    5076 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976136    5076 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976139    5076 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976142    5076 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976158    5076 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976162    5076 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976165    5076 flags.go:64] FLAG: --cgroup-root=""
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976168    5076 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976171    5076 flags.go:64] FLAG: --client-ca-file=""
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976174    5076 flags.go:64] FLAG: --cloud-provider="external"
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976177    5076 flags.go:64] FLAG: --cluster-dns="[]"
Nov 02 21:58:10.982108 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976185    5076 flags.go:64] FLAG: --cluster-domain=""
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976188    5076 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976191    5076 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976200    5076 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976204    5076 flags.go:64] FLAG: --container-log-max-files="5"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976208    5076 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976211    5076 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976229    5076 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976233    5076 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976236    5076 flags.go:64] FLAG: --contention-profiling="false"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976239    5076 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976242    5076 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976245    5076 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976248    5076 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976253    5076 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976256    5076 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976259    5076 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976262    5076 flags.go:64] FLAG: --enable-load-reader="false"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976265    5076 flags.go:64] FLAG: --enable-server="true"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976268    5076 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976276    5076 flags.go:64] FLAG: --event-burst="100"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976279    5076 flags.go:64] FLAG: --event-qps="50"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976282    5076 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976285    5076 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 02 21:58:10.982700 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976288    5076 flags.go:64] FLAG: --eviction-hard=""
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976293    5076 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976296    5076 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976300    5076 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976303    5076 flags.go:64] FLAG: --eviction-soft=""
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976306    5076 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976309    5076 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976312    5076 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976315    5076 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976318    5076 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976321    5076 flags.go:64] FLAG: --fail-swap-on="true"
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976331    5076 flags.go:64] FLAG: --feature-gates=""
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976341    5076 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976345    5076 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976348    5076 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976351    5076 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976355    5076 flags.go:64] FLAG: --healthz-port="10248"
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976358    5076 flags.go:64] FLAG: --help="false"
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976361    5076 flags.go:64] FLAG: --hostname-override="ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976364    5076 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976367    5076 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976370    5076 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976374    5076 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 02 21:58:10.983310 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976377    5076 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976380    5076 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976383    5076 flags.go:64] FLAG: --image-service-endpoint=""
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976386    5076 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976389    5076 flags.go:64] FLAG: --kube-api-burst="100"
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976392    5076 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976396    5076 flags.go:64] FLAG: --kube-api-qps="50"
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976399    5076 flags.go:64] FLAG: --kube-reserved=""
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976401    5076 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976404    5076 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976409    5076 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976412    5076 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976415    5076 flags.go:64] FLAG: --lock-file=""
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976418    5076 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976421    5076 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976424    5076 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976430    5076 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976433    5076 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976436    5076 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976439    5076 flags.go:64] FLAG: --logging-format="text"
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976442    5076 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976445    5076 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976454    5076 flags.go:64] FLAG: --manifest-url=""
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976458    5076 flags.go:64] FLAG: --manifest-url-header=""
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976462    5076 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 02 21:58:10.984233 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976465    5076 flags.go:64] FLAG: --max-open-files="1000000"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976469    5076 flags.go:64] FLAG: --max-pods="110"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976473    5076 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976476    5076 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976479    5076 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976483    5076 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976486    5076 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976489    5076 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976492    5076 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976499    5076 flags.go:64] FLAG: --node-status-max-images="50"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976502    5076 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976505    5076 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976508    5076 flags.go:64] FLAG: --pod-cidr=""
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976511    5076 flags.go:64] FLAG: --pod-manifest-path=""
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976514    5076 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976518    5076 flags.go:64] FLAG: --pods-per-core="0"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976521    5076 flags.go:64] FLAG: --port="10250"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976525    5076 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976528    5076 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0ab9c51bea6befd5b"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976532    5076 flags.go:64] FLAG: --qos-reserved=""
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976535    5076 flags.go:64] FLAG: --read-only-port="10255"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976538    5076 flags.go:64] FLAG: --register-node="true"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976540    5076 flags.go:64] FLAG: --register-with-taints=""
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976545    5076 flags.go:64] FLAG: --registry-burst="10"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976548    5076 flags.go:64] FLAG: --registry-qps="5"
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976550    5076 flags.go:64] FLAG: --reserved-cpus=""
Nov 02 21:58:10.984964 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976553    5076 flags.go:64] FLAG: --reserved-memory=""
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976557    5076 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976561    5076 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976564    5076 flags.go:64] FLAG: --rotate-certificates="false"
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976572    5076 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976575    5076 flags.go:64] FLAG: --runonce="false"
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976578    5076 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976582    5076 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976585    5076 flags.go:64] FLAG: --seccomp-default="false"
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976588    5076 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976591    5076 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976594    5076 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976597    5076 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976600    5076 flags.go:64] FLAG: --storage-driver-password="root"
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976603    5076 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976606    5076 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976609    5076 flags.go:64] FLAG: --storage-driver-user="root"
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976612    5076 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976617    5076 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976621    5076 flags.go:64] FLAG: --system-cgroups=""
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976624    5076 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976629    5076 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976632    5076 flags.go:64] FLAG: --tls-cert-file=""
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976637    5076 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976643    5076 flags.go:64] FLAG: --tls-min-version=""
Nov 02 21:58:10.985634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976646    5076 flags.go:64] FLAG: --tls-private-key-file=""
Nov 02 21:58:10.986294 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976649    5076 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 02 21:58:10.986294 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976652    5076 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 02 21:58:10.986294 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976655    5076 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 02 21:58:10.986294 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976658    5076 flags.go:64] FLAG: --v="2"
Nov 02 21:58:10.986294 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976662    5076 flags.go:64] FLAG: --version="false"
Nov 02 21:58:10.986294 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976666    5076 flags.go:64] FLAG: --vmodule=""
Nov 02 21:58:10.986294 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976670    5076 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 02 21:58:10.986294 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.976674    5076 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 02 21:58:10.986294 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976824    5076 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 21:58:10.986294 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976828    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 21:58:10.986294 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976831    5076 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 21:58:10.986294 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976835    5076 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 21:58:10.986294 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976838    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 21:58:10.986294 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976840    5076 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 21:58:10.986294 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976843    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 21:58:10.986294 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976845    5076 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 21:58:10.986294 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976848    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 21:58:10.986294 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976850    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 21:58:10.986294 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976853    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 21:58:10.986294 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976856    5076 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 21:58:10.986834 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976858    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 21:58:10.986834 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976861    5076 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 21:58:10.986834 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976864    5076 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 21:58:10.986834 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976866    5076 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 21:58:10.986834 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976870    5076 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 21:58:10.986834 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976873    5076 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 21:58:10.986834 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976876    5076 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 21:58:10.986834 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976878    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 21:58:10.986834 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976881    5076 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 21:58:10.986834 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976886    5076 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 21:58:10.986834 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976889    5076 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 21:58:10.986834 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976892    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 21:58:10.986834 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976894    5076 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 21:58:10.986834 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976897    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 21:58:10.986834 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976900    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 21:58:10.986834 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976902    5076 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 21:58:10.986834 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976905    5076 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 21:58:10.986834 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976908    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 21:58:10.986834 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976910    5076 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 21:58:10.986834 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976913    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 21:58:10.987490 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976916    5076 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 21:58:10.987490 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976918    5076 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 21:58:10.987490 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976922    5076 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 21:58:10.987490 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976925    5076 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 21:58:10.987490 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976929    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 21:58:10.987490 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976932    5076 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 21:58:10.987490 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976935    5076 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 21:58:10.987490 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976938    5076 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 21:58:10.987490 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976940    5076 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 21:58:10.987490 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976943    5076 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 21:58:10.987490 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976946    5076 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 21:58:10.987490 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976948    5076 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 21:58:10.987490 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976951    5076 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 21:58:10.987490 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976954    5076 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 21:58:10.987490 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976956    5076 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 21:58:10.987490 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976959    5076 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 21:58:10.987490 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976963    5076 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 21:58:10.987490 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976966    5076 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 21:58:10.987490 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976968    5076 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 21:58:10.987490 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976971    5076 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 21:58:10.988028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976974    5076 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 21:58:10.988028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976977    5076 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 21:58:10.988028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976980    5076 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 21:58:10.988028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976983    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 21:58:10.988028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976986    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 21:58:10.988028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976988    5076 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 21:58:10.988028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976991    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 21:58:10.988028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976993    5076 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 21:58:10.988028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976996    5076 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 21:58:10.988028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.976999    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 21:58:10.988028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977002    5076 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 21:58:10.988028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977004    5076 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 21:58:10.988028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977007    5076 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 21:58:10.988028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977009    5076 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 21:58:10.988028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977012    5076 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 21:58:10.988028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977015    5076 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 21:58:10.988028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977017    5076 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 21:58:10.988028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977021    5076 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 21:58:10.988028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977023    5076 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 21:58:10.988028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977026    5076 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 21:58:10.988655 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977029    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 21:58:10.988655 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977031    5076 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 21:58:10.988655 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977034    5076 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 21:58:10.988655 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977037    5076 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 21:58:10.988655 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977039    5076 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 21:58:10.988655 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977042    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 21:58:10.988655 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977045    5076 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 21:58:10.988655 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977047    5076 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 21:58:10.988655 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977051    5076 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 21:58:10.988655 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977054    5076 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 21:58:10.988655 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977056    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 21:58:10.988655 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977059    5076 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 21:58:10.988655 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977061    5076 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 21:58:10.988655 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977066    5076 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 21:58:10.988655 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977069    5076 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 21:58:10.988655 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977071    5076 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 21:58:10.988655 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977074    5076 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 21:58:10.988655 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977077    5076 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 21:58:10.988655 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977079    5076 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 21:58:10.988655 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977082    5076 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 21:58:10.989163 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977085    5076 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 21:58:10.989163 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977087    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 21:58:10.989163 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977092    5076 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 21:58:10.989163 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977096    5076 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 21:58:10.989163 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977099    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 21:58:10.989163 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977102    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 21:58:10.989163 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977105    5076 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 21:58:10.989163 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977108    5076 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 21:58:10.989163 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977110    5076 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 21:58:10.989163 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977113    5076 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 21:58:10.989163 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977116    5076 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 21:58:10.989163 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977119    5076 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 21:58:10.989163 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977121    5076 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 21:58:10.989163 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977124    5076 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 21:58:10.989163 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.977149    5076 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 21:58:10.989654 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977183    5076 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 21:58:10.989654 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977187    5076 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 21:58:10.989654 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977190    5076 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 21:58:10.989654 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977193    5076 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 21:58:10.989654 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977195    5076 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 21:58:10.989654 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977200    5076 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 21:58:10.989654 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977202    5076 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 21:58:10.989654 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977205    5076 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 21:58:10.989654 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977208    5076 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 21:58:10.989654 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977210    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 21:58:10.989654 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977228    5076 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 21:58:10.989654 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977234    5076 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 21:58:10.989654 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977238    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 21:58:10.989654 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977241    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 21:58:10.989654 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977244    5076 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 21:58:10.989654 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977247    5076 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 21:58:10.989654 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977251    5076 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 21:58:10.989654 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977253    5076 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 21:58:10.989654 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977256    5076 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 21:58:10.990229 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977259    5076 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 21:58:10.990229 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977261    5076 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 21:58:10.990229 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977264    5076 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 21:58:10.990229 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977267    5076 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 21:58:10.990229 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977269    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 21:58:10.990229 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977272    5076 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 21:58:10.990229 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977275    5076 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 21:58:10.990229 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977277    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 21:58:10.990229 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977280    5076 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 21:58:10.990229 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977283    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 21:58:10.990229 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977286    5076 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 21:58:10.990229 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977289    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 21:58:10.990229 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977291    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 21:58:10.990229 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977294    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 21:58:10.990229 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977296    5076 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 21:58:10.990229 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977299    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 21:58:10.990229 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977302    5076 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 21:58:10.990229 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977304    5076 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 21:58:10.990229 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977309    5076 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 21:58:10.990708 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977311    5076 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 21:58:10.990708 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977314    5076 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 21:58:10.990708 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977317    5076 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 21:58:10.990708 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977319    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 21:58:10.990708 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977322    5076 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 21:58:10.990708 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977327    5076 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 21:58:10.990708 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977329    5076 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 21:58:10.990708 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977332    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 21:58:10.990708 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977335    5076 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 21:58:10.990708 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977337    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 21:58:10.990708 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977340    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 21:58:10.990708 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977343    5076 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 21:58:10.990708 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977345    5076 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 21:58:10.990708 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977348    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 21:58:10.990708 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977351    5076 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 21:58:10.990708 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977353    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 21:58:10.990708 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977356    5076 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 21:58:10.990708 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977358    5076 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 21:58:10.990708 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977362    5076 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 21:58:10.991172 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977366    5076 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 21:58:10.991172 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977369    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 21:58:10.991172 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977372    5076 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 21:58:10.991172 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977375    5076 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 21:58:10.991172 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977379    5076 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 21:58:10.991172 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977383    5076 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 21:58:10.991172 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977385    5076 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 21:58:10.991172 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977388    5076 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 21:58:10.991172 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977391    5076 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 21:58:10.991172 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977394    5076 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 21:58:10.991172 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977396    5076 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 21:58:10.991172 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977399    5076 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 21:58:10.991172 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977403    5076 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 21:58:10.991172 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977406    5076 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 21:58:10.991172 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977408    5076 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 21:58:10.991172 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977412    5076 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 21:58:10.991172 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977414    5076 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 21:58:10.991172 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977417    5076 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 21:58:10.991172 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977421    5076 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 21:58:10.991172 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977424    5076 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 21:58:10.991657 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977427    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 21:58:10.991657 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977429    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 21:58:10.991657 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977432    5076 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 21:58:10.991657 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977435    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 21:58:10.991657 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977437    5076 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 21:58:10.991657 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977440    5076 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 21:58:10.991657 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977443    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 21:58:10.991657 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977445    5076 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 21:58:10.991657 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977448    5076 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 21:58:10.991657 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977450    5076 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 21:58:10.991657 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977453    5076 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 21:58:10.991657 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977456    5076 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 21:58:10.991657 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977458    5076 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 21:58:10.991657 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977461    5076 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 21:58:10.991657 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977464    5076 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 21:58:10.991657 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977466    5076 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 21:58:10.991657 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977469    5076 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 21:58:10.991657 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977472    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 21:58:10.991657 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977474    5076 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 21:58:10.991657 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977477    5076 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 21:58:10.992164 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977481    5076 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 21:58:10.992164 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977483    5076 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 21:58:10.992164 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977486    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 21:58:10.992164 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977489    5076 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 21:58:10.992164 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977493    5076 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 21:58:10.992164 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977495    5076 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 21:58:10.992164 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977498    5076 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 21:58:10.992164 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977500    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 21:58:10.992164 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.977503    5076 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 21:58:10.992164 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.981156    5076 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 02 21:58:10.992164 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.981172    5076 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 02 21:58:10.992164 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.981189    5076 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 02 21:58:10.992164 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.981194    5076 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 02 21:58:10.992164 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981260    5076 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 21:58:10.992164 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981266    5076 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 21:58:10.992164 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981269    5076 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 21:58:10.992164 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981272    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 21:58:10.992164 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981274    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 21:58:10.992164 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981277    5076 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 21:58:10.992164 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981279    5076 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 21:58:10.992762 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981282    5076 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 21:58:10.992762 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981285    5076 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 21:58:10.992762 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981288    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 21:58:10.992762 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981290    5076 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 21:58:10.992762 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981293    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 21:58:10.992762 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981296    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 21:58:10.992762 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981298    5076 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 21:58:10.992762 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981302    5076 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 21:58:10.992762 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981307    5076 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 21:58:10.992762 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981310    5076 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 21:58:10.992762 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981313    5076 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 21:58:10.992762 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981317    5076 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 21:58:10.992762 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981320    5076 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 21:58:10.992762 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981323    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 21:58:10.992762 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981326    5076 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 21:58:10.992762 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981328    5076 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 21:58:10.992762 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981332    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 21:58:10.992762 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981334    5076 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 21:58:10.992762 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981337    5076 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 21:58:10.993210 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981340    5076 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 21:58:10.993210 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981342    5076 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 21:58:10.993210 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981345    5076 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 21:58:10.993210 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981349    5076 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 21:58:10.993210 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981351    5076 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 21:58:10.993210 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981354    5076 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 21:58:10.993210 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981356    5076 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 21:58:10.993210 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981359    5076 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 21:58:10.993210 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981361    5076 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 21:58:10.993210 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981364    5076 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 21:58:10.993210 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981367    5076 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 21:58:10.993210 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981370    5076 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 21:58:10.993210 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981373    5076 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 21:58:10.993210 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981375    5076 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 21:58:10.993210 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981378    5076 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 21:58:10.993210 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981381    5076 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 21:58:10.993210 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981383    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 21:58:10.993210 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981386    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 21:58:10.993210 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981388    5076 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 21:58:10.993210 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981391    5076 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 21:58:10.993709 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981393    5076 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 21:58:10.993709 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981396    5076 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 21:58:10.993709 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981398    5076 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 21:58:10.993709 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981401    5076 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 21:58:10.993709 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981404    5076 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 21:58:10.993709 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981406    5076 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 21:58:10.993709 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981409    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 21:58:10.993709 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981412    5076 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 21:58:10.993709 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981414    5076 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 21:58:10.993709 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981417    5076 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 21:58:10.993709 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981420    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 21:58:10.993709 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981422    5076 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 21:58:10.993709 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981425    5076 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 21:58:10.993709 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981427    5076 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 21:58:10.993709 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981430    5076 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 21:58:10.993709 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981433    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 21:58:10.993709 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981436    5076 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 21:58:10.993709 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981438    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 21:58:10.993709 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981441    5076 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 21:58:10.994200 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981443    5076 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 21:58:10.994200 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981446    5076 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 21:58:10.994200 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981449    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 21:58:10.994200 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981451    5076 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 21:58:10.994200 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981454    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 21:58:10.994200 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981457    5076 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 21:58:10.994200 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981459    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 21:58:10.994200 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981462    5076 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 21:58:10.994200 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981464    5076 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 21:58:10.994200 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981467    5076 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 21:58:10.994200 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981469    5076 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 21:58:10.994200 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981472    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 21:58:10.994200 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981474    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 21:58:10.994200 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981477    5076 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 21:58:10.994200 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981479    5076 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 21:58:10.994200 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981482    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 21:58:10.994200 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981484    5076 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 21:58:10.994200 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981487    5076 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 21:58:10.994200 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981490    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 21:58:10.994200 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981492    5076 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 21:58:10.994695 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981495    5076 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 21:58:10.994695 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981498    5076 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 21:58:10.994695 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981500    5076 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 21:58:10.994695 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981503    5076 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 21:58:10.994695 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981506    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 21:58:10.994695 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981509    5076 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 21:58:10.994695 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981513    5076 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 21:58:10.994695 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981516    5076 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 21:58:10.994695 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981519    5076 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 21:58:10.994695 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981522    5076 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 21:58:10.994695 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981525    5076 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 21:58:10.994695 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981528    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 21:58:10.994695 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981530    5076 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 21:58:10.994695 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981533    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 21:58:10.994695 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981535    5076 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 21:58:10.994695 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981538    5076 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 21:58:10.994695 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981540    5076 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 21:58:10.994695 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981543    5076 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 21:58:10.994695 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981546    5076 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 21:58:10.995154 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981548    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 21:58:10.995154 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981551    5076 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 21:58:10.995154 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.981577    5076 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 21:58:10.995154 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981699    5076 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 21:58:10.995154 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981703    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 21:58:10.995154 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981706    5076 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 21:58:10.995154 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981709    5076 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 21:58:10.995154 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981712    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 21:58:10.995154 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981715    5076 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 21:58:10.995154 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981718    5076 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 21:58:10.995154 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981720    5076 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 21:58:10.995154 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981723    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 21:58:10.995154 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981726    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 21:58:10.995154 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981728    5076 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 21:58:10.995154 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981731    5076 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 21:58:10.995154 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981734    5076 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 21:58:10.995565 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981736    5076 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 21:58:10.995565 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981739    5076 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 21:58:10.995565 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981741    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 21:58:10.995565 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981744    5076 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 21:58:10.995565 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981747    5076 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 21:58:10.995565 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981749    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 21:58:10.995565 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981752    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 21:58:10.995565 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981754    5076 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 21:58:10.995565 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981757    5076 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 21:58:10.995565 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981760    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 21:58:10.995565 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981763    5076 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 21:58:10.995565 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981765    5076 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 21:58:10.995565 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981768    5076 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 21:58:10.995565 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981771    5076 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 21:58:10.995565 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981773    5076 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 21:58:10.995565 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981776    5076 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 21:58:10.995565 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981778    5076 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 21:58:10.995565 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981781    5076 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 21:58:10.995565 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981784    5076 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 21:58:10.996045 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981787    5076 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 21:58:10.996045 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981789    5076 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 21:58:10.996045 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981792    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 21:58:10.996045 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981794    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 21:58:10.996045 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981799    5076 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 21:58:10.996045 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981802    5076 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 21:58:10.996045 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981805    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 21:58:10.996045 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981807    5076 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 21:58:10.996045 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981810    5076 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 21:58:10.996045 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981812    5076 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 21:58:10.996045 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981816    5076 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 21:58:10.996045 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981820    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 21:58:10.996045 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981823    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 21:58:10.996045 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981826    5076 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 21:58:10.996045 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981829    5076 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 21:58:10.996045 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981831    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 21:58:10.996045 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981834    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 21:58:10.996045 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981836    5076 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 21:58:10.996045 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981839    5076 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 21:58:10.996534 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981842    5076 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 21:58:10.996534 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981844    5076 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 21:58:10.996534 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981847    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 21:58:10.996534 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981850    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 21:58:10.996534 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981853    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 21:58:10.996534 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981856    5076 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 21:58:10.996534 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981858    5076 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 21:58:10.996534 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981861    5076 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 21:58:10.996534 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981864    5076 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 21:58:10.996534 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981866    5076 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 21:58:10.996534 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981869    5076 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 21:58:10.996534 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981871    5076 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 21:58:10.996534 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981874    5076 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 21:58:10.996534 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981876    5076 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 21:58:10.996534 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981879    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 21:58:10.996534 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981882    5076 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 21:58:10.996534 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981884    5076 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 21:58:10.996534 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981889    5076 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 21:58:10.996534 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981892    5076 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 21:58:10.996534 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981895    5076 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 21:58:10.997028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981897    5076 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 21:58:10.997028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981900    5076 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 21:58:10.997028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981904    5076 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 21:58:10.997028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981908    5076 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 21:58:10.997028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981911    5076 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 21:58:10.997028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981913    5076 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 21:58:10.997028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981916    5076 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 21:58:10.997028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981918    5076 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 21:58:10.997028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981921    5076 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 21:58:10.997028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981924    5076 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 21:58:10.997028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981926    5076 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 21:58:10.997028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981929    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 21:58:10.997028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981931    5076 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 21:58:10.997028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981934    5076 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 21:58:10.997028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981936    5076 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 21:58:10.997028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981939    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 21:58:10.997028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981942    5076 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 21:58:10.997028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981944    5076 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 21:58:10.997028 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981947    5076 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 21:58:10.997499 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981950    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 21:58:10.997499 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981952    5076 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 21:58:10.997499 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981955    5076 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 21:58:10.997499 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981957    5076 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 21:58:10.997499 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981960    5076 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 21:58:10.997499 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981962    5076 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 21:58:10.997499 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981965    5076 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 21:58:10.997499 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981967    5076 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 21:58:10.997499 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981970    5076 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 21:58:10.997499 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981975    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 21:58:10.997499 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981979    5076 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 21:58:10.997499 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981982    5076 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 21:58:10.997499 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981985    5076 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 21:58:10.997499 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981987    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 21:58:10.997499 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981990    5076 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 21:58:10.997499 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.981993    5076 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 21:58:10.997910 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.982015    5076 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 21:58:10.997910 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982042    5076 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 21:58:10.997910 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982047    5076 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 21:58:10.997910 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982050    5076 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 21:58:10.997910 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982053    5076 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 21:58:10.997910 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982055    5076 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 21:58:10.997910 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982058    5076 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 21:58:10.997910 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982061    5076 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 21:58:10.997910 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982063    5076 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 21:58:10.997910 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982066    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 21:58:10.997910 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982069    5076 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 21:58:10.997910 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982072    5076 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 21:58:10.997910 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982074    5076 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 21:58:10.997910 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982077    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 21:58:10.997910 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982080    5076 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 21:58:10.997910 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982083    5076 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 21:58:10.998333 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982085    5076 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 21:58:10.998333 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982088    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 21:58:10.998333 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982091    5076 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 21:58:10.998333 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982093    5076 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 21:58:10.998333 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982097    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 21:58:10.998333 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982099    5076 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 21:58:10.998333 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982102    5076 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 21:58:10.998333 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982105    5076 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 21:58:10.998333 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982107    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 21:58:10.998333 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982110    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 21:58:10.998333 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982115    5076 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 21:58:10.998333 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982118    5076 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 21:58:10.998333 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982121    5076 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 21:58:10.998333 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982124    5076 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 21:58:10.998333 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982126    5076 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 21:58:10.998333 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982129    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 21:58:10.998333 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982132    5076 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 21:58:10.998333 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982134    5076 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 21:58:10.998333 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982137    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 21:58:10.998333 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982140    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 21:58:10.998810 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982142    5076 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 21:58:10.998810 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982145    5076 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 21:58:10.998810 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982148    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 21:58:10.998810 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982150    5076 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 21:58:10.998810 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982153    5076 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 21:58:10.998810 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982156    5076 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 21:58:10.998810 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982159    5076 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 21:58:10.998810 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982161    5076 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 21:58:10.998810 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982164    5076 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 21:58:10.998810 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982167    5076 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 21:58:10.998810 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982169    5076 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 21:58:10.998810 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982173    5076 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 21:58:10.998810 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982175    5076 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 21:58:10.998810 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982178    5076 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 21:58:10.998810 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982181    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 21:58:10.998810 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982184    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 21:58:10.998810 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982186    5076 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 21:58:10.998810 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982188    5076 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 21:58:10.998810 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982191    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 21:58:10.999278 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982194    5076 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 21:58:10.999278 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982196    5076 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 21:58:10.999278 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982199    5076 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 21:58:10.999278 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982205    5076 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 21:58:10.999278 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982209    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 21:58:10.999278 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982212    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 21:58:10.999278 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982230    5076 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 21:58:10.999278 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982234    5076 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 21:58:10.999278 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982237    5076 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 21:58:10.999278 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982240    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 21:58:10.999278 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982243    5076 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 21:58:10.999278 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982246    5076 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 21:58:10.999278 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982248    5076 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 21:58:10.999278 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982251    5076 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 21:58:10.999278 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982253    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 21:58:10.999278 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982256    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 21:58:10.999278 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982259    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 21:58:10.999278 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982262    5076 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 21:58:10.999278 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982264    5076 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 21:58:10.999771 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982267    5076 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 21:58:10.999771 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982269    5076 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 21:58:10.999771 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982272    5076 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 21:58:10.999771 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982275    5076 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 21:58:10.999771 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982277    5076 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 21:58:10.999771 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982280    5076 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 21:58:10.999771 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982283    5076 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 21:58:10.999771 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982286    5076 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 21:58:10.999771 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982289    5076 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 21:58:10.999771 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982291    5076 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 21:58:10.999771 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982294    5076 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 21:58:10.999771 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982296    5076 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 21:58:10.999771 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982299    5076 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 21:58:10.999771 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982302    5076 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 21:58:10.999771 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982304    5076 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 21:58:10.999771 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982309    5076 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 21:58:10.999771 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982315    5076 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 21:58:10.999771 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982318    5076 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 21:58:10.999771 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982321    5076 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 21:58:11.000247 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982324    5076 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 21:58:11.000247 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982327    5076 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 21:58:11.000247 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982330    5076 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 21:58:11.000247 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982333    5076 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 21:58:11.000247 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982335    5076 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 21:58:11.000247 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982338    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 21:58:11.000247 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982340    5076 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 21:58:11.000247 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982343    5076 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 21:58:11.000247 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982346    5076 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 21:58:11.000247 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982348    5076 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 21:58:11.000247 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982351    5076 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 21:58:11.000247 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982354    5076 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 21:58:11.000247 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982356    5076 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 21:58:11.000247 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:10.982359    5076 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 21:58:11.000247 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.982405    5076 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 02 21:58:11.000247 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.983279    5076 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Nov 02 21:58:11.000247 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.983328    5076 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Nov 02 21:58:11.000247 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.984362    5076 server.go:1014] "Starting client certificate rotation"
Nov 02 21:58:11.000247 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.984547    5076 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 02 21:58:11.000968 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.984737    5076 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-01 21:52:00 +0000 UTC" deadline="2028-06-06 00:44:51.554803336 +0000 UTC"
Nov 02 21:58:11.000968 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.984786    5076 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13946h46m40.570020298s"
Nov 02 21:58:11.000968 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.985173    5076 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 21:58:11.000968 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.986199    5076 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 21:58:11.000968 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.987554    5076 log.go:25] "Validated CRI v1 runtime API"
Nov 02 21:58:11.000968 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.989260    5076 log.go:25] "Validated CRI v1 image API"
Nov 02 21:58:11.000968 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.990047    5076 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 02 21:58:11.000968 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.991712    5076 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a72734e9-356b-46fc-9417-554082807394:/dev/nvme0n1p3 e1969d1a-8b3c-4e62-a642-b354b236e62e:/dev/nvme0n1p4]
Nov 02 21:58:11.001345 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.991732    5076 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0ae0d0867caa07842cd173ccd0aca0c2f9c35f5c97476b9396eea1de6ed6b6f1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0ae0d0867caa07842cd173ccd0aca0c2f9c35f5c97476b9396eea1de6ed6b6f1/userdata/shm major:0 minor:202 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/19a0166b7b57f1314231357853b58cff5e8e3a71946dbef05a399c9d0e819f62/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/19a0166b7b57f1314231357853b58cff5e8e3a71946dbef05a399c9d0e819f62/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/202407eace618277a127e9921b28bed64d00988d8cba676edfe3ec153c682097/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/202407eace618277a127e9921b28bed64d00988d8cba676edfe3ec153c682097/userdata/shm major:0 minor:248 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/219da624c562cfd1d677dce98cf027fc7f35f7997a837805ad8508f4cde55fa7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/219da624c562cfd1d677dce98cf027fc7f35f7997a837805ad8508f4cde55fa7/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/38c42907d619c842321ffc439dad5f5bd86b3af191a43a7c2a30c85e006da46a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/38c42907d619c842321ffc439dad5f5bd86b3af191a43a7c2a30c85e006da46a/userdata/shm major:0 minor:225 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/50fde3f5535230faaf9a733db5200794720237e10ce2d005d78e0401da40a28e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/50fde3f5535230faaf9a733db5200794720237e10ce2d005d78e0401da40a28e/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5548146444ddb24a0fff976de1a1d31118a465d60e0be93b3605fa6f7ebc14a3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5548146444ddb24a0fff976de1a1d31118a465d60e0be93b3605fa6f7ebc14a3/userdata/shm major:0 minor:214 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5e2abcd9f09d8ce60186c4cc7ad1e875096974fff3d7f2696f25e7565ca2419e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5e2abcd9f09d8ce60186c4cc7ad1e875096974fff3d7f2696f25e7565ca2419e/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6a016f0733425b28c300eda2cadfe4ce444b8c76ae459731a6185ecb670e9b3e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6a016f0733425b28c300eda2cadfe4ce444b8c76ae459731a6185ecb670e9b3e/userdata/shm major:0 minor:54 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8ea1662581010af275cece56f47eb0dc3e7a3e178a9800b5405199d875e89ae3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8ea1662581010af275cece56f47eb0dc3e7a3e178a9800b5405199d875e89ae3/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9cb2256f1d2af9eb3465c01d9bfe57bdbda5e7c0d4a3407e077c52d7bdd0877e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9cb2256f1d2af9eb3465c01d9bfe57bdbda5e7c0d4a3407e077c52d7bdd0877e/userdata/shm major:0 minor:55 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a6f582f4487009251e6cc3bc9cd49536d272b9c58e684f7fb55ad804f5354382/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a6f582f4487009251e6cc3bc9cd49536d272b9c58e684f7fb55ad804f5354382/userdata/shm major:0 minor:306 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cec26a4f2936c04e0eb737d39e2651897a0fb058eca50b7b3dfe4a1993862f8e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cec26a4f2936c04e0eb737d39e2651897a0fb058eca50b7b3dfe4a1993862f8e/userdata/shm major:0 minor:302 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d1c4f8c66505fd2527b24bd32465c3f0976d4668be26d7509f4e8c89058b68a3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d1c4f8c66505fd2527b24bd32465c3f0976d4668be26d7509f4e8c89058b68a3/userdata/shm major:0 minor:289 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d4ad79638c9cb202e76fb7c9e146c8a9be239f52cdf301e0b3d4d6490a3d1673/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d4ad79638c9cb202e76fb7c9e146c8a9be239f52cdf301e0b3d4d6490a3d1673/userdata/shm major:0 minor:219 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d6102dfa9d56608ea6eaacafe5a5170b33e53cf3c8cf3c56f8b30a111568b01d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d6102dfa9d56608ea6eaacafe5a5170b33e53cf3c8cf3c56f8b30a111568b01d/userdata/shm major:0 minor:304 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ecddfcfb89279612dc47ce67924bc4cd4f9d0cdb698fd61fe3db7bc19a47dccf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ecddfcfb89279612dc47ce67924bc4cd4f9d0cdb698fd61fe3db7bc19a47dccf/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ecf275fb3cbf9215368eae87c3d62b457f2acceb7456057a7b25ceb8fa7386cf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ecf275fb3cbf9215368eae87c3d62b457f2acceb7456057a7b25ceb8fa7386cf/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fab7fe7d6a5e3f8fc20791d6875880030ebaee6c0ad925d6ee3be31f35194e58/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fab7fe7d6a5e3f8fc20791d6875880030ebaee6c0ad925d6ee3be31f35194e58/userdata/shm major:0 minor:269 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ffd06d38137ca6866ffbc023bdcef223f05cbe283e2bb0a3aca63d6ef51d6f6e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ffd06d38137ca6866ffbc023bdcef223f05cbe283e2bb0a3aca63d6ef51d6f6e/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0272e533-4834-4d8e-a907-5c341eb20edb/volumes/kubernetes.io~projected/kube-api-access-qj729:{mountpoint:/var/lib/kubelet/pods/0272e533-4834-4d8e-a907-5c341eb20edb/volumes/kubernetes.io~projected/kube-api-access-qj729 major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0272e533-4834-4d8e-a907-5c341eb20edb/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/0272e533-4834-4d8e-a907-5c341eb20edb/volumes/kubernetes.io~secret/metrics-certs major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/02c98483-aa0a-483b-9e76-d578115bae14/volumes/kubernetes.io~projected/kube-api-access-hh5cr:{mountpoint:/var/lib/kubelet/pods/02c98483-aa0a-483b-9e76-d578115bae14/volumes/kubernetes.io~projected/kube-api-access-hh5cr major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0ad960f5-ae8d-43ed-950f-b6f93be7e101/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/0ad960f5-ae8d-43ed-950f-b6f93be7e101/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:300 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1c203060-df7f-4287-b699-9fb6666b6c17/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/1c203060-df7f-4287-b699-9fb6666b6c17/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1c203060-df7f-4287-b699-9fb6666b6c17/volumes/kubernetes.io~projected/kube-api-access-s7f9j:{mountpoint:/var/lib/kubelet/pods/1c203060-df7f-4287-b699-9fb6666b6c17/volumes/kubernetes.io~projected/kube-api-access-s7f9j major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1c203060-df7f-4287-b699-9fb6666b6c17/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/1c203060-df7f-4287-b699-9fb6666b6c17/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/24a682dd-9873-4861-a837-3df17b108c00/volumes/kubernetes.io~projected/kube-api-access-qm6lb:{mountpoint:/var/lib/kubelet/pods/24a682dd-9873-4861-a837-3df17b108c00/volumes/kubernetes.io~projected/kube-api-access-qm6lb major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2da733e7-c5c3-4170-b3c1-1817068ee620/volumes/kubernetes.io~projected/kube-api-access-c6vwb:{mountpoint:/var/lib/kubelet/pods/2da733e7-c5c3-4170-b3c1-1817068ee620/volumes/kubernetes.io~projected/kube-api-access-c6vwb major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/36caef13-1364-4809-af05-58a3a2042ccc/volumes/kubernetes.io~projected/kube-api-access-kdc99:{mountpoint:/var/lib/kubelet/pods/36caef13-1364-4809-af05-58a3a2042ccc/volumes/kubernetes.io~projected/kube-api-access-kdc99 major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/36caef13-1364-4809-af05-58a3a2042ccc/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/36caef13-1364-4809-af05-58a3a2042ccc/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/39fb3387-3347-4028-837b-a93354d07835/volumes/kubernetes.io~projected/kube-api-access-f42cc:{mountpoint:/var/lib/kubelet/pods/39fb3387-3347-4028-837b-a93354d07835/volumes/kubernetes.io~projected/kube-api-access-f42cc major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/39fb3387-3347-4028-837b-a93354d07835/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/39fb3387-3347-4028-837b-a93354d07835/volumes/kubernetes.io~secret/metrics-tls major:0 minor:265 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc/volumes/kubernetes.io~empty-dir/tmp major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc/volumes/kubernetes.io~projected/kube-api-access-vqzvz:{mountpoint:/var/lib/kubelet/pods/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc/volumes/kubernetes.io~projected/kube-api-access-vqzvz major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4debe5f2-cdbd-4b57-9af4-f984df529ff2/volumes/kubernetes.io~projected/kube-api-access-jl7lz:{mountpoint:/var/lib/kubelet/pods/4debe5f2-cdbd-4b57-9af4-f984df529ff2/volumes/kubernetes.io~projected/kube-api-access-jl7lz major:0 minor:301 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/79c8e674-3d99-4644-bf32-199d1de151a6/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/79c8e674-3d99-4644-bf32-199d1de151a6/volumes/kubernetes.io~secret/agent-certs major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/84d08f21-69d0-417b-a9cf-37f80bb4e332/volumes/kubernetes.io~projected/kube-api-access-m55vd:{mountpoint:/var/lib/kubelet/pods/84d08f21-69d0-417b-a9cf-37f80bb4e332/volumes/kubernetes.io~projected/kube-api-access-m55vd major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8778cf51-2f98-409f-855c-60002cb0504c/volumes/kubernetes.io~projected/kube-api-access-kfgw6:{mountpoint:/var/lib/kubelet/pods/8778cf51-2f98-409f-855c-60002cb0504c/volumes/kubernetes.io~projected/kube-api-access-kfgw6 major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8a7ce469-5b88-4552-bb1f-66a901701d43/volumes/kubernetes.io~projected/kube-api-access-k9b9d:{mountpoint:/var/lib/kubelet/pods/8a7ce469-5b88-4552-bb1f-66a901701d43/volumes/kubernetes.io~projected/kube-api-access-k9b9d major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8ff33c25-9556-45d7-8f7b-ca8f45a35c86/volumes/kubernetes.io~projected/kube-api-access-gggb5:{mountpoint:/var/lib/kubelet/pods/8ff33c25-9556-45d7-8f7b-ca8f45a35c86/volumes/kubernetes.io~projected/kube-api-access-gggb5 major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/932238d8-80c1-420e-b437-83525c2df2e8/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/932238d8-80c1-420e-b437-83525c2df2e8/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/932238d8-80c1-420e-b437-83525c2df2e8/volumes/kubernetes.io~projected/kube-api-access-crdwd:{mountpoint:/var/lib/kubelet/pods/932238d8-80c1-420e-b437-83525c2df2e8/volumes/kubernetes.io~projected/kube-api-access-crdwd major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/932238d8-80c1-420e-b437-83525c2df2e8/volumes/kubernetes.io~projected/registry-tls:{mountpoint:/var/lib/kubelet/pods/932238d8-80c1-420e-b437-83525c2df2e8/volumes/kubernetes.io~projected/registry-tls major:0 minor:286 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/932238d8-80c1-420e-b437-83525c2df2e8/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/932238d8-80c1-420e-b437-83525c2df2e8/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:281 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/932238d8-80c1-420e-b437-83525c2df2e8/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/932238d8-80c1-420e-b437-83525c2df2e8/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:285 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d776db87-e7da-4eee-8116-19220c6e61c6/volumes/kubernetes.io~projected/kube-api-access-8pcpq:{mountpoint:/var/lib/kubelet/pods/d776db87-e7da-4eee-8116-19220c6e61c6/volumes/kubernetes.io~projected/kube-api-access-8pcpq major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d776db87-e7da-4eee-8116-19220c6e61c6/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/d776db87-e7da-4eee-8116-19220c6e61c6/volumes/kubernetes.io~secret/signing-key major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e2ba252e-e593-41ec-badb-6c7c98c725a2/volumes/kubernetes.io~projected/kube-api-access-hx2zc:{mountpoint:/var/lib/kubelet/pods/e2ba252e-e593-41ec-badb-6c7c98c725a2/volumes/kubernetes.io~projected/kube-api-access-hx2zc major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e2ba252e-e593-41ec-badb-6c7c98c725a2/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/e2ba252e-e593-41ec-badb-6c7c98c725a2/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:243 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ee77ac04-78e3-47e8-bfc4-9e2ab5f2bb0f/volumes/kubernetes.io~projected/kube-api-access-nctrd:{mountpoint:/var/lib/kubelet/pods/ee77ac04-78e3-47e8-bfc4-9e2ab5f2bb0f/volumes/kubernetes.io~projected/kube-api-access-nctrd major:0 minor:218 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/cf43e19cd78b4c794db7b0edb85bc09b5055ba0744c39ec30b583fd5ef7d6dfe/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/7b24bfeeac7142cc394d186c9aba9e89064fe320d298f62bf80c452f9c4078fc/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/acfb55e2d867aa66010d4be06d94dce060a8493895318c252aaa08a6e6b89e8a/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/50b7be091ac3c69b49c05f3cc73003fecb3bd023e24be3282a99ee8e953a92c0/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-113:{mountpoint:/var/lib/containers/storage/overlay/e53760f7344280612fd28440668c0c43768acfca63fa1d73836b0a6a03cf7ad3/merged major:0 minor:113 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/df26d7f18d730085a507d0410a6c8df458cbd3fc0c1c8eb750617e82cb21268d/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/d1c22a1f841e68805c41250e001d04be66593303946d1a1bef051e2147de1bb1/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/199aee334f7b1342c0033be94c12c21629f54cf44abc96347d5fe99475e5be89/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/137319e12ed1a3ff418f34803a0afc52ce62ef1623e8a7d58455d39739ec9a00/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/47242fdebef9a3d1079722fa0dc74e3dd1f4f89b36e0bd1731c97f21bc331452/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-143:{mountpoint:/var/lib/containers/storage/overlay/72b3d6de1831bf41df92b6cdac4393a4d6531e7edf14088294e5d289a906b6fe/merged major:0 minor:143 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/32593c3af23aa9a381d4f7a3c5148615e63ae82f6b37f4992575681e198208b4/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/c8854a3262315bc455c57862b3da2714e695550f7f2052c7f70626b2d93dd06f/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/4c6bb2a8912f651eb5a2f9e41f1bf7def95b767f320644d4b98ed3b0b8d79247/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/f5dc80c0c9f9cbeee48d2a19e448df4ea7291bb851c8cc7f216f646155314e4d/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/1a05ce17bbeea7f631e56fbc5d97e1f90b8a5d0cd1f54f952aa68209748d2e65/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/2eb7148e7abfdee47eadeac3119ec64085b47f0fd097f7fd1bdc4c39b0c974fb/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/49dc50862d4e53e979f904223163837b5c7d42d677021db95ea14dac38c514be/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/813af60003ac7048875b94ab2b46f78db13d9f11ed686a849a96bde91f689992/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/48c4dba27101dd8ab7733dd4e0bc5fdcb7bb472a74baf2ea60d899628e7a0352/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/2c618e3e62979b931328f95ae9f9768d0d7161a3f88aef8650079639680d278e/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-204:{mountpoint:/var/lib/containers/storage/overlay/97261b2073555941fda8dafea5448d246e7fc10155d394d5ea44a538316c20ff/merged major:0 minor:204 fsType:overlay blockSize:0} overlay_0-206:{mountpoint:/var/lib/containers/storage/overlay/e2bcf382eb48118a37fe8ee937406effa1644c072399a2a13437326ee33477e7/merged major:0 minor:206 fsType:overlay blockSize:0} overlay_0-216:{mountpoint:/var/lib/containers/storage/overlay/a02b17fd3cec7e4b0845220c9c692e07bf1d76090acfd6366a239b17920c0e57/merged major:0 minor:216 fsType:overlay blockSize:0} overlay_0-221:{mountpoint:/var/lib/containers/storage/overlay/84223c9de2f071be57ef14bc4463606daf2bd190656bfe59dcf4a83245889b32/merged major:0 minor:221 fsType:overlay blockSize:0} overlay_0-227:{mountpoint:/var/lib/containers/storage/overlay/5e5b0faf6879d74b0cd502809256d7974128701f837cf01a0307a954e1b9df2f/merged major:0 minor:227 fsType:overlay blockSize:0} overlay_0-229:{mountpoint:/var/lib/containers/storage/overlay/a669ac65ed4f74085b4a9ec4011d1da86d49f12360fb1c0de8fea0b1393f62e3/merged major:0 minor:229 fsType:overlay blockSize:0} overlay_0-231:{mountpoint:/var/lib/containers/storage/overlay/4d57c1adae0898fed3c44cd8fa227174f16d87a136634e613957ed2ed2cc69bb/merged major:0 minor:231 fsType:overlay blockSize:0} overlay_0-237:{mountpoint:/var/lib/containers/storage/overlay/a5b8fbe7594fed63b8b9fd1e7f3d4f19d2781ae121ab0641ad3f979ad3344ecb/merged major:0 minor:237 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/b9aabe360ab4376789035b7c26ee45bc824fec0d0c14d9f6e046a485d9379cf6/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/0fb70c1ac0c79aad27a5f711798225db6bece933c300c00a01cb672cba6c9d58/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/a81ec0013d3fc3b8b5413ee21996500663f838bfc53282b2df7dfab1afc1d9bd/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/599816d43d214dc66d0a62748b8a93bafadd97c18765f0833a8525a37cb7cc27/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-271:{mountpoint:/var/lib/containers/storage/overlay/9c2419ffc57f8dacdbd5a890d055c1dd1e77756c936d8d179e32f9bae09095cd/merged major:0 minor:271 fsType:overlay blockSize:0} overlay_0-273:{mountpoint:/var/lib/containers/storage/overlay/3fd5eb6dd49cfbe75f60e669a1627549ce8f4265b9705e3935ff69e425eb03ee/merged major:0 minor:273 fsType:overlay blockSize:0} overlay_0-275:{mountpoint:/var/lib/containers/storage/overlay/40c264ad054ca053e21c737cc1a57a2d4693532d2e596e3d0b8045bf0d980bc2/merged major:0 minor:275 fsType:overlay blockSize:0} overlay_0-291:{mountpoint:/var/lib/containers/storage/overlay/4777b817bc89f5ade226105240817fbf3bb2aee8ad467c46b3d4d92b2b6ce60a/merged major:0 minor:291 fsType:overlay blockSize:0} overlay_0-293:{mountpoint:/var/lib/containers/storage/overlay/3d6c4dd4390f069eec91e9a1a850706e215179126b9f64707a57a3111825c165/merged major:0 minor:293 fsType:overlay blockSize:0} overlay_0-308:{mountpoint:/var/lib/containers/storage/overlay/f58976791b98b5f1e3ab57b081e9747562dd36460e0860bde69cdcc9312ff237/merged major:0 minor:308 fsType:overlay blockSize:0} overlay_0-310:{mountpoint:/var/lib/containers/storage/overlay/19e76c29227232a0c0639fb2aad56b20d79b88e5b74eeb1f91a2c61e159560cc/merged major:0 minor:310 fsType:overlay blockSize:0} overlay_0-312:{mountpoint:/var/lib/containers/storage/overlay/fb88330b64c07c1b85037855d5544d2c0044d66b8d068e688bd26adc7364cfdf/merged major:0 minor:312 fsType:overlay blockSize:0} overlay_0-314:{mountpoint:/var/lib/containers/storage/overlay/7baea2504fcde30798ff0e6304801275d68981e5e8c25b1f61c113af75b0a877/merged major:0 minor:314 fsType:overlay blockSize:0} overlay_0-316:{mountpoint:/var/lib/containers/storage/overlay/95f751a12d7473e0447401e18a78fb24d1dffd461a06f73f6b42a1b64dda4f7d/merged major:0 minor:316 fsType:overlay blockSize:0} overlay_0-322:{mountpoint:/var/lib/containers/storage/overlay/0b912b7d71ea792ba43994ee1c2cd0be69f170feaa962ad6e945e1433098e187/merged major:0 minor:322 fsType:overlay blockSize:0} overlay_0-327:{mountpoint:/var/lib/containers/storage/overlay/1a92815fdd7dbb53c4fd64cef9688f5022bfd2734bad93b98cb3e2df0fb76b46/merged major:0 minor:327 fsType:overlay blockSize:0} overlay_0-58:{mountpoint:/var/lib/containers/storage/overlay/1aee62d87f9cc5070afb78c8ce1a7d9bfa0a7500c1709fe5f994ab3ab065588a/merged major:0 minor:58 fsType:overlay blockSize:0} overlay_0-62:{mountpoint:/var/lib/containers/storage/overlay/13c02cac76362a45c8bef2b27df4b61bc3bd2b25bbbd5566cc5b1b6c99fd1f4d/merged major:0 minor:62 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/3f7f822abcba64c67205c40303bba6d20d064eec226fb632c5722054221bd86a/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/62686b8c76a54ef02861905612a5ae52af0cb5b368ff4a4590535b48fa46283f/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/8fc1fd6e0cf5e321a1881f48f5b0442c45ccbdae78d3d712f0f365f18f59bd58/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/20efb1a09b78e9a04bac4145d9caacb4dc5f4f53e1c3605b50e63208e693f472/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/0229950d30abc4731d3b53794ce948cf7392ba1efb5b981ead49f48607b6204a/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/33b1a54034adba9a70c4a622d7768173c27bd05bddf919beb12c4b280dbcbb2a/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/e4280eff6a3946642e406e16dc1f22e84114bb0f906899bec0f7a9ea16ed1916/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/d23e2ffaef78d243eb32520e25ee32b55aabc061afbc1e693c7532f7ddeef2da/merged major:0 minor:96 fsType:overlay blockSize:0}]
Nov 02 21:58:11.001659 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.999011    5076 manager.go:217] Machine: {Timestamp:2026-11-02 21:58:10.998561558 +0000 UTC m=+0.054895931 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105995 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fa387954f7b2715f81efa868ec834 SystemUUID:ec2fa387-954f-7b27-15f8-1efa868ec834 BootID:98dda23f-2df4-4b3b-82d2-20e4f94df9f8 Filesystems:[{Device:/var/lib/kubelet/pods/84d08f21-69d0-417b-a9cf-37f80bb4e332/volumes/kubernetes.io~projected/kube-api-access-m55vd DeviceMajor:0 DeviceMinor:64 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8ea1662581010af275cece56f47eb0dc3e7a3e178a9800b5405199d875e89ae3/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-204 DeviceMajor:0 DeviceMinor:204 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/38c42907d619c842321ffc439dad5f5bd86b3af191a43a7c2a30c85e006da46a/userdata/shm DeviceMajor:0 DeviceMinor:225 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/932238d8-80c1-420e-b437-83525c2df2e8/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:285 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ffd06d38137ca6866ffbc023bdcef223f05cbe283e2bb0a3aca63d6ef51d6f6e/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ecf275fb3cbf9215368eae87c3d62b457f2acceb7456057a7b25ceb8fa7386cf/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-216 DeviceMajor:0 DeviceMinor:216 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-310 DeviceMajor:0 DeviceMinor:310 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2da733e7-c5c3-4170-b3c1-1817068ee620/volumes/kubernetes.io~projected/kube-api-access-c6vwb DeviceMajor:0 DeviceMinor:51 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1c203060-df7f-4287-b699-9fb6666b6c17/volumes/kubernetes.io~projected/kube-api-access-s7f9j DeviceMajor:0 DeviceMinor:65 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1c203060-df7f-4287-b699-9fb6666b6c17/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/0272e533-4834-4d8e-a907-5c341eb20edb/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:295 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d6102dfa9d56608ea6eaacafe5a5170b33e53cf3c8cf3c56f8b30a111568b01d/userdata/shm DeviceMajor:0 DeviceMinor:304 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/932238d8-80c1-420e-b437-83525c2df2e8/volumes/kubernetes.io~projected/registry-tls DeviceMajor:0 DeviceMinor:286 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-293 DeviceMajor:0 DeviceMinor:293 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d776db87-e7da-4eee-8116-19220c6e61c6/volumes/kubernetes.io~projected/kube-api-access-8pcpq DeviceMajor:0 DeviceMinor:224 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/50fde3f5535230faaf9a733db5200794720237e10ce2d005d78e0401da40a28e/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5548146444ddb24a0fff976de1a1d31118a465d60e0be93b3605fa6f7ebc14a3/userdata/shm DeviceMajor:0 DeviceMinor:214 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/79c8e674-3d99-4644-bf32-199d1de151a6/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:60 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-312 DeviceMajor:0 DeviceMinor:312 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-314 DeviceMajor:0 DeviceMinor:314 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/932238d8-80c1-420e-b437-83525c2df2e8/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:281 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-322 DeviceMajor:0 DeviceMinor:322 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/202407eace618277a127e9921b28bed64d00988d8cba676edfe3ec153c682097/userdata/shm DeviceMajor:0 DeviceMinor:248 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0ad960f5-ae8d-43ed-950f-b6f93be7e101/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:300 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cec26a4f2936c04e0eb737d39e2651897a0fb058eca50b7b3dfe4a1993862f8e/userdata/shm DeviceMajor:0 DeviceMinor:302 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc/volumes/kubernetes.io~projected/kube-api-access-vqzvz DeviceMajor:0 DeviceMinor:53 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/8778cf51-2f98-409f-855c-60002cb0504c/volumes/kubernetes.io~projected/kube-api-access-kfgw6 DeviceMajor:0 DeviceMinor:52 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/219da624c562cfd1d677dce98cf027fc7f35f7997a837805ad8508f4cde55fa7/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/24a682dd-9873-4861-a837-3df17b108c00/volumes/kubernetes.io~projected/kube-api-access-qm6lb DeviceMajor:0 DeviceMinor:208 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-237 DeviceMajor:0 DeviceMinor:237 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d4ad79638c9cb202e76fb7c9e146c8a9be239f52cdf301e0b3d4d6490a3d1673/userdata/shm DeviceMajor:0 DeviceMinor:219 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-221 DeviceMajor:0 DeviceMinor:221 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/932238d8-80c1-420e-b437-83525c2df2e8/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:288 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/1c203060-df7f-4287-b699-9fb6666b6c17/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:61 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5e2abcd9f09d8ce60186c4cc7ad1e875096974fff3d7f2696f25e7565ca2419e/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/39fb3387-3347-4028-837b-a93354d07835/volumes/kubernetes.io~projected/kube-api-access-f42cc DeviceMajor:0 DeviceMinor:197 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-271 DeviceMajor:0 DeviceMinor:271 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a6f582f4487009251e6cc3bc9cd49536d272b9c58e684f7fb55ad804f5354382/userdata/shm DeviceMajor:0 DeviceMinor:306 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/19a0166b7b57f1314231357853b58cff5e8e3a71946dbef05a399c9d0e819f62/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/36caef13-1364-4809-af05-58a3a2042ccc/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d776db87-e7da-4eee-8116-19220c6e61c6/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:223 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-273 DeviceMajor:0 DeviceMinor:273 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-275 DeviceMajor:0 DeviceMinor:275 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-143 DeviceMajor:0 DeviceMinor:143 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ecddfcfb89279612dc47ce67924bc4cd4f9d0cdb698fd61fe3db7bc19a47dccf/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:48 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/8a7ce469-5b88-4552-bb1f-66a901701d43/volumes/kubernetes.io~projected/kube-api-access-k9b9d DeviceMajor:0 DeviceMinor:66 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/02c98483-aa0a-483b-9e76-d578115bae14/volumes/kubernetes.io~projected/kube-api-access-hh5cr DeviceMajor:0 DeviceMinor:67 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0ae0d0867caa07842cd173ccd0aca0c2f9c35f5c97476b9396eea1de6ed6b6f1/userdata/shm DeviceMajor:0 DeviceMinor:202 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-206 DeviceMajor:0 DeviceMinor:206 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e2ba252e-e593-41ec-badb-6c7c98c725a2/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:243 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-291 DeviceMajor:0 DeviceMinor:291 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4debe5f2-cdbd-4b57-9af4-f984df529ff2/volumes/kubernetes.io~projected/kube-api-access-jl7lz DeviceMajor:0 DeviceMinor:301 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-316 DeviceMajor:0 DeviceMinor:316 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-62 DeviceMajor:0 DeviceMinor:62 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/39fb3387-3347-4028-837b-a93354d07835/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:265 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0272e533-4834-4d8e-a907-5c341eb20edb/volumes/kubernetes.io~projected/kube-api-access-qj729 DeviceMajor:0 DeviceMinor:49 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9cb2256f1d2af9eb3465c01d9bfe57bdbda5e7c0d4a3407e077c52d7bdd0877e/userdata/shm DeviceMajor:0 DeviceMinor:55 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/36caef13-1364-4809-af05-58a3a2042ccc/volumes/kubernetes.io~projected/kube-api-access-kdc99 DeviceMajor:0 DeviceMinor:201 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/932238d8-80c1-420e-b437-83525c2df2e8/volumes/kubernetes.io~projected/kube-api-access-crdwd DeviceMajor:0 DeviceMinor:287 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-327 DeviceMajor:0 DeviceMinor:327 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-227 DeviceMajor:0 DeviceMinor:227 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-231 DeviceMajor:0 DeviceMinor:231 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-229 DeviceMajor:0 DeviceMinor:229 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:47 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/8ff33c25-9556-45d7-8f7b-ca8f45a35c86/volumes/kubernetes.io~projected/kube-api-access-gggb5 DeviceMajor:0 DeviceMinor:50 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e2ba252e-e593-41ec-badb-6c7c98c725a2/volumes/kubernetes.io~projected/kube-api-access-hx2zc DeviceMajor:0 DeviceMinor:213 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ee77ac04-78e3-47e8-bfc4-9e2ab5f2bb0f/volumes/kubernetes.io~projected/kube-api-access-nctrd DeviceMajor:0 DeviceMinor:218 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-113 DeviceMajor:0 DeviceMinor:113 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-308 DeviceMajor:0 DeviceMinor:308 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-58 DeviceMajor:0 DeviceMinor:58 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fab7fe7d6a5e3f8fc20791d6875880030ebaee6c0ad925d6ee3be31f35194e58/userdata/shm DeviceMajor:0 DeviceMinor:269 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d1c4f8c66505fd2527b24bd32465c3f0976d4668be26d7509f4e8c89058b68a3/userdata/shm DeviceMajor:0 DeviceMinor:289 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6a016f0733425b28c300eda2cadfe4ce444b8c76ae459731a6185ecb670e9b3e/userdata/shm DeviceMajor:0 DeviceMinor:54 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0ae0d0867caa078 MacAddress:da:c6:56:18:28:c6 Speed:10000 Mtu:8901} {Name:202407eace61827 MacAddress:f2:2a:cd:f5:80:84 Speed:10000 Mtu:8901} {Name:38c42907d619c84 MacAddress:b6:1c:84:e5:8b:5c Speed:10000 Mtu:8901} {Name:5548146444ddb24 MacAddress:7a:09:fd:56:18:67 Speed:10000 Mtu:8901} {Name:a6f582f44870092 MacAddress:c6:02:b6:b5:f0:0a Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:f5:22:ba:91 Speed:0 Mtu:9001} {Name:br-int MacAddress:26:cc:46:1f:86:a7 Speed:0 Mtu:8901} {Name:cec26a4f2936c04 MacAddress:a2:11:65:13:c0:14 Speed:10000 Mtu:8901} {Name:d1c4f8c66505fd2 MacAddress:de:45:bb:56:65:62 Speed:10000 Mtu:8901} {Name:d4ad79638c9cb20 MacAddress:9a:63:0f:79:08:d3 Speed:10000 Mtu:8901} {Name:d6102dfa9d56608 MacAddress:b2:8f:19:9f:61:6b Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:f5:22:ba:91 Speed:0 Mtu:9001} {Name:fab7fe7d6a5e3f8 MacAddress:8e:d5:e4:54:d6:be Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:8e:16:6f:d3:bd:2a Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:42:5d:e7:77:cf:4a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 02 21:58:11.001659 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.999338    5076 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 02 21:58:11.001659 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.999378    5076 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 02 21:58:11.001659 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.999640    5076 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 02 21:58:11.001659 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.999654    5076 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-132.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 02 21:58:11.001659 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.999766    5076 topology_manager.go:143] "Creating topology manager with none policy"
Nov 02 21:58:11.001659 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.999774    5076 container_manager_linux.go:311] "Creating device plugin manager"
Nov 02 21:58:11.001659 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.999788    5076 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 02 21:58:11.001659 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.999801    5076 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 02 21:58:11.001659 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.999857    5076 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 02 21:58:11.001659 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:10.999992    5076 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 02 21:58:11.001659 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.000098    5076 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 02 21:58:11.001659 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.000129    5076 kubelet.go:493] "Attempting to sync node with API server"
Nov 02 21:58:11.001659 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.000141    5076 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 02 21:58:11.001659 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.000157    5076 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 02 21:58:11.001659 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.000166    5076 kubelet.go:405] "Adding apiserver pod source"
Nov 02 21:58:11.001659 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.000174    5076 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 02 21:58:11.002535 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.001704    5076 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 02 21:58:11.002535 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.001720    5076 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 02 21:58:11.002667 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.002647    5076 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 02 21:58:11.004902 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.004886    5076 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 02 21:58:11.004902 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.004899    5076 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 02 21:58:11.005015 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.005005    5076 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Nov 02 21:58:11.005194 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.005183    5076 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 02 21:58:11.005240 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.005213    5076 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 02 21:58:11.005336 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.005327    5076 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 02 21:58:11.005369 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.005341    5076 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 02 21:58:11.005369 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.005348    5076 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 02 21:58:11.005369 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.005353    5076 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 02 21:58:11.005369 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.005360    5076 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 02 21:58:11.005529 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.005371    5076 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 02 21:58:11.005529 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.005381    5076 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 02 21:58:11.005529 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.005388    5076 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 02 21:58:11.005529 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.005395    5076 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 02 21:58:11.005529 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.005401    5076 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 02 21:58:11.005529 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.005415    5076 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 02 21:58:11.005529 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.005424    5076 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 02 21:58:11.005529 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.005446    5076 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 02 21:58:11.005529 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.005454    5076 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 02 21:58:11.008699 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.008684    5076 server.go:1263] "Started kubelet"
Nov 02 21:58:11.009168 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.008797    5076 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 02 21:58:11.009168 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.008804    5076 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 02 21:58:11.009168 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.008881    5076 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 02 21:58:11.009168 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.009160    5076 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 02 21:58:11.009239 ip-10-0-142-132 systemd[1]: Started Kubernetes Kubelet.
Nov 02 21:58:11.010173 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.010155    5076 server.go:317] "Adding debug handlers to kubelet server"
Nov 02 21:58:11.015460 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.013355    5076 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 02 21:58:11.015460 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.013383    5076 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 02 21:58:11.015460 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.013532    5076 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 21:52:01 +0000 UTC" deadline="2028-04-10 10:08:43.475666806 +0000 UTC"
Nov 02 21:58:11.015460 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.013574    5076 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12588h10m32.462098004s"
Nov 02 21:58:11.015460 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.013610    5076 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 02 21:58:11.015460 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.013617    5076 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 02 21:58:11.016722 ip-10-0-142-132 kubenswrapper[5076]: E1102 21:58:11.016447    5076 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-132.us-east-2.compute.internal\" not found"
Nov 02 21:58:11.016722 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.016470    5076 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 02 21:58:11.018513 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.018493    5076 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 21:58:11.019547 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.019481    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1c203060-df7f-4287-b699-9fb6666b6c17" volumeName="kubernetes.io/secret/1c203060-df7f-4287-b699-9fb6666b6c17-ovn-node-metrics-cert" seLinuxMountContext=""
Nov 02 21:58:11.019652 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.019540    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2da733e7-c5c3-4170-b3c1-1817068ee620" volumeName="kubernetes.io/projected/2da733e7-c5c3-4170-b3c1-1817068ee620-kube-api-access-c6vwb" seLinuxMountContext=""
Nov 02 21:58:11.019652 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.019621    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39fb3387-3347-4028-837b-a93354d07835" volumeName="kubernetes.io/projected/39fb3387-3347-4028-837b-a93354d07835-kube-api-access-f42cc" seLinuxMountContext=""
Nov 02 21:58:11.019652 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.019635    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2ba252e-e593-41ec-badb-6c7c98c725a2" volumeName="kubernetes.io/empty-dir/e2ba252e-e593-41ec-badb-6c7c98c725a2-data-volume" seLinuxMountContext=""
Nov 02 21:58:11.019863 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.019668    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2ba252e-e593-41ec-badb-6c7c98c725a2" volumeName="kubernetes.io/projected/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-api-access-hx2zc" seLinuxMountContext=""
Nov 02 21:58:11.019863 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.019684    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0272e533-4834-4d8e-a907-5c341eb20edb" volumeName="kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs" seLinuxMountContext=""
Nov 02 21:58:11.019863 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.019698    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="02c98483-aa0a-483b-9e76-d578115bae14" volumeName="kubernetes.io/projected/02c98483-aa0a-483b-9e76-d578115bae14-kube-api-access-hh5cr" seLinuxMountContext=""
Nov 02 21:58:11.019863 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.019714    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1c203060-df7f-4287-b699-9fb6666b6c17" volumeName="kubernetes.io/configmap/1c203060-df7f-4287-b699-9fb6666b6c17-env-overrides" seLinuxMountContext=""
Nov 02 21:58:11.019863 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.019734    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39fb3387-3347-4028-837b-a93354d07835" volumeName="kubernetes.io/empty-dir/39fb3387-3347-4028-837b-a93354d07835-tmp-dir" seLinuxMountContext=""
Nov 02 21:58:11.019863 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.019752    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4debe5f2-cdbd-4b57-9af4-f984df529ff2" volumeName="kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz" seLinuxMountContext=""
Nov 02 21:58:11.019863 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.019768    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ff33c25-9556-45d7-8f7b-ca8f45a35c86" volumeName="kubernetes.io/configmap/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-cni-binary-copy" seLinuxMountContext=""
Nov 02 21:58:11.019863 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.019787    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1c203060-df7f-4287-b699-9fb6666b6c17" volumeName="kubernetes.io/configmap/1c203060-df7f-4287-b699-9fb6666b6c17-ovnkube-script-lib" seLinuxMountContext=""
Nov 02 21:58:11.019863 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.019801    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24a682dd-9873-4861-a837-3df17b108c00" volumeName="kubernetes.io/empty-dir/24a682dd-9873-4861-a837-3df17b108c00-archives-path" seLinuxMountContext=""
Nov 02 21:58:11.019863 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.019813    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24a682dd-9873-4861-a837-3df17b108c00" volumeName="kubernetes.io/projected/24a682dd-9873-4861-a837-3df17b108c00-kube-api-access-qm6lb" seLinuxMountContext=""
Nov 02 21:58:11.019863 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.019834    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36caef13-1364-4809-af05-58a3a2042ccc" volumeName="kubernetes.io/projected/36caef13-1364-4809-af05-58a3a2042ccc-kube-api-access-kdc99" seLinuxMountContext=""
Nov 02 21:58:11.019863 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.019847    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc" volumeName="kubernetes.io/empty-dir/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-tuned" seLinuxMountContext=""
Nov 02 21:58:11.019863 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.019864    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="84d08f21-69d0-417b-a9cf-37f80bb4e332" volumeName="kubernetes.io/configmap/84d08f21-69d0-417b-a9cf-37f80bb4e332-whereabouts-flatfile-configmap" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.019967    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2ba252e-e593-41ec-badb-6c7c98c725a2" volumeName="kubernetes.io/secret/e2ba252e-e593-41ec-badb-6c7c98c725a2-insights-runtime-extractor-tls" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.019984    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="02c98483-aa0a-483b-9e76-d578115bae14" volumeName="kubernetes.io/configmap/02c98483-aa0a-483b-9e76-d578115bae14-iptables-alerter-script" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020005    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24a682dd-9873-4861-a837-3df17b108c00" volumeName="kubernetes.io/configmap/24a682dd-9873-4861-a837-3df17b108c00-service-ca-bundle" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020017    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39fb3387-3347-4028-837b-a93354d07835" volumeName="kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020035    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="79c8e674-3d99-4644-bf32-199d1de151a6" volumeName="kubernetes.io/secret/79c8e674-3d99-4644-bf32-199d1de151a6-agent-certs" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020050    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="84d08f21-69d0-417b-a9cf-37f80bb4e332" volumeName="kubernetes.io/projected/84d08f21-69d0-417b-a9cf-37f80bb4e332-kube-api-access-m55vd" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020068    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a7ce469-5b88-4552-bb1f-66a901701d43" volumeName="kubernetes.io/empty-dir/8a7ce469-5b88-4552-bb1f-66a901701d43-tmp-dir" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020079    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="932238d8-80c1-420e-b437-83525c2df2e8" volumeName="kubernetes.io/projected/932238d8-80c1-420e-b437-83525c2df2e8-registry-tls" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020094    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee77ac04-78e3-47e8-bfc4-9e2ab5f2bb0f" volumeName="kubernetes.io/projected/ee77ac04-78e3-47e8-bfc4-9e2ab5f2bb0f-kube-api-access-nctrd" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020110    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0272e533-4834-4d8e-a907-5c341eb20edb" volumeName="kubernetes.io/projected/0272e533-4834-4d8e-a907-5c341eb20edb-kube-api-access-qj729" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020122    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1c203060-df7f-4287-b699-9fb6666b6c17" volumeName="kubernetes.io/projected/1c203060-df7f-4287-b699-9fb6666b6c17-kube-api-access-s7f9j" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020247    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc" volumeName="kubernetes.io/empty-dir/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-tmp" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020275    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="932238d8-80c1-420e-b437-83525c2df2e8" volumeName="kubernetes.io/projected/932238d8-80c1-420e-b437-83525c2df2e8-bound-sa-token" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020302    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d776db87-e7da-4eee-8116-19220c6e61c6" volumeName="kubernetes.io/configmap/d776db87-e7da-4eee-8116-19220c6e61c6-signing-cabundle" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020383    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2ba252e-e593-41ec-badb-6c7c98c725a2" volumeName="kubernetes.io/configmap/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-rbac-proxy-cm" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020406    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36caef13-1364-4809-af05-58a3a2042ccc" volumeName="kubernetes.io/secret/36caef13-1364-4809-af05-58a3a2042ccc-cert" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020425    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39fb3387-3347-4028-837b-a93354d07835" volumeName="kubernetes.io/configmap/39fb3387-3347-4028-837b-a93354d07835-config-volume" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020452    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a7ce469-5b88-4552-bb1f-66a901701d43" volumeName="kubernetes.io/projected/8a7ce469-5b88-4552-bb1f-66a901701d43-kube-api-access-k9b9d" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020471    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ff33c25-9556-45d7-8f7b-ca8f45a35c86" volumeName="kubernetes.io/projected/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-kube-api-access-gggb5" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020490    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc" volumeName="kubernetes.io/projected/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-kube-api-access-vqzvz" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020514    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="79c8e674-3d99-4644-bf32-199d1de151a6" volumeName="kubernetes.io/configmap/79c8e674-3d99-4644-bf32-199d1de151a6-konnectivity-ca" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020532    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="84d08f21-69d0-417b-a9cf-37f80bb4e332" volumeName="kubernetes.io/configmap/84d08f21-69d0-417b-a9cf-37f80bb4e332-cni-binary-copy" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020559    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8778cf51-2f98-409f-855c-60002cb0504c" volumeName="kubernetes.io/projected/8778cf51-2f98-409f-855c-60002cb0504c-kube-api-access-kfgw6" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020591    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="932238d8-80c1-420e-b437-83525c2df2e8" volumeName="kubernetes.io/configmap/932238d8-80c1-420e-b437-83525c2df2e8-trusted-ca" seLinuxMountContext=""
Nov 02 21:58:11.020701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020615    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="932238d8-80c1-420e-b437-83525c2df2e8" volumeName="kubernetes.io/empty-dir/932238d8-80c1-420e-b437-83525c2df2e8-ca-trust-extracted" seLinuxMountContext=""
Nov 02 21:58:11.021743 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020913    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="932238d8-80c1-420e-b437-83525c2df2e8" volumeName="kubernetes.io/projected/932238d8-80c1-420e-b437-83525c2df2e8-kube-api-access-crdwd" seLinuxMountContext=""
Nov 02 21:58:11.021743 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020952    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="932238d8-80c1-420e-b437-83525c2df2e8" volumeName="kubernetes.io/secret/932238d8-80c1-420e-b437-83525c2df2e8-image-registry-private-configuration" seLinuxMountContext=""
Nov 02 21:58:11.021743 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020970    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24a682dd-9873-4861-a837-3df17b108c00" volumeName="kubernetes.io/configmap/24a682dd-9873-4861-a837-3df17b108c00-trusted-ca-bundle" seLinuxMountContext=""
Nov 02 21:58:11.021743 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.020984    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2da733e7-c5c3-4170-b3c1-1817068ee620" volumeName="kubernetes.io/configmap/2da733e7-c5c3-4170-b3c1-1817068ee620-serviceca" seLinuxMountContext=""
Nov 02 21:58:11.021743 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.021164    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="84d08f21-69d0-417b-a9cf-37f80bb4e332" volumeName="kubernetes.io/configmap/84d08f21-69d0-417b-a9cf-37f80bb4e332-cni-sysctl-allowlist" seLinuxMountContext=""
Nov 02 21:58:11.021743 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.021182    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ff33c25-9556-45d7-8f7b-ca8f45a35c86" volumeName="kubernetes.io/configmap/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-daemon-config" seLinuxMountContext=""
Nov 02 21:58:11.021743 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.021203    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="932238d8-80c1-420e-b437-83525c2df2e8" volumeName="kubernetes.io/configmap/932238d8-80c1-420e-b437-83525c2df2e8-registry-certificates" seLinuxMountContext=""
Nov 02 21:58:11.021743 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.021233    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="932238d8-80c1-420e-b437-83525c2df2e8" volumeName="kubernetes.io/secret/932238d8-80c1-420e-b437-83525c2df2e8-installation-pull-secrets" seLinuxMountContext=""
Nov 02 21:58:11.021743 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.021247    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d776db87-e7da-4eee-8116-19220c6e61c6" volumeName="kubernetes.io/projected/d776db87-e7da-4eee-8116-19220c6e61c6-kube-api-access-8pcpq" seLinuxMountContext=""
Nov 02 21:58:11.021743 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.021269    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d776db87-e7da-4eee-8116-19220c6e61c6" volumeName="kubernetes.io/secret/d776db87-e7da-4eee-8116-19220c6e61c6-signing-key" seLinuxMountContext=""
Nov 02 21:58:11.021743 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.021285    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ad960f5-ae8d-43ed-950f-b6f93be7e101" volumeName="kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret" seLinuxMountContext=""
Nov 02 21:58:11.021743 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.021303    5076 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1c203060-df7f-4287-b699-9fb6666b6c17" volumeName="kubernetes.io/configmap/1c203060-df7f-4287-b699-9fb6666b6c17-ovnkube-config" seLinuxMountContext=""
Nov 02 21:58:11.021743 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.021328    5076 reconstruct.go:97] "Volume reconstruction finished"
Nov 02 21:58:11.021743 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.021338    5076 reconciler.go:29] "Reconciler: start to sync state"
Nov 02 21:58:11.021743 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.021609    5076 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 21:58:11.022821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.022801    5076 factory.go:55] Registering systemd factory
Nov 02 21:58:11.022990 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.022823    5076 factory.go:223] Registration of the systemd container factory successfully
Nov 02 21:58:11.023059 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.023032    5076 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 21:58:11.023107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.023097    5076 factory.go:153] Registering CRI-O factory
Nov 02 21:58:11.023141 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.023113    5076 factory.go:223] Registration of the crio container factory successfully
Nov 02 21:58:11.023195 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.023183    5076 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 02 21:58:11.023272 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.023206    5076 factory.go:103] Registering Raw factory
Nov 02 21:58:11.023272 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.023236    5076 manager.go:1199] Started watching for new ooms in manager
Nov 02 21:58:11.023662 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.023643    5076 manager.go:319] Starting recovery of all containers
Nov 02 21:58:11.028177 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.028157    5076 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Nov 02 21:58:11.044572 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.044527    5076 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 02 21:58:11.045945 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.045925    5076 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 02 21:58:11.045945 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.045949    5076 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 02 21:58:11.046077 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.045965    5076 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 02 21:58:11.046077 ip-10-0-142-132 kubenswrapper[5076]: E1102 21:58:11.045993    5076 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 02 21:58:11.049300 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.049276    5076 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 21:58:11.072653 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.072615    5076 generic.go:356] "Generic (PLEG): container finished" podID="84d08f21-69d0-417b-a9cf-37f80bb4e332" containerID="b254b54a1fa5a05ad740f20deb0c0ccd211e7d80625e9fbea257d246b17ede12" exitCode=0
Nov 02 21:58:11.072653 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.072649    5076 generic.go:356] "Generic (PLEG): container finished" podID="84d08f21-69d0-417b-a9cf-37f80bb4e332" containerID="69c7edc49c97b14c165801b9ed40cdb4e0512d82bb7db5049b5e70a1aefb377c" exitCode=0
Nov 02 21:58:11.072653 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.072655    5076 generic.go:356] "Generic (PLEG): container finished" podID="84d08f21-69d0-417b-a9cf-37f80bb4e332" containerID="3aed05f12a7fbf160c7caf655aa1a99c4b14030d8751a0d8fea782a8f2375b98" exitCode=0
Nov 02 21:58:11.072828 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.072661    5076 generic.go:356] "Generic (PLEG): container finished" podID="84d08f21-69d0-417b-a9cf-37f80bb4e332" containerID="cd1965b08c4ee30d631c432bd3d6ae156a6cdd58942fb99c98609b639c1d7f84" exitCode=0
Nov 02 21:58:11.072828 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.072667    5076 generic.go:356] "Generic (PLEG): container finished" podID="84d08f21-69d0-417b-a9cf-37f80bb4e332" containerID="09243965903bc98c988ff968db86c69d1a75a3413297b913854a1a4c2abfbfee" exitCode=0
Nov 02 21:58:11.072828 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.072672    5076 generic.go:356] "Generic (PLEG): container finished" podID="84d08f21-69d0-417b-a9cf-37f80bb4e332" containerID="9a58159f483b45cfddbdd415850c50ad5a0bdcb415697aff018edf83a7395ca6" exitCode=0
Nov 02 21:58:11.080962 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.080930    5076 generic.go:356] "Generic (PLEG): container finished" podID="48ed979d025ac3d838a4955411937a4b" containerID="1fec51599f27ad5f33ed7ba20fb889e9f3e35a2b0f9e99224f215f741a3b764e" exitCode=0
Nov 02 21:58:11.105748 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.105730    5076 manager.go:324] Recovery completed
Nov 02 21:58:11.124980 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.124955    5076 cpu_manager.go:226] "Starting" policy="none"
Nov 02 21:58:11.124980 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.124972    5076 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 02 21:58:11.125104 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.124988    5076 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 02 21:58:11.125135 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.125110    5076 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Nov 02 21:58:11.125135 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.125120    5076 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Nov 02 21:58:11.125207 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.125136    5076 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Nov 02 21:58:11.125207 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.125141    5076 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Nov 02 21:58:11.125207 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.125146    5076 policy_none.go:50] "Start"
Nov 02 21:58:11.125207 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.125154    5076 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 02 21:58:11.125207 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.125164    5076 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 02 21:58:11.125357 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.125303    5076 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Nov 02 21:58:11.125357 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.125312    5076 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Nov 02 21:58:11.125357 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.125317    5076 policy_none.go:44] "Start"
Nov 02 21:58:11.129534 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.129509    5076 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 02 21:58:11.132639 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.132624    5076 manager.go:341] "Starting Device Plugin manager"
Nov 02 21:58:11.133162 ip-10-0-142-132 kubenswrapper[5076]: E1102 21:58:11.133145    5076 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 02 21:58:11.133196 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.133163    5076 server.go:87] "Starting device plugin registration server"
Nov 02 21:58:11.133429 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.133418    5076 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 02 21:58:11.133463 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.133430    5076 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 02 21:58:11.133548 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.133531    5076 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 02 21:58:11.133672 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.133635    5076 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 02 21:58:11.133752 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.133679    5076 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 02 21:58:11.133752 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.133686    5076 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 02 21:58:11.133852 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.133736    5076 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-02T21:58:11.133669219Z","UUID":"729eef0b-118a-42c4-809c-76cf0f68fad4","Handler":null,"Name":"","Endpoint":""}
Nov 02 21:58:11.135261 ip-10-0-142-132 kubenswrapper[5076]: E1102 21:58:11.135238    5076 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 02 21:58:11.135354 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.135335    5076 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 02 21:58:11.135412 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.135377    5076 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 02 21:58:11.146101 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.146066    5076 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal"]
Nov 02 21:58:11.146664 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.146625    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal" event={"ID":"3bcc33effb8bb32f83119c817ee77244","Type":"ContainerStarted","Data":"ae5a617265733bae796b479e7614c41e3ced2a59c8ba9e3eddb0a0ac4edac548"}
Nov 02 21:58:11.146664 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.146663    5076 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:11.146893 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.146764    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal" event={"ID":"3bcc33effb8bb32f83119c817ee77244","Type":"ContainerStarted","Data":"9cb2256f1d2af9eb3465c01d9bfe57bdbda5e7c0d4a3407e077c52d7bdd0877e"}
Nov 02 21:58:11.146893 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.146841    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal" event={"ID":"48ed979d025ac3d838a4955411937a4b","Type":"ContainerStarted","Data":"50e066023e045662a7538ab54d6705ac8e5e91c6d7d060e5fa0f9e03df0a852b"}
Nov 02 21:58:11.146893 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.146860    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal" event={"ID":"48ed979d025ac3d838a4955411937a4b","Type":"ContainerDied","Data":"1fec51599f27ad5f33ed7ba20fb889e9f3e35a2b0f9e99224f215f741a3b764e"}
Nov 02 21:58:11.146893 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.146880    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal" event={"ID":"48ed979d025ac3d838a4955411937a4b","Type":"ContainerStarted","Data":"6a016f0733425b28c300eda2cadfe4ce444b8c76ae459731a6185ecb670e9b3e"}
Nov 02 21:58:11.147033 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.146985    5076 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:11.158742 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.158694    5076 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 21:58:11.158742 ip-10-0-142-132 kubenswrapper[5076]: E1102 21:58:11.158739    5076 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:11.159377 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.159363    5076 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 21:58:11.159429 ip-10-0-142-132 kubenswrapper[5076]: E1102 21:58:11.159398    5076 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:11.228501 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.228471    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48ed979d025ac3d838a4955411937a4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal\" (UID: \"48ed979d025ac3d838a4955411937a4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:11.228621 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.228505    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48ed979d025ac3d838a4955411937a4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal\" (UID: \"48ed979d025ac3d838a4955411937a4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:11.228621 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.228523    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3bcc33effb8bb32f83119c817ee77244-config\") pod \"kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal\" (UID: \"3bcc33effb8bb32f83119c817ee77244\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:11.233515 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.233496    5076 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 21:58:11.235407 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.235391    5076 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 21:58:11.235474 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.235423    5076 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 21:58:11.235474 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.235434    5076 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-132.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 21:58:11.235474 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.235470    5076 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:11.248535 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.248519    5076 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:11.248583 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.248573    5076 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:11.329453 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.329432    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48ed979d025ac3d838a4955411937a4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal\" (UID: \"48ed979d025ac3d838a4955411937a4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:11.329535 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.329456    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48ed979d025ac3d838a4955411937a4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal\" (UID: \"48ed979d025ac3d838a4955411937a4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:11.329535 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.329473    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3bcc33effb8bb32f83119c817ee77244-config\") pod \"kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal\" (UID: \"3bcc33effb8bb32f83119c817ee77244\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:11.329535 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.329513    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3bcc33effb8bb32f83119c817ee77244-config\") pod \"kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal\" (UID: \"3bcc33effb8bb32f83119c817ee77244\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:11.329656 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.329534    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48ed979d025ac3d838a4955411937a4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal\" (UID: \"48ed979d025ac3d838a4955411937a4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:11.329656 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:11.329552    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48ed979d025ac3d838a4955411937a4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal\" (UID: \"48ed979d025ac3d838a4955411937a4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:12.000916 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.000885    5076 apiserver.go:52] "Watching apiserver"
Nov 02 21:58:12.040442 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.040409    5076 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 02 21:58:12.041011 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.040984    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rjf77","openshift-image-registry/node-ca-q9zww","openshift-insights/insights-runtime-extractor-ff49f","openshift-insights/periodic-gathering-k9qbf-96c98","openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j","kube-system/konnectivity-agent-fssjr","openshift-ingress-canary/ingress-canary-gkz57","openshift-network-operator/iptables-alerter-2njd6","openshift-cluster-node-tuning-operator/tuned-qg8mq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw","openshift-network-diagnostics/network-check-target-s4zr8","kube-system/global-pull-secret-syncer-g8bvh","openshift-kube-storage-version-migrator/migrator-66df5d496b-j7ldn","openshift-multus/network-metrics-daemon-qhm2w","openshift-service-ca/service-ca-5fffc97bdf-x2z8k","openshift-dns/node-resolver-kk66k","openshift-ovn-kubernetes/ovnkube-node-gcbjt","openshift-monitoring/node-exporter-ngqs4","kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal","openshift-multus/multus-t24vc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal","openshift-multus/multus-additional-cni-plugins-rnjhr","openshift-image-registry/image-registry-65946b4b6f-qtvpw"]
Nov 02 21:58:12.046147 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.046115    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 02 21:58:12.046286 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.046248    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-n7kkn\""
Nov 02 21:58:12.046534 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.046516    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 02 21:58:12.046622 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.046516    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 02 21:58:12.046622 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.046555    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 02 21:58:12.046622 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.046619    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 02 21:58:12.046767 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.046667    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 02 21:58:12.046816 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.046790    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 02 21:58:12.046816 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.046802    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wtxk8\""
Nov 02 21:58:12.047604 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.047585    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 02 21:58:12.047720 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.047621    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 02 21:58:12.047720 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.047663    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 02 21:58:12.047720 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.047670    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 02 21:58:12.047720 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.047664    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 02 21:58:12.047895 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.047759    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 02 21:58:12.047895 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.047833    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 02 21:58:12.047895 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.047853    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-sd22g\""
Nov 02 21:58:12.048019 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.047909    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7q497\""
Nov 02 21:58:12.048321 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.048304    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vjf48\""
Nov 02 21:58:12.048508 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.048495    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 02 21:58:12.049649 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.049631    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 02 21:58:12.049741 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.049702    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 02 21:58:12.050060 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.050041    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-447sr\""
Nov 02 21:58:12.050060 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.050049    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gf8xp\""
Nov 02 21:58:12.050194 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.050094    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 02 21:58:12.050571 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.050551    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 02 21:58:12.050658 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.050625    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 02 21:58:12.050658 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.050630    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4qcf6\""
Nov 02 21:58:12.050780 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.050677    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 02 21:58:12.050780 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.050738    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 02 21:58:12.051893 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.051874    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-6t4jd\""
Nov 02 21:58:12.051992 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.051977    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 02 21:58:12.052035 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.051993    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 02 21:58:12.052035 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.052024    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 02 21:58:12.052101 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.052065    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 02 21:58:12.052141 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.052105    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dx8bh\""
Nov 02 21:58:12.052204 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.052195    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5tk4z\""
Nov 02 21:58:12.052368 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.052347    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 02 21:58:12.052438 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.052424    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 02 21:58:12.052483 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.052450    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 02 21:58:12.052483 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.052456    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 02 21:58:12.052566 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.052540    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-9dzjg\""
Nov 02 21:58:12.053117 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.053101    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 02 21:58:12.053211 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.053138    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-b8hrl\""
Nov 02 21:58:12.053211 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.053160    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 02 21:58:12.053211 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.053167    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 02 21:58:12.053211 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.053194    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 02 21:58:12.053211 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.053202    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 02 21:58:12.053399 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.053248    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 02 21:58:12.053753 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.053736    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Nov 02 21:58:12.053858 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.053843    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bqhdf\""
Nov 02 21:58:12.053929 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.053916    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rv85s\""
Nov 02 21:58:12.054015 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.053999    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9v8fd\""
Nov 02 21:58:12.054101 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.054089    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 02 21:58:12.054166 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.054151    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 02 21:58:12.054300 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.054286    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 02 21:58:12.056612 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.056597    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 02 21:58:12.056665 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.056650    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Nov 02 21:58:12.056779 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.056767    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j"
Nov 02 21:58:12.057306 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.057285    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Nov 02 21:58:12.057306 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.057288    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Nov 02 21:58:12.057444 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.057428    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Nov 02 21:58:12.057496 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.057451    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Nov 02 21:58:12.057496 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.057481    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-g9f57\""
Nov 02 21:58:12.057598 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.057504    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Nov 02 21:58:12.057598 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.057533    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Nov 02 21:58:12.057675 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.057608    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Nov 02 21:58:12.057787 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.057770    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6vj4v\""
Nov 02 21:58:12.057890 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.057874    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-p696k\""
Nov 02 21:58:12.058792 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.058770    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Nov 02 21:58:12.058874 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.058794    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Nov 02 21:58:12.060703 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.060681    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.061393 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.061370    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Nov 02 21:58:12.061526 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.061506    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ppbmh\""
Nov 02 21:58:12.061602 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.061563    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 02 21:58:12.061676 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.061660    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Nov 02 21:58:12.063129 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.063107    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 02 21:58:12.063274 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.063249    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Nov 02 21:58:12.063274 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.063251    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 02 21:58:12.064043 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.064021    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 02 21:58:12.064123 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.064077    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 02 21:58:12.064395 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.064380    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xgmtc\""
Nov 02 21:58:12.064448 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.064393    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 02 21:58:12.093636 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.093617    5076 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:12.093805 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.093791    5076 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:12.105660 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.105642    5076 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 21:58:12.105752 ip-10-0-142-132 kubenswrapper[5076]: E1102 21:58:12.105687    5076 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:12.105821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.105642    5076 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 21:58:12.105821 ip-10-0-142-132 kubenswrapper[5076]: E1102 21:58:12.105801    5076 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-132.us-east-2.compute.internal"
Nov 02 21:58:12.118344 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.118326    5076 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 02 21:58:12.126581 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.126558    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:12.133473 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.133453    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-run\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.133556 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.133480    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-tuned\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.133556 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.133499    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-conf-dir\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.133556 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.133515    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1c203060-df7f-4287-b699-9fb6666b6c17-env-overrides\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.133556 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.133532    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/61ad6168-e16c-4985-83fa-0e1f83918a70-root\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.133759 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.133575    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24a682dd-9873-4861-a837-3df17b108c00-trusted-ca-bundle\") pod \"periodic-gathering-k9qbf-96c98\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") " pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:58:12.133759 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.133604    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.133759 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.133615    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-tuned\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.133759 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.133622    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0ad960f5-ae8d-43ed-950f-b6f93be7e101-dbus\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:58:12.133759 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.133703    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:58:12.133969 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.133801    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1c203060-df7f-4287-b699-9fb6666b6c17-env-overrides\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.133969 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.133854    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-sys-fs\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:58:12.133969 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.133878    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61ad6168-e16c-4985-83fa-0e1f83918a70-metrics-client-ca\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.133969 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.133947    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nctrd\" (UniqueName: \"kubernetes.io/projected/ee77ac04-78e3-47e8-bfc4-9e2ab5f2bb0f-kube-api-access-nctrd\") pod \"migrator-66df5d496b-j7ldn\" (UID: \"ee77ac04-78e3-47e8-bfc4-9e2ab5f2bb0f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-j7ldn"
Nov 02 21:58:12.134143 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.133996    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2da733e7-c5c3-4170-b3c1-1817068ee620-host\") pod \"node-ca-q9zww\" (UID: \"2da733e7-c5c3-4170-b3c1-1817068ee620\") " pod="openshift-image-registry/node-ca-q9zww"
Nov 02 21:58:12.134143 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134050    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-cnibin\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.134143 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134102    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ad960f5-ae8d-43ed-950f-b6f93be7e101-original-pull-secret\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:58:12.134143 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134106    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-var-lib-cni-bin\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.134306 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134149    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gggb5\" (UniqueName: \"kubernetes.io/projected/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-kube-api-access-gggb5\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.134306 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134178    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-registration-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:58:12.134306 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134209    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2da733e7-c5c3-4170-b3c1-1817068ee620-serviceca\") pod \"node-ca-q9zww\" (UID: \"2da733e7-c5c3-4170-b3c1-1817068ee620\") " pod="openshift-image-registry/node-ca-q9zww"
Nov 02 21:58:12.134306 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134265    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-tmp\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.134465 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134338    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-tmp\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.134465 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134356    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24a682dd-9873-4861-a837-3df17b108c00-trusted-ca-bundle\") pod \"periodic-gathering-k9qbf-96c98\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") " pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:58:12.134465 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134400    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/932238d8-80c1-420e-b437-83525c2df2e8-image-registry-private-configuration\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:58:12.134465 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134432    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79c8e674-3d99-4644-bf32-199d1de151a6-agent-certs\") pod \"konnectivity-agent-fssjr\" (UID: \"79c8e674-3d99-4644-bf32-199d1de151a6\") " pod="kube-system/konnectivity-agent-fssjr"
Nov 02 21:58:12.134465 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134456    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/24a682dd-9873-4861-a837-3df17b108c00-archives-path\") pod \"periodic-gathering-k9qbf-96c98\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") " pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:58:12.134701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134479    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-log-socket\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.134701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134504    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2ba252e-e593-41ec-badb-6c7c98c725a2-data-volume\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:58:12.134701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134535    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:58:12.134701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134538    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/24a682dd-9873-4861-a837-3df17b108c00-archives-path\") pod \"periodic-gathering-k9qbf-96c98\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") " pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:58:12.134701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134576    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-lib-modules\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.134701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134602    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84d08f21-69d0-417b-a9cf-37f80bb4e332-cnibin\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:58:12.134701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134611    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/932238d8-80c1-420e-b437-83525c2df2e8-image-registry-private-configuration\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:58:12.134701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134629    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84d08f21-69d0-417b-a9cf-37f80bb4e332-cni-binary-copy\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:58:12.134701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134652    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2ba252e-e593-41ec-badb-6c7c98c725a2-data-volume\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:58:12.134701 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134673    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79c8e674-3d99-4644-bf32-199d1de151a6-agent-certs\") pod \"konnectivity-agent-fssjr\" (UID: \"79c8e674-3d99-4644-bf32-199d1de151a6\") " pod="kube-system/konnectivity-agent-fssjr"
Nov 02 21:58:12.135104 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134750    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-cni-dir\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.135104 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134773    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38f59469-37aa-4519-bc84-9f2777b31ccf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-sq24j\" (UID: \"38f59469-37aa-4519-bc84-9f2777b31ccf\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j"
Nov 02 21:58:12.135104 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134790    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-sysctl-conf\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.135104 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134815    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84d08f21-69d0-417b-a9cf-37f80bb4e332-cni-binary-copy\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:58:12.135104 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134825    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-var-lib-kubelet\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.135104 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134837    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2da733e7-c5c3-4170-b3c1-1817068ee620-serviceca\") pod \"node-ca-q9zww\" (UID: \"2da733e7-c5c3-4170-b3c1-1817068ee620\") " pod="openshift-image-registry/node-ca-q9zww"
Nov 02 21:58:12.135104 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134852    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-run-systemd\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.135104 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134840    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:58:12.135104 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134878    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/932238d8-80c1-420e-b437-83525c2df2e8-registry-tls\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:58:12.135104 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.134975    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79c8e674-3d99-4644-bf32-199d1de151a6-konnectivity-ca\") pod \"konnectivity-agent-fssjr\" (UID: \"79c8e674-3d99-4644-bf32-199d1de151a6\") " pod="kube-system/konnectivity-agent-fssjr"
Nov 02 21:58:12.135104 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135018    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36caef13-1364-4809-af05-58a3a2042ccc-cert\") pod \"ingress-canary-gkz57\" (UID: \"36caef13-1364-4809-af05-58a3a2042ccc\") " pod="openshift-ingress-canary/ingress-canary-gkz57"
Nov 02 21:58:12.135104 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135035    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/84d08f21-69d0-417b-a9cf-37f80bb4e332-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:58:12.135104 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135048    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/932238d8-80c1-420e-b437-83525c2df2e8-registry-tls\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:58:12.135104 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135056    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs\") pod \"network-metrics-daemon-qhm2w\" (UID: \"0272e533-4834-4d8e-a907-5c341eb20edb\") " pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:58:12.135749 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135163    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24a682dd-9873-4861-a837-3df17b108c00-service-ca-bundle\") pod \"periodic-gathering-k9qbf-96c98\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") " pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:58:12.135749 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135175    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79c8e674-3d99-4644-bf32-199d1de151a6-konnectivity-ca\") pod \"konnectivity-agent-fssjr\" (UID: \"79c8e674-3d99-4644-bf32-199d1de151a6\") " pod="kube-system/konnectivity-agent-fssjr"
Nov 02 21:58:12.135749 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135279    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36caef13-1364-4809-af05-58a3a2042ccc-cert\") pod \"ingress-canary-gkz57\" (UID: \"36caef13-1364-4809-af05-58a3a2042ccc\") " pod="openshift-ingress-canary/ingress-canary-gkz57"
Nov 02 21:58:12.135749 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135334    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1c203060-df7f-4287-b699-9fb6666b6c17-ovnkube-script-lib\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.135749 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135340    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0272e533-4834-4d8e-a907-5c341eb20edb-metrics-certs\") pod \"network-metrics-daemon-qhm2w\" (UID: \"0272e533-4834-4d8e-a907-5c341eb20edb\") " pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:58:12.135749 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135337    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/84d08f21-69d0-417b-a9cf-37f80bb4e332-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:58:12.135749 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135369    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39fb3387-3347-4028-837b-a93354d07835-config-volume\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:58:12.135749 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135394    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38f59469-37aa-4519-bc84-9f2777b31ccf-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-sq24j\" (UID: \"38f59469-37aa-4519-bc84-9f2777b31ccf\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j"
Nov 02 21:58:12.135749 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135532    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1c203060-df7f-4287-b699-9fb6666b6c17-ovnkube-script-lib\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.135749 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135545    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39fb3387-3347-4028-837b-a93354d07835-config-volume\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:58:12.135749 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135524    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-systemd\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.135749 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135577    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-hostroot\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.135749 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135596    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfgw6\" (UniqueName: \"kubernetes.io/projected/8778cf51-2f98-409f-855c-60002cb0504c-kube-api-access-kfgw6\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:58:12.135749 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135633    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm6lb\" (UniqueName: \"kubernetes.io/projected/24a682dd-9873-4861-a837-3df17b108c00-kube-api-access-qm6lb\") pod \"periodic-gathering-k9qbf-96c98\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") " pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:58:12.135749 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135731    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-run-ovn-kubernetes\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.136293 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135801    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24a682dd-9873-4861-a837-3df17b108c00-service-ca-bundle\") pod \"periodic-gathering-k9qbf-96c98\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") " pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:58:12.136293 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135825    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-cni-bin\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.136293 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135861    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c203060-df7f-4287-b699-9fb6666b6c17-ovn-node-metrics-cert\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.136293 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.135891    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0ad960f5-ae8d-43ed-950f-b6f93be7e101-kubelet-config\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:58:12.136293 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136014    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61ad6168-e16c-4985-83fa-0e1f83918a70-sys\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.136293 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136036    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh5cr\" (UniqueName: \"kubernetes.io/projected/02c98483-aa0a-483b-9e76-d578115bae14-kube-api-access-hh5cr\") pod \"iptables-alerter-2njd6\" (UID: \"02c98483-aa0a-483b-9e76-d578115bae14\") " pod="openshift-network-operator/iptables-alerter-2njd6"
Nov 02 21:58:12.136293 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136053    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/84d08f21-69d0-417b-a9cf-37f80bb4e332-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:58:12.136293 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136056    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c203060-df7f-4287-b699-9fb6666b6c17-ovn-node-metrics-cert\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.136293 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136069    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-run-k8s-cni-cncf-io\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.136293 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136104    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-system-cni-dir\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.136293 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136128    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-etc-selinux\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:58:12.136293 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136143    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/61ad6168-e16c-4985-83fa-0e1f83918a70-node-exporter-textfile\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.136293 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136188    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6vwb\" (UniqueName: \"kubernetes.io/projected/2da733e7-c5c3-4170-b3c1-1817068ee620-kube-api-access-c6vwb\") pod \"node-ca-q9zww\" (UID: \"2da733e7-c5c3-4170-b3c1-1817068ee620\") " pod="openshift-image-registry/node-ca-q9zww"
Nov 02 21:58:12.136293 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136242    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crdwd\" (UniqueName: \"kubernetes.io/projected/932238d8-80c1-420e-b437-83525c2df2e8-kube-api-access-crdwd\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:58:12.136293 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136282    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/84d08f21-69d0-417b-a9cf-37f80bb4e332-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136366    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7f9j\" (UniqueName: \"kubernetes.io/projected/1c203060-df7f-4287-b699-9fb6666b6c17-kube-api-access-s7f9j\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136429    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136549    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38f59469-37aa-4519-bc84-9f2777b31ccf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-sq24j\" (UID: \"38f59469-37aa-4519-bc84-9f2777b31ccf\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136575    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/61ad6168-e16c-4985-83fa-0e1f83918a70-node-exporter-tls\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136612    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-host\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136661    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-kubernetes\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136684    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-daemon-config\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136699    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-socket-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136716    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-cni-netd\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136732    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39fb3387-3347-4028-837b-a93354d07835-tmp-dir\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136714    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39fb3387-3347-4028-837b-a93354d07835-metrics-tls\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136761    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a7ce469-5b88-4552-bb1f-66a901701d43-hosts-file\") pod \"node-resolver-kk66k\" (UID: \"8a7ce469-5b88-4552-bb1f-66a901701d43\") " pod="openshift-dns/node-resolver-kk66k"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136790    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39fb3387-3347-4028-837b-a93354d07835-tmp-dir\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136813    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/932238d8-80c1-420e-b437-83525c2df2e8-ca-trust-extracted\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136852    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-cni-binary-copy\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136872    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-socket-dir-parent\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136898    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/932238d8-80c1-420e-b437-83525c2df2e8-ca-trust-extracted\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136921    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-daemon-config\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136929    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqzvz\" (UniqueName: \"kubernetes.io/projected/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-kube-api-access-vqzvz\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136962    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84d08f21-69d0-417b-a9cf-37f80bb4e332-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:58:12.136977 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.136984    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx2zc\" (UniqueName: \"kubernetes.io/projected/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-api-access-hx2zc\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137030    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-cni-binary-copy\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137034    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a7ce469-5b88-4552-bb1f-66a901701d43-tmp-dir\") pod \"node-resolver-kk66k\" (UID: \"8a7ce469-5b88-4552-bb1f-66a901701d43\") " pod="openshift-dns/node-resolver-kk66k"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137067    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-run-multus-certs\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137088    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a7ce469-5b88-4552-bb1f-66a901701d43-tmp-dir\") pod \"node-resolver-kk66k\" (UID: \"8a7ce469-5b88-4552-bb1f-66a901701d43\") " pod="openshift-dns/node-resolver-kk66k"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137115    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-etc-kubernetes\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137148    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-run-openvswitch\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137182    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61ad6168-e16c-4985-83fa-0e1f83918a70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137211    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdc99\" (UniqueName: \"kubernetes.io/projected/36caef13-1364-4809-af05-58a3a2042ccc-kube-api-access-kdc99\") pod \"ingress-canary-gkz57\" (UID: \"36caef13-1364-4809-af05-58a3a2042ccc\") " pod="openshift-ingress-canary/ingress-canary-gkz57"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137255    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d776db87-e7da-4eee-8116-19220c6e61c6-signing-cabundle\") pod \"service-ca-5fffc97bdf-x2z8k\" (UID: \"d776db87-e7da-4eee-8116-19220c6e61c6\") " pod="openshift-service-ca/service-ca-5fffc97bdf-x2z8k"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137322    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/932238d8-80c1-420e-b437-83525c2df2e8-registry-certificates\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137429    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02c98483-aa0a-483b-9e76-d578115bae14-host-slash\") pod \"iptables-alerter-2njd6\" (UID: \"02c98483-aa0a-483b-9e76-d578115bae14\") " pod="openshift-network-operator/iptables-alerter-2njd6"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137467    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f42cc\" (UniqueName: \"kubernetes.io/projected/39fb3387-3347-4028-837b-a93354d07835-kube-api-access-f42cc\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137493    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9b9d\" (UniqueName: \"kubernetes.io/projected/8a7ce469-5b88-4552-bb1f-66a901701d43-kube-api-access-k9b9d\") pod \"node-resolver-kk66k\" (UID: \"8a7ce469-5b88-4552-bb1f-66a901701d43\") " pod="openshift-dns/node-resolver-kk66k"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137517    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-sys\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137523    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/932238d8-80c1-420e-b437-83525c2df2e8-registry-certificates\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137537    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d776db87-e7da-4eee-8116-19220c6e61c6-signing-cabundle\") pod \"service-ca-5fffc97bdf-x2z8k\" (UID: \"d776db87-e7da-4eee-8116-19220c6e61c6\") " pod="openshift-service-ca/service-ca-5fffc97bdf-x2z8k"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137541    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-run-netns\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137581    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-var-lib-cni-multus\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137618    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-slash\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137643    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-modprobe-d\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137689    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-sysctl-d\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137711    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-run-netns\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137749    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jm8n\" (UniqueName: \"kubernetes.io/projected/38f59469-37aa-4519-bc84-9f2777b31ccf-kube-api-access-8jm8n\") pod \"openshift-state-metrics-7bd7489957-sq24j\" (UID: \"38f59469-37aa-4519-bc84-9f2777b31ccf\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137777    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/61ad6168-e16c-4985-83fa-0e1f83918a70-node-exporter-accelerators-collector-config\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.137821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137815    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-sysconfig\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137839    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-kubelet\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137876    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-var-lib-openvswitch\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137903    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-run-ovn\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137924    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m55vd\" (UniqueName: \"kubernetes.io/projected/84d08f21-69d0-417b-a9cf-37f80bb4e332-kube-api-access-m55vd\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.137988    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d776db87-e7da-4eee-8116-19220c6e61c6-signing-key\") pod \"service-ca-5fffc97bdf-x2z8k\" (UID: \"d776db87-e7da-4eee-8116-19220c6e61c6\") " pod="openshift-service-ca/service-ca-5fffc97bdf-x2z8k"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138016    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-var-lib-kubelet\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138037    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj729\" (UniqueName: \"kubernetes.io/projected/0272e533-4834-4d8e-a907-5c341eb20edb-kube-api-access-qj729\") pod \"network-metrics-daemon-qhm2w\" (UID: \"0272e533-4834-4d8e-a907-5c341eb20edb\") " pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138094    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1c203060-df7f-4287-b699-9fb6666b6c17-ovnkube-config\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138252    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/932238d8-80c1-420e-b437-83525c2df2e8-trusted-ca\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138261    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d776db87-e7da-4eee-8116-19220c6e61c6-signing-key\") pod \"service-ca-5fffc97bdf-x2z8k\" (UID: \"d776db87-e7da-4eee-8116-19220c6e61c6\") " pod="openshift-service-ca/service-ca-5fffc97bdf-x2z8k"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138291    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/932238d8-80c1-420e-b437-83525c2df2e8-installation-pull-secrets\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138316    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1c203060-df7f-4287-b699-9fb6666b6c17-ovnkube-config\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138381    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7lz\" (UniqueName: \"kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz\") pod \"network-check-target-s4zr8\" (UID: \"4debe5f2-cdbd-4b57-9af4-f984df529ff2\") " pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138486    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/932238d8-80c1-420e-b437-83525c2df2e8-installation-pull-secrets\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138507    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/61ad6168-e16c-4985-83fa-0e1f83918a70-node-exporter-wtmp\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138539    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-device-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138561    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-systemd-units\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138607    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/02c98483-aa0a-483b-9e76-d578115bae14-iptables-alerter-script\") pod \"iptables-alerter-2njd6\" (UID: \"02c98483-aa0a-483b-9e76-d578115bae14\") " pod="openshift-network-operator/iptables-alerter-2njd6"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138609    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/932238d8-80c1-420e-b437-83525c2df2e8-trusted-ca\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138627    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138649    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-etc-openvswitch\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138668    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-node-log\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138693    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84d08f21-69d0-417b-a9cf-37f80bb4e332-system-cni-dir\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:58:12.138719 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138722    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w64h\" (UniqueName: \"kubernetes.io/projected/61ad6168-e16c-4985-83fa-0e1f83918a70-kube-api-access-4w64h\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.139510 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138748    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2ba252e-e593-41ec-badb-6c7c98c725a2-crio-socket\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:58:12.139510 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138771    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/02c98483-aa0a-483b-9e76-d578115bae14-iptables-alerter-script\") pod \"iptables-alerter-2njd6\" (UID: \"02c98483-aa0a-483b-9e76-d578115bae14\") " pod="openshift-network-operator/iptables-alerter-2njd6"
Nov 02 21:58:12.139510 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138779    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pcpq\" (UniqueName: \"kubernetes.io/projected/d776db87-e7da-4eee-8116-19220c6e61c6-kube-api-access-8pcpq\") pod \"service-ca-5fffc97bdf-x2z8k\" (UID: \"d776db87-e7da-4eee-8116-19220c6e61c6\") " pod="openshift-service-ca/service-ca-5fffc97bdf-x2z8k"
Nov 02 21:58:12.139510 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138808    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/932238d8-80c1-420e-b437-83525c2df2e8-bound-sa-token\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:58:12.139510 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.138834    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2ba252e-e593-41ec-badb-6c7c98c725a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:58:12.139510 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.139117    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2ba252e-e593-41ec-badb-6c7c98c725a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:58:12.140531 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.140516    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nctrd\" (UniqueName: \"kubernetes.io/projected/ee77ac04-78e3-47e8-bfc4-9e2ab5f2bb0f-kube-api-access-nctrd\") pod \"migrator-66df5d496b-j7ldn\" (UID: \"ee77ac04-78e3-47e8-bfc4-9e2ab5f2bb0f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-j7ldn"
Nov 02 21:58:12.145402 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.145378    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gggb5\" (UniqueName: \"kubernetes.io/projected/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-kube-api-access-gggb5\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.153123 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.152123    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9b9d\" (UniqueName: \"kubernetes.io/projected/8a7ce469-5b88-4552-bb1f-66a901701d43-kube-api-access-k9b9d\") pod \"node-resolver-kk66k\" (UID: \"8a7ce469-5b88-4552-bb1f-66a901701d43\") " pod="openshift-dns/node-resolver-kk66k"
Nov 02 21:58:12.154353 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.154209    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m55vd\" (UniqueName: \"kubernetes.io/projected/84d08f21-69d0-417b-a9cf-37f80bb4e332-kube-api-access-m55vd\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:58:12.154705 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.154682    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj729\" (UniqueName: \"kubernetes.io/projected/0272e533-4834-4d8e-a907-5c341eb20edb-kube-api-access-qj729\") pod \"network-metrics-daemon-qhm2w\" (UID: \"0272e533-4834-4d8e-a907-5c341eb20edb\") " pod="openshift-multus/network-metrics-daemon-qhm2w"
Nov 02 21:58:12.154705 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.154692    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqzvz\" (UniqueName: \"kubernetes.io/projected/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-kube-api-access-vqzvz\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.155061 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.155039    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm6lb\" (UniqueName: \"kubernetes.io/projected/24a682dd-9873-4861-a837-3df17b108c00-kube-api-access-qm6lb\") pod \"periodic-gathering-k9qbf-96c98\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") " pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:58:12.155160 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.155102    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh5cr\" (UniqueName: \"kubernetes.io/projected/02c98483-aa0a-483b-9e76-d578115bae14-kube-api-access-hh5cr\") pod \"iptables-alerter-2njd6\" (UID: \"02c98483-aa0a-483b-9e76-d578115bae14\") " pod="openshift-network-operator/iptables-alerter-2njd6"
Nov 02 21:58:12.155506 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.155485    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pcpq\" (UniqueName: \"kubernetes.io/projected/d776db87-e7da-4eee-8116-19220c6e61c6-kube-api-access-8pcpq\") pod \"service-ca-5fffc97bdf-x2z8k\" (UID: \"d776db87-e7da-4eee-8116-19220c6e61c6\") " pod="openshift-service-ca/service-ca-5fffc97bdf-x2z8k"
Nov 02 21:58:12.155593 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.155549    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx2zc\" (UniqueName: \"kubernetes.io/projected/e2ba252e-e593-41ec-badb-6c7c98c725a2-kube-api-access-hx2zc\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:58:12.155809 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.155789    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfgw6\" (UniqueName: \"kubernetes.io/projected/8778cf51-2f98-409f-855c-60002cb0504c-kube-api-access-kfgw6\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:58:12.155924 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.155898    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdc99\" (UniqueName: \"kubernetes.io/projected/36caef13-1364-4809-af05-58a3a2042ccc-kube-api-access-kdc99\") pod \"ingress-canary-gkz57\" (UID: \"36caef13-1364-4809-af05-58a3a2042ccc\") " pod="openshift-ingress-canary/ingress-canary-gkz57"
Nov 02 21:58:12.156694 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.156668    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6vwb\" (UniqueName: \"kubernetes.io/projected/2da733e7-c5c3-4170-b3c1-1817068ee620-kube-api-access-c6vwb\") pod \"node-ca-q9zww\" (UID: \"2da733e7-c5c3-4170-b3c1-1817068ee620\") " pod="openshift-image-registry/node-ca-q9zww"
Nov 02 21:58:12.156803 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.156674    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/932238d8-80c1-420e-b437-83525c2df2e8-bound-sa-token\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:58:12.156803 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.156720    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crdwd\" (UniqueName: \"kubernetes.io/projected/932238d8-80c1-420e-b437-83525c2df2e8-kube-api-access-crdwd\") pod \"image-registry-65946b4b6f-qtvpw\" (UID: \"932238d8-80c1-420e-b437-83525c2df2e8\") " pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:58:12.157149 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.157125    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f42cc\" (UniqueName: \"kubernetes.io/projected/39fb3387-3347-4028-837b-a93354d07835-kube-api-access-f42cc\") pod \"dns-default-rjf77\" (UID: \"39fb3387-3347-4028-837b-a93354d07835\") " pod="openshift-dns/dns-default-rjf77"
Nov 02 21:58:12.157241 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.157199    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7f9j\" (UniqueName: \"kubernetes.io/projected/1c203060-df7f-4287-b699-9fb6666b6c17-kube-api-access-s7f9j\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.157920 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.157897    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl7lz\" (UniqueName: \"kubernetes.io/projected/4debe5f2-cdbd-4b57-9af4-f984df529ff2-kube-api-access-jl7lz\") pod \"network-check-target-s4zr8\" (UID: \"4debe5f2-cdbd-4b57-9af4-f984df529ff2\") " pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:58:12.214345 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.214312    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:12.239371 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239340    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-run-netns\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.239371 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239370    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-var-lib-cni-multus\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.239544 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239386    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-slash\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.239544 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239402    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-modprobe-d\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.239544 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239416    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-sysctl-d\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.239544 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239431    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-run-netns\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.239544 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239431    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-run-netns\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.239544 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239446    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jm8n\" (UniqueName: \"kubernetes.io/projected/38f59469-37aa-4519-bc84-9f2777b31ccf-kube-api-access-8jm8n\") pod \"openshift-state-metrics-7bd7489957-sq24j\" (UID: \"38f59469-37aa-4519-bc84-9f2777b31ccf\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j"
Nov 02 21:58:12.239544 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239466    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/61ad6168-e16c-4985-83fa-0e1f83918a70-node-exporter-accelerators-collector-config\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.239544 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239489    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-sysconfig\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.239544 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239495    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-run-netns\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.239544 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239508    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-kubelet\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.239544 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239515    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-var-lib-cni-multus\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.239544 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239530    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-var-lib-openvswitch\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239549    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-modprobe-d\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239554    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-run-ovn\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239569    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-slash\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239584    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-sysctl-d\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239602    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-kubelet\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239607    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-var-lib-kubelet\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239635    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-sysconfig\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239641    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-run-ovn\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239664    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-var-lib-kubelet\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239670    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-var-lib-openvswitch\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239706    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/61ad6168-e16c-4985-83fa-0e1f83918a70-node-exporter-wtmp\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239740    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-device-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239761    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-systemd-units\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239794    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239810    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/61ad6168-e16c-4985-83fa-0e1f83918a70-node-exporter-wtmp\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239818    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-etc-openvswitch\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239840    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-node-log\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239847    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-device-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239863    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84d08f21-69d0-417b-a9cf-37f80bb4e332-system-cni-dir\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239886    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239903    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w64h\" (UniqueName: \"kubernetes.io/projected/61ad6168-e16c-4985-83fa-0e1f83918a70-kube-api-access-4w64h\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239925    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84d08f21-69d0-417b-a9cf-37f80bb4e332-system-cni-dir\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239849    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-systemd-units\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239935    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-node-log\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239927    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2ba252e-e593-41ec-badb-6c7c98c725a2-crio-socket\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239973    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2ba252e-e593-41ec-badb-6c7c98c725a2-crio-socket\") pod \"insights-runtime-extractor-ff49f\" (UID: \"e2ba252e-e593-41ec-badb-6c7c98c725a2\") " pod="openshift-insights/insights-runtime-extractor-ff49f"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239975    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-run\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240006    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-conf-dir\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240012    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-run\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240039    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/61ad6168-e16c-4985-83fa-0e1f83918a70-root\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240041    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-conf-dir\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.239903    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-etc-openvswitch\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240069    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240070    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/61ad6168-e16c-4985-83fa-0e1f83918a70-node-exporter-accelerators-collector-config\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.240107 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240091    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/61ad6168-e16c-4985-83fa-0e1f83918a70-root\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240120    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0ad960f5-ae8d-43ed-950f-b6f93be7e101-dbus\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240185    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0ad960f5-ae8d-43ed-950f-b6f93be7e101-dbus\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240189    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240240    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-sys-fs\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240290    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-sys-fs\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240312    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61ad6168-e16c-4985-83fa-0e1f83918a70-metrics-client-ca\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240339    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2da733e7-c5c3-4170-b3c1-1817068ee620-host\") pod \"node-ca-q9zww\" (UID: \"2da733e7-c5c3-4170-b3c1-1817068ee620\") " pod="openshift-image-registry/node-ca-q9zww"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240370    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-cnibin\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240391    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-var-lib-cni-bin\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240408    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2da733e7-c5c3-4170-b3c1-1817068ee620-host\") pod \"node-ca-q9zww\" (UID: \"2da733e7-c5c3-4170-b3c1-1817068ee620\") " pod="openshift-image-registry/node-ca-q9zww"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240425    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-cnibin\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240415    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-registration-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240459    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-var-lib-cni-bin\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240470    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-log-socket\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240494    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-lib-modules\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240511    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-registration-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240513    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84d08f21-69d0-417b-a9cf-37f80bb4e332-cnibin\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240544    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-cni-dir\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240553    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84d08f21-69d0-417b-a9cf-37f80bb4e332-cnibin\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240547    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-log-socket\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240575    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38f59469-37aa-4519-bc84-9f2777b31ccf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-sq24j\" (UID: \"38f59469-37aa-4519-bc84-9f2777b31ccf\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240615    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-cni-dir\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240615    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-lib-modules\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240614    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-sysctl-conf\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240659    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-var-lib-kubelet\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240683    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-run-systemd\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240714    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38f59469-37aa-4519-bc84-9f2777b31ccf-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-sq24j\" (UID: \"38f59469-37aa-4519-bc84-9f2777b31ccf\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240721    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-sysctl-conf\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240749    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-systemd\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240760    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-run-systemd\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240724    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-var-lib-kubelet\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240777    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-hostroot\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240807    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-run-ovn-kubernetes\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240807    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-hostroot\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240850    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-run-ovn-kubernetes\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240857    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-systemd\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240874    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-cni-bin\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240874    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61ad6168-e16c-4985-83fa-0e1f83918a70-metrics-client-ca\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240894    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0ad960f5-ae8d-43ed-950f-b6f93be7e101-kubelet-config\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240910    5076 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240949    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61ad6168-e16c-4985-83fa-0e1f83918a70-sys\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240919    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-cni-bin\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240955    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0ad960f5-ae8d-43ed-950f-b6f93be7e101-kubelet-config\") pod \"global-pull-secret-syncer-g8bvh\" (UID: \"0ad960f5-ae8d-43ed-950f-b6f93be7e101\") " pod="kube-system/global-pull-secret-syncer-g8bvh"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.240911    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61ad6168-e16c-4985-83fa-0e1f83918a70-sys\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241022    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-run-k8s-cni-cncf-io\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241043    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-system-cni-dir\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241059    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-etc-selinux\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241065    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-run-k8s-cni-cncf-io\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241076    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/61ad6168-e16c-4985-83fa-0e1f83918a70-node-exporter-textfile\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241100    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38f59469-37aa-4519-bc84-9f2777b31ccf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-sq24j\" (UID: \"38f59469-37aa-4519-bc84-9f2777b31ccf\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241120    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/61ad6168-e16c-4985-83fa-0e1f83918a70-node-exporter-tls\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241143    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-host\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241163    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-system-cni-dir\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241165    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-kubernetes\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241122    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-etc-selinux\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241275    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-host\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241306    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-etc-kubernetes\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241311    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-socket-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241339    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8778cf51-2f98-409f-855c-60002cb0504c-socket-dir\") pod \"aws-ebs-csi-driver-node-wjdrw\" (UID: \"8778cf51-2f98-409f-855c-60002cb0504c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wjdrw"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241356    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-cni-netd\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241382    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a7ce469-5b88-4552-bb1f-66a901701d43-hosts-file\") pod \"node-resolver-kk66k\" (UID: \"8a7ce469-5b88-4552-bb1f-66a901701d43\") " pod="openshift-dns/node-resolver-kk66k"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241408    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-socket-dir-parent\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241436    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84d08f21-69d0-417b-a9cf-37f80bb4e332-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241436    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-host-cni-netd\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241461    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-run-multus-certs\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241484    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-etc-kubernetes\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241501    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-multus-socket-dir-parent\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241506    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-run-openvswitch\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241544    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c203060-df7f-4287-b699-9fb6666b6c17-run-openvswitch\") pod \"ovnkube-node-gcbjt\" (UID: \"1c203060-df7f-4287-b699-9fb6666b6c17\") " pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241548    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61ad6168-e16c-4985-83fa-0e1f83918a70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241582    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02c98483-aa0a-483b-9e76-d578115bae14-host-slash\") pod \"iptables-alerter-2njd6\" (UID: \"02c98483-aa0a-483b-9e76-d578115bae14\") " pod="openshift-network-operator/iptables-alerter-2njd6"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241600    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84d08f21-69d0-417b-a9cf-37f80bb4e332-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rnjhr\" (UID: \"84d08f21-69d0-417b-a9cf-37f80bb4e332\") " pod="openshift-multus/multus-additional-cni-plugins-rnjhr"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241608    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-sys\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241621    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/61ad6168-e16c-4985-83fa-0e1f83918a70-node-exporter-textfile\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241647    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-host-run-multus-certs\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241685    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc-sys\") pod \"tuned-qg8mq\" (UID: \"4bf5775a-f2f1-4a1f-a259-71a4e9e58bcc\") " pod="openshift-cluster-node-tuning-operator/tuned-qg8mq"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241690    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ff33c25-9556-45d7-8f7b-ca8f45a35c86-etc-kubernetes\") pod \"multus-t24vc\" (UID: \"8ff33c25-9556-45d7-8f7b-ca8f45a35c86\") " pod="openshift-multus/multus-t24vc"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241726    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02c98483-aa0a-483b-9e76-d578115bae14-host-slash\") pod \"iptables-alerter-2njd6\" (UID: \"02c98483-aa0a-483b-9e76-d578115bae14\") " pod="openshift-network-operator/iptables-alerter-2njd6"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241734    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a7ce469-5b88-4552-bb1f-66a901701d43-hosts-file\") pod \"node-resolver-kk66k\" (UID: \"8a7ce469-5b88-4552-bb1f-66a901701d43\") " pod="openshift-dns/node-resolver-kk66k"
Nov 02 21:58:12.242289 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.241807    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38f59469-37aa-4519-bc84-9f2777b31ccf-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-sq24j\" (UID: \"38f59469-37aa-4519-bc84-9f2777b31ccf\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j"
Nov 02 21:58:12.245825 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.243505    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38f59469-37aa-4519-bc84-9f2777b31ccf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-sq24j\" (UID: \"38f59469-37aa-4519-bc84-9f2777b31ccf\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j"
Nov 02 21:58:12.245825 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.243641    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61ad6168-e16c-4985-83fa-0e1f83918a70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.245825 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.243861    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/61ad6168-e16c-4985-83fa-0e1f83918a70-node-exporter-tls\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.245825 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.243931    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38f59469-37aa-4519-bc84-9f2777b31ccf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-sq24j\" (UID: \"38f59469-37aa-4519-bc84-9f2777b31ccf\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j"
Nov 02 21:58:12.247250 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.247233    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w64h\" (UniqueName: \"kubernetes.io/projected/61ad6168-e16c-4985-83fa-0e1f83918a70-kube-api-access-4w64h\") pod \"node-exporter-ngqs4\" (UID: \"61ad6168-e16c-4985-83fa-0e1f83918a70\") " pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.247926 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.247906    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jm8n\" (UniqueName: \"kubernetes.io/projected/38f59469-37aa-4519-bc84-9f2777b31ccf-kube-api-access-8jm8n\") pod \"openshift-state-metrics-7bd7489957-sq24j\" (UID: \"38f59469-37aa-4519-bc84-9f2777b31ccf\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j"
Nov 02 21:58:12.376332 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.376169    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j"
Nov 02 21:58:12.383330 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.383310    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ngqs4"
Nov 02 21:58:12.413404 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.413382    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rjf77"
Nov 02 21:58:12.431266 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.431235    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:12.441741 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:12.441708    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61ad6168_e16c_4985_83fa_0e1f83918a70.slice/crio-bfa77f9c27419dd9f225ba33c96b78eb54bcdcfd104f7643adbbf52b82defb70 WatchSource:0}: Error finding container bfa77f9c27419dd9f225ba33c96b78eb54bcdcfd104f7643adbbf52b82defb70: Status 404 returned error can't find the container with id bfa77f9c27419dd9f225ba33c96b78eb54bcdcfd104f7643adbbf52b82defb70
Nov 02 21:58:12.444065 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.444050    5076 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 21:58:12.624622 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.624591    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:12.679897 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.679832    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j"]
Nov 02 21:58:12.682561 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:12.682537    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38f59469_37aa_4519_bc84_9f2777b31ccf.slice/crio-5871ceb805690d6ac3e7f6c2f23e3b4dfa59dc17a4d7986a2f35c864ab6b1c35 WatchSource:0}: Error finding container 5871ceb805690d6ac3e7f6c2f23e3b4dfa59dc17a4d7986a2f35c864ab6b1c35: Status 404 returned error can't find the container with id 5871ceb805690d6ac3e7f6c2f23e3b4dfa59dc17a4d7986a2f35c864ab6b1c35
Nov 02 21:58:12.813268 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.813240    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:12.902490 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:12.902462    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:13.026300 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:13.026198    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:13.098125 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:13.098088    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ngqs4" event={"ID":"61ad6168-e16c-4985-83fa-0e1f83918a70","Type":"ContainerStarted","Data":"bfa77f9c27419dd9f225ba33c96b78eb54bcdcfd104f7643adbbf52b82defb70"}
Nov 02 21:58:13.100363 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:13.100332    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j" event={"ID":"38f59469-37aa-4519-bc84-9f2777b31ccf","Type":"ContainerStarted","Data":"c3d6cf0c7ab916eb8de06db18608f0b2482c3fd34e7f07c90f35031f0c4fd9c6"}
Nov 02 21:58:13.100487 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:13.100393    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j" event={"ID":"38f59469-37aa-4519-bc84-9f2777b31ccf","Type":"ContainerStarted","Data":"d8553aefb7739d9f99d6ee219829cba8f1f45977f62e8e6e1e2a55c682548d82"}
Nov 02 21:58:13.100487 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:13.100422    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j" event={"ID":"38f59469-37aa-4519-bc84-9f2777b31ccf","Type":"ContainerStarted","Data":"5871ceb805690d6ac3e7f6c2f23e3b4dfa59dc17a4d7986a2f35c864ab6b1c35"}
Nov 02 21:58:13.813281 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:13.813257    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:14.106455 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:14.106417    5076 generic.go:356] "Generic (PLEG): container finished" podID="61ad6168-e16c-4985-83fa-0e1f83918a70" containerID="4580165a001443b9277cc8f1da514d1bfbbc77c5b343ea290f37f96f10aba8de" exitCode=0
Nov 02 21:58:14.106455 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:14.106506    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ngqs4" event={"ID":"61ad6168-e16c-4985-83fa-0e1f83918a70","Type":"ContainerDied","Data":"4580165a001443b9277cc8f1da514d1bfbbc77c5b343ea290f37f96f10aba8de"}
Nov 02 21:58:14.106981 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:14.106668    5076 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 02 21:58:14.810801 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:14.810723    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:14.914226 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:14.914188    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:15.010144 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:15.010105    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:15.114835 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:15.114807    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ngqs4" event={"ID":"61ad6168-e16c-4985-83fa-0e1f83918a70","Type":"ContainerStarted","Data":"d171c967aa5ca45bdeb51f66cf1cd0a1774a11a19600f42bd921a731ebe7df5a"}
Nov 02 21:58:15.115337 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:15.114857    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ngqs4" event={"ID":"61ad6168-e16c-4985-83fa-0e1f83918a70","Type":"ContainerStarted","Data":"58e5f3c73870441512bc8629dc9c0f951405b2aad165f1a82dc7608f00cc52ac"}
Nov 02 21:58:15.117066 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:15.117044    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j" event={"ID":"38f59469-37aa-4519-bc84-9f2777b31ccf","Type":"ContainerStarted","Data":"aad9126a00375715634e6aaf2d36f6e8e3a03820cf90d96940a7159acc3ae08a"}
Nov 02 21:58:15.140680 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:15.140634    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ngqs4" podStartSLOduration=2.774138813 podStartE2EDuration="4.140622649s" totalImagesPullingTime="1.299234568s" totalInitContainerRuntime="67.249268ms" isStatefulPod=true podCreationTimestamp="2026-11-02 21:58:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:58:15.13882052 +0000 UTC m=+4.195154900" watchObservedRunningTime="2026-11-02 21:58:15.140622649 +0000 UTC m=+4.196957052"
Nov 02 21:58:15.156852 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:15.156814    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-sq24j" podStartSLOduration=2.634641405 podStartE2EDuration="4.156803756s" totalImagesPullingTime="1.522162351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:58:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:58:15.156371409 +0000 UTC m=+4.212705802" watchObservedRunningTime="2026-11-02 21:58:15.156803756 +0000 UTC m=+4.213138130"
Nov 02 21:58:15.567758 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:15.567689    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:58:16.435449 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:16.435412    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:16.437892 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:16.437873    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65946b4b6f-qtvpw"
Nov 02 21:58:16.535718 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:16.535682    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:16.616269 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:16.616244    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-2x96f"]
Nov 02 21:58:16.619154 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:16.619139    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-2x96f"
Nov 02 21:58:16.620685 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:16.620658    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:16.626659 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:16.626639    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-2x96f"]
Nov 02 21:58:16.677662 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:16.677635    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Nov 02 21:58:16.677753 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:16.677699    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-5rsmf\""
Nov 02 21:58:16.678853 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:16.678821    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg6fk\" (UniqueName: \"kubernetes.io/projected/e9a7b55f-d4a3-48fe-8c1b-640483fd9bc4-kube-api-access-sg6fk\") pod \"monitoring-plugin-77f4f76594-2x96f\" (UID: \"e9a7b55f-d4a3-48fe-8c1b-640483fd9bc4\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-2x96f"
Nov 02 21:58:16.678922 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:16.678876    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9a7b55f-d4a3-48fe-8c1b-640483fd9bc4-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-2x96f\" (UID: \"e9a7b55f-d4a3-48fe-8c1b-640483fd9bc4\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-2x96f"
Nov 02 21:58:16.777261 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:16.777154    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:16.780206 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:16.780179    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg6fk\" (UniqueName: \"kubernetes.io/projected/e9a7b55f-d4a3-48fe-8c1b-640483fd9bc4-kube-api-access-sg6fk\") pod \"monitoring-plugin-77f4f76594-2x96f\" (UID: \"e9a7b55f-d4a3-48fe-8c1b-640483fd9bc4\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-2x96f"
Nov 02 21:58:16.780314 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:16.780250    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9a7b55f-d4a3-48fe-8c1b-640483fd9bc4-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-2x96f\" (UID: \"e9a7b55f-d4a3-48fe-8c1b-640483fd9bc4\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-2x96f"
Nov 02 21:58:16.782663 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:16.782643    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9a7b55f-d4a3-48fe-8c1b-640483fd9bc4-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-2x96f\" (UID: \"e9a7b55f-d4a3-48fe-8c1b-640483fd9bc4\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-2x96f"
Nov 02 21:58:16.788576 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:16.788560    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg6fk\" (UniqueName: \"kubernetes.io/projected/e9a7b55f-d4a3-48fe-8c1b-640483fd9bc4-kube-api-access-sg6fk\") pod \"monitoring-plugin-77f4f76594-2x96f\" (UID: \"e9a7b55f-d4a3-48fe-8c1b-640483fd9bc4\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-2x96f"
Nov 02 21:58:16.875639 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:16.875602    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:16.933690 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:16.933656    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-2x96f"
Nov 02 21:58:17.201788 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:17.201721    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-2x96f"]
Nov 02 21:58:17.205700 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:17.205674    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a7b55f_d4a3_48fe_8c1b_640483fd9bc4.slice/crio-35e3dc85c203e5c23d7e8c89f7def00a06770f77ddc1e42777dbce355fc915ce WatchSource:0}: Error finding container 35e3dc85c203e5c23d7e8c89f7def00a06770f77ddc1e42777dbce355fc915ce: Status 404 returned error can't find the container with id 35e3dc85c203e5c23d7e8c89f7def00a06770f77ddc1e42777dbce355fc915ce
Nov 02 21:58:18.129383 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:18.129343    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-2x96f" event={"ID":"e9a7b55f-d4a3-48fe-8c1b-640483fd9bc4","Type":"ContainerStarted","Data":"35e3dc85c203e5c23d7e8c89f7def00a06770f77ddc1e42777dbce355fc915ce"}
Nov 02 21:58:18.203689 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:18.203655    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:18.774989 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:18.774939    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gcbjt"
Nov 02 21:58:19.133603 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:19.133571    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-2x96f" event={"ID":"e9a7b55f-d4a3-48fe-8c1b-640483fd9bc4","Type":"ContainerStarted","Data":"5a0c78d37c0324c0bf3a7aaac461482d44fa95e3f3472cf42e80df2c5d95dd36"}
Nov 02 21:58:19.134048 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:19.133750    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-2x96f"
Nov 02 21:58:19.138823 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:19.138803    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-2x96f"
Nov 02 21:58:19.151755 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:19.151718    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-2x96f" podStartSLOduration=1.459148686 podStartE2EDuration="3.151706635s" totalImagesPullingTime="1.692557949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:58:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:58:19.151316313 +0000 UTC m=+8.207650716" watchObservedRunningTime="2026-11-02 21:58:19.151706635 +0000 UTC m=+8.208041015"
Nov 02 21:58:19.554650 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:19.554555    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:19.652636 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:19.652608    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:22.708043 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.708010    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cbd466867-xzw86"]
Nov 02 21:58:22.711009 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.710992    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.715283 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.715252    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Nov 02 21:58:22.715283 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.715261    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Nov 02 21:58:22.715283 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.715274    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Nov 02 21:58:22.715447 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.715306    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Nov 02 21:58:22.716535 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.716468    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Nov 02 21:58:22.716535 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.716476    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Nov 02 21:58:22.716699 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.716573    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-j7lvq\""
Nov 02 21:58:22.716699 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.716623    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Nov 02 21:58:22.720421 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.720402    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Nov 02 21:58:22.721659 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.721640    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbd466867-xzw86"]
Nov 02 21:58:22.823605 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.823579    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-tmp\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.823715 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.823614    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vscts\" (UniqueName: \"kubernetes.io/projected/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-kube-api-access-vscts\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.823715 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.823641    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-service-ca\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.823784 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.823722    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-oauth-serving-cert\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.823784 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.823760    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-trusted-ca-bundle\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.823846 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.823790    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-serving-cert\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.823881 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.823856    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-config\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.823913 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.823891    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-oauth-config\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.924445 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.924386    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-service-ca\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.924445 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.924424    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-oauth-serving-cert\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.924445 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.924445    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-trusted-ca-bundle\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.924634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.924492    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-serving-cert\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.924634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.924521    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-config\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.924634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.924549    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-oauth-config\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.924634 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.924570    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-tmp\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.924821 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.924700    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vscts\" (UniqueName: \"kubernetes.io/projected/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-kube-api-access-vscts\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.924906 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.924884    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-tmp\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.925286 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.925264    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-service-ca\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.925410 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.925326    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-oauth-serving-cert\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.925534 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.925514    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-config\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.925748 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.925726    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-trusted-ca-bundle\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.927032 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.927016    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-oauth-config\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.927090 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.927075    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-serving-cert\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:22.935246 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:22.935212    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vscts\" (UniqueName: \"kubernetes.io/projected/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-kube-api-access-vscts\") pod \"console-5cbd466867-xzw86\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") " pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:23.021563 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:23.021499    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:23.293050 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:23.292979    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbd466867-xzw86"]
Nov 02 21:58:23.296377 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:58:23.296344    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd8cc6ad_8d9a_4228_85c9_e2fbb6b207c5.slice/crio-94329facec6eb3d0497ad1002d7ec50c5a26bed23ae0c00d525ae44885885fba WatchSource:0}: Error finding container 94329facec6eb3d0497ad1002d7ec50c5a26bed23ae0c00d525ae44885885fba: Status 404 returned error can't find the container with id 94329facec6eb3d0497ad1002d7ec50c5a26bed23ae0c00d525ae44885885fba
Nov 02 21:58:24.151045 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:24.151006    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbd466867-xzw86" event={"ID":"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5","Type":"ContainerStarted","Data":"94329facec6eb3d0497ad1002d7ec50c5a26bed23ae0c00d525ae44885885fba"}
Nov 02 21:58:24.933154 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:24.933116    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:25.036632 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:25.034398    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:25.137721 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:25.137690    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:26.505176 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:26.505146    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fssjr"
Nov 02 21:58:29.889845 ip-10-0-142-132 kubenswrapper[5076]: E1102 21:58:29.889797    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 21:58:30.171898 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:30.171870    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbd466867-xzw86" event={"ID":"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5","Type":"ContainerStarted","Data":"c1e9bbace00b277ff470cd5b4f6aa1c84df5fbcd122af40845877d44ac313bdb"}
Nov 02 21:58:30.190740 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:30.190695    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5cbd466867-xzw86" podStartSLOduration=1.391512786 podStartE2EDuration="8.190682046s" totalImagesPullingTime="6.79916926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:58:30.190148128 +0000 UTC m=+19.246482509" watchObservedRunningTime="2026-11-02 21:58:30.190682046 +0000 UTC m=+19.247016426"
Nov 02 21:58:31.158924 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:31.158890    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:31.251683 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:31.251643    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:32.903521 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:32.903489    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:33.005182 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:33.005141    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:33.022442 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:33.022417    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:33.022575 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:33.022512    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:33.026979 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:33.026961    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:33.184769 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:33.184707    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:58:34.323039 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:34.323007    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:34.423486 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:34.423452    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:44.869558 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:44.869519    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:44.945980 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:44.945946    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:45.570534 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:45.570503    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s4zr8"
Nov 02 21:58:54.415365 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:54.415322    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:59.863245 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:59.863194    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:58:59.887188 ip-10-0-142-132 kubenswrapper[5076]: E1102 21:58:59.887157    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 21:58:59.932372 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:58:59.932344    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:59:01.077321 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:01.077282    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:59:01.147869 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:01.147835    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:59:06.287729 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:06.287692    5076 generic.go:356] "Generic (PLEG): container finished" podID="24a682dd-9873-4861-a837-3df17b108c00" containerID="bea4d587d47a65c50b26d141637840e833ec557eb16c7b97dded5675cb223b53" exitCode=0
Nov 02 21:59:06.288100 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:06.287766    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-k9qbf-96c98" event={"ID":"24a682dd-9873-4861-a837-3df17b108c00","Type":"ContainerDied","Data":"bea4d587d47a65c50b26d141637840e833ec557eb16c7b97dded5675cb223b53"}
Nov 02 21:59:07.419710 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:07.419686    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:59:07.439489 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:07.439466    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/24a682dd-9873-4861-a837-3df17b108c00-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24a682dd-9873-4861-a837-3df17b108c00-trusted-ca-bundle\") pod \"24a682dd-9873-4861-a837-3df17b108c00\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") "
Nov 02 21:59:07.439605 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:07.439497    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/24a682dd-9873-4861-a837-3df17b108c00-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/24a682dd-9873-4861-a837-3df17b108c00-archives-path\") pod \"24a682dd-9873-4861-a837-3df17b108c00\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") "
Nov 02 21:59:07.439605 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:07.439526    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/24a682dd-9873-4861-a837-3df17b108c00-kube-api-access-qm6lb\" (UniqueName: \"kubernetes.io/projected/24a682dd-9873-4861-a837-3df17b108c00-kube-api-access-qm6lb\") pod \"24a682dd-9873-4861-a837-3df17b108c00\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") "
Nov 02 21:59:07.439605 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:07.439544    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/24a682dd-9873-4861-a837-3df17b108c00-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24a682dd-9873-4861-a837-3df17b108c00-service-ca-bundle\") pod \"24a682dd-9873-4861-a837-3df17b108c00\" (UID: \"24a682dd-9873-4861-a837-3df17b108c00\") "
Nov 02 21:59:07.439899 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:07.439870    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a682dd-9873-4861-a837-3df17b108c00-archives-path" pod "24a682dd-9873-4861-a837-3df17b108c00" (UID: "24a682dd-9873-4861-a837-3df17b108c00"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 21:59:07.440084 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:07.439913    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24a682dd-9873-4861-a837-3df17b108c00-trusted-ca-bundle" pod "24a682dd-9873-4861-a837-3df17b108c00" (UID: "24a682dd-9873-4861-a837-3df17b108c00"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 21:59:07.440084 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:07.439929    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24a682dd-9873-4861-a837-3df17b108c00-service-ca-bundle" pod "24a682dd-9873-4861-a837-3df17b108c00" (UID: "24a682dd-9873-4861-a837-3df17b108c00"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 21:59:07.441906 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:07.441884    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24a682dd-9873-4861-a837-3df17b108c00-kube-api-access-qm6lb" pod "24a682dd-9873-4861-a837-3df17b108c00" (UID: "24a682dd-9873-4861-a837-3df17b108c00"). InnerVolumeSpecName "kube-api-access-qm6lb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 21:59:07.540618 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:07.540585    5076 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24a682dd-9873-4861-a837-3df17b108c00-trusted-ca-bundle\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 21:59:07.540618 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:07.540615    5076 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/24a682dd-9873-4861-a837-3df17b108c00-archives-path\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 21:59:07.540618 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:07.540625    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm6lb\" (UniqueName: \"kubernetes.io/projected/24a682dd-9873-4861-a837-3df17b108c00-kube-api-access-qm6lb\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 21:59:07.540829 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:07.540636    5076 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24a682dd-9873-4861-a837-3df17b108c00-service-ca-bundle\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 21:59:08.295993 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:08.295950    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-k9qbf-96c98" event={"ID":"24a682dd-9873-4861-a837-3df17b108c00","Type":"ContainerDied","Data":"5548146444ddb24a0fff976de1a1d31118a465d60e0be93b3605fa6f7ebc14a3"}
Nov 02 21:59:08.295993 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:08.295984    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-k9qbf-96c98"
Nov 02 21:59:08.296192 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:08.296010    5076 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5548146444ddb24a0fff976de1a1d31118a465d60e0be93b3605fa6f7ebc14a3"
Nov 02 21:59:08.602071 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:08.602043    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:59:08.702601 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:08.702551    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:59:09.756535 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.756500    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cd8db754d-bl495"]
Nov 02 21:59:09.756956 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.756734    5076 cpu_manager.go:414] "containerMap: removing container" podUID="24a682dd-9873-4861-a837-3df17b108c00" containerName="insights-gathering"
Nov 02 21:59:09.756956 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.756743    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="24a682dd-9873-4861-a837-3df17b108c00" containerName="insights-gathering"
Nov 02 21:59:09.756956 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.756805    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="24a682dd-9873-4861-a837-3df17b108c00" containerName="insights-gathering"
Nov 02 21:59:09.758898 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.758882    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.771678 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.771655    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cd8db754d-bl495"]
Nov 02 21:59:09.825325 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.825286    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:59:09.856959 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.856928    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-config\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.857083 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.856974    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-service-ca\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.857083 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.856993    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-oauth-config\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.857083 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.857053    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efa8f650-1c8e-4f91-a2ff-4faf86272116-tmp\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.857240 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.857133    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-serving-cert\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.857240 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.857157    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-trusted-ca-bundle\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.857240 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.857186    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-oauth-serving-cert\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.857331 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.857287    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwhvf\" (UniqueName: \"kubernetes.io/projected/efa8f650-1c8e-4f91-a2ff-4faf86272116-kube-api-access-kwhvf\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.925667 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.925627    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:59:09.958270 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.958248    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-service-ca\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.958377 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.958276    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-oauth-config\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.958377 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.958295    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efa8f650-1c8e-4f91-a2ff-4faf86272116-tmp\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.958377 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.958317    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-serving-cert\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.958377 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.958362    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-trusted-ca-bundle\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.958578 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.958387    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-oauth-serving-cert\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.958578 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.958420    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwhvf\" (UniqueName: \"kubernetes.io/projected/efa8f650-1c8e-4f91-a2ff-4faf86272116-kube-api-access-kwhvf\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.958578 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.958475    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-config\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.958878 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.958842    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efa8f650-1c8e-4f91-a2ff-4faf86272116-tmp\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.959096 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.959074    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-service-ca\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.959169 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.959137    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-oauth-serving-cert\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.959279 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.959261    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-config\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.959337 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.959321    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-trusted-ca-bundle\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.960860 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.960839    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-serving-cert\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.960972 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.960953    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-oauth-config\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:09.966665 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:09.966642    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwhvf\" (UniqueName: \"kubernetes.io/projected/efa8f650-1c8e-4f91-a2ff-4faf86272116-kube-api-access-kwhvf\") pod \"console-6cd8db754d-bl495\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") " pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:10.068783 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:10.068719    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:10.337762 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:10.337683    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cd8db754d-bl495"]
Nov 02 21:59:10.340645 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:59:10.340617    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefa8f650_1c8e_4f91_a2ff_4faf86272116.slice/crio-54d0b1f1624e5df3eecc23c8264773c0aefd152845954b2ce0c43fe990d1e31d WatchSource:0}: Error finding container 54d0b1f1624e5df3eecc23c8264773c0aefd152845954b2ce0c43fe990d1e31d: Status 404 returned error can't find the container with id 54d0b1f1624e5df3eecc23c8264773c0aefd152845954b2ce0c43fe990d1e31d
Nov 02 21:59:10.426856 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:10.426829    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:59:11.307536 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:11.307500    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cd8db754d-bl495" event={"ID":"efa8f650-1c8e-4f91-a2ff-4faf86272116","Type":"ContainerStarted","Data":"5e8bbcf8fab202a87489112ff6270e12000b8627f3bd2dfc8fb60617423a9f1b"}
Nov 02 21:59:11.307902 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:11.307574    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cd8db754d-bl495" event={"ID":"efa8f650-1c8e-4f91-a2ff-4faf86272116","Type":"ContainerStarted","Data":"54d0b1f1624e5df3eecc23c8264773c0aefd152845954b2ce0c43fe990d1e31d"}
Nov 02 21:59:11.324921 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:11.324877    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6cd8db754d-bl495" podStartSLOduration=2.324864889 podStartE2EDuration="2.324864889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:59:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:59:11.323953687 +0000 UTC m=+60.380288068" watchObservedRunningTime="2026-11-02 21:59:11.324864889 +0000 UTC m=+60.381199269"
Nov 02 21:59:17.624599 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:17.624558    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-7kp2p-ldjgk"]
Nov 02 21:59:17.628926 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:17.628908    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-7kp2p-ldjgk"
Nov 02 21:59:17.635825 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:17.635758    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rv85s\""
Nov 02 21:59:17.636031 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:17.636008    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Nov 02 21:59:17.636177 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:17.636157    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-7kp2p-ldjgk"]
Nov 02 21:59:17.639777 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:17.639758    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Nov 02 21:59:17.712538 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:17.712504    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfqgq\" (UniqueName: \"kubernetes.io/projected/c9754249-c79c-47f2-ab95-b4ef4ae80032-kube-api-access-xfqgq\") pod \"periodic-gathering-7kp2p-ldjgk\" (UID: \"c9754249-c79c-47f2-ab95-b4ef4ae80032\") " pod="openshift-insights/periodic-gathering-7kp2p-ldjgk"
Nov 02 21:59:17.712538 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:17.712544    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9754249-c79c-47f2-ab95-b4ef4ae80032-trusted-ca-bundle\") pod \"periodic-gathering-7kp2p-ldjgk\" (UID: \"c9754249-c79c-47f2-ab95-b4ef4ae80032\") " pod="openshift-insights/periodic-gathering-7kp2p-ldjgk"
Nov 02 21:59:17.712774 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:17.712574    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9754249-c79c-47f2-ab95-b4ef4ae80032-service-ca-bundle\") pod \"periodic-gathering-7kp2p-ldjgk\" (UID: \"c9754249-c79c-47f2-ab95-b4ef4ae80032\") " pod="openshift-insights/periodic-gathering-7kp2p-ldjgk"
Nov 02 21:59:17.712774 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:17.712686    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/c9754249-c79c-47f2-ab95-b4ef4ae80032-archives-path\") pod \"periodic-gathering-7kp2p-ldjgk\" (UID: \"c9754249-c79c-47f2-ab95-b4ef4ae80032\") " pod="openshift-insights/periodic-gathering-7kp2p-ldjgk"
Nov 02 21:59:17.813873 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:17.813835    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfqgq\" (UniqueName: \"kubernetes.io/projected/c9754249-c79c-47f2-ab95-b4ef4ae80032-kube-api-access-xfqgq\") pod \"periodic-gathering-7kp2p-ldjgk\" (UID: \"c9754249-c79c-47f2-ab95-b4ef4ae80032\") " pod="openshift-insights/periodic-gathering-7kp2p-ldjgk"
Nov 02 21:59:17.814027 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:17.813885    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9754249-c79c-47f2-ab95-b4ef4ae80032-trusted-ca-bundle\") pod \"periodic-gathering-7kp2p-ldjgk\" (UID: \"c9754249-c79c-47f2-ab95-b4ef4ae80032\") " pod="openshift-insights/periodic-gathering-7kp2p-ldjgk"
Nov 02 21:59:17.814027 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:17.813922    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9754249-c79c-47f2-ab95-b4ef4ae80032-service-ca-bundle\") pod \"periodic-gathering-7kp2p-ldjgk\" (UID: \"c9754249-c79c-47f2-ab95-b4ef4ae80032\") " pod="openshift-insights/periodic-gathering-7kp2p-ldjgk"
Nov 02 21:59:17.814027 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:17.813955    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/c9754249-c79c-47f2-ab95-b4ef4ae80032-archives-path\") pod \"periodic-gathering-7kp2p-ldjgk\" (UID: \"c9754249-c79c-47f2-ab95-b4ef4ae80032\") " pod="openshift-insights/periodic-gathering-7kp2p-ldjgk"
Nov 02 21:59:17.814403 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:17.814383    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/c9754249-c79c-47f2-ab95-b4ef4ae80032-archives-path\") pod \"periodic-gathering-7kp2p-ldjgk\" (UID: \"c9754249-c79c-47f2-ab95-b4ef4ae80032\") " pod="openshift-insights/periodic-gathering-7kp2p-ldjgk"
Nov 02 21:59:17.814603 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:17.814585    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9754249-c79c-47f2-ab95-b4ef4ae80032-service-ca-bundle\") pod \"periodic-gathering-7kp2p-ldjgk\" (UID: \"c9754249-c79c-47f2-ab95-b4ef4ae80032\") " pod="openshift-insights/periodic-gathering-7kp2p-ldjgk"
Nov 02 21:59:17.814787 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:17.814768    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9754249-c79c-47f2-ab95-b4ef4ae80032-trusted-ca-bundle\") pod \"periodic-gathering-7kp2p-ldjgk\" (UID: \"c9754249-c79c-47f2-ab95-b4ef4ae80032\") " pod="openshift-insights/periodic-gathering-7kp2p-ldjgk"
Nov 02 21:59:17.822399 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:17.822382    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfqgq\" (UniqueName: \"kubernetes.io/projected/c9754249-c79c-47f2-ab95-b4ef4ae80032-kube-api-access-xfqgq\") pod \"periodic-gathering-7kp2p-ldjgk\" (UID: \"c9754249-c79c-47f2-ab95-b4ef4ae80032\") " pod="openshift-insights/periodic-gathering-7kp2p-ldjgk"
Nov 02 21:59:17.940564 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:17.940480    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-7kp2p-ldjgk"
Nov 02 21:59:18.206439 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:18.206363    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-7kp2p-ldjgk"]
Nov 02 21:59:18.209315 ip-10-0-142-132 kubenswrapper[5076]: W1102 21:59:18.209282    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9754249_c79c_47f2_ab95_b4ef4ae80032.slice/crio-a4055823e936489a761cf86519449b1efbb1d826d1ac4349bd887d7d5170d916 WatchSource:0}: Error finding container a4055823e936489a761cf86519449b1efbb1d826d1ac4349bd887d7d5170d916: Status 404 returned error can't find the container with id a4055823e936489a761cf86519449b1efbb1d826d1ac4349bd887d7d5170d916
Nov 02 21:59:18.330776 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:18.330737    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-7kp2p-ldjgk" event={"ID":"c9754249-c79c-47f2-ab95-b4ef4ae80032","Type":"ContainerStarted","Data":"294404f7ff029329a1e1c1b8b80b0479fcf3db59b34dda1ffcd11adcbb08aa3d"}
Nov 02 21:59:18.330933 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:18.330794    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-7kp2p-ldjgk" event={"ID":"c9754249-c79c-47f2-ab95-b4ef4ae80032","Type":"ContainerStarted","Data":"a4055823e936489a761cf86519449b1efbb1d826d1ac4349bd887d7d5170d916"}
Nov 02 21:59:18.346803 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:18.346758    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-7kp2p-ldjgk" podStartSLOduration=1.34674699 podStartE2EDuration="1.34674699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 21:59:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 21:59:18.345694558 +0000 UTC m=+67.402028941" watchObservedRunningTime="2026-11-02 21:59:18.34674699 +0000 UTC m=+67.403081369"
Nov 02 21:59:20.069400 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:20.069372    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:20.069777 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:20.069416    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:20.074830 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:20.074799    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:20.340492 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:20.340422    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 21:59:20.382784 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:20.382749    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cbd466867-xzw86"]
Nov 02 21:59:29.886754 ip-10-0-142-132 kubenswrapper[5076]: E1102 21:59:29.886716    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 21:59:32.947513 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:32.947464    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:59:35.083755 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:35.083705    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 21:59:45.402489 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.402448    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-5cbd466867-xzw86" podUID="fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5" containerName="console" containerID="cri-o://c1e9bbace00b277ff470cd5b4f6aa1c84df5fbcd122af40845877d44ac313bdb" gracePeriod=15
Nov 02 21:59:45.639140 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.639115    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:59:45.710296 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.710213    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-trusted-ca-bundle\") pod \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") "
Nov 02 21:59:45.710296 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.710262    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-kube-api-access-vscts\" (UniqueName: \"kubernetes.io/projected/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-kube-api-access-vscts\") pod \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") "
Nov 02 21:59:45.710491 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.710306    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-serving-cert\") pod \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") "
Nov 02 21:59:45.710491 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.710400    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-tmp\") pod \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") "
Nov 02 21:59:45.710491 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.710464    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-oauth-serving-cert\") pod \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") "
Nov 02 21:59:45.710695 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.710496    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-config\" (UniqueName: \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-config\") pod \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") "
Nov 02 21:59:45.710695 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.710524    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-oauth-config\") pod \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") "
Nov 02 21:59:45.710695 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.710602    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-service-ca\") pod \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\" (UID: \"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5\") "
Nov 02 21:59:45.710695 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.710670    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-tmp" pod "fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5" (UID: "fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 21:59:45.710695 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.710680    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-trusted-ca-bundle" pod "fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5" (UID: "fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 21:59:45.711011 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.710975    5076 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-trusted-ca-bundle\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 21:59:45.711129 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.711016    5076 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-tmp\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 21:59:45.711129 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.710989    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-service-ca" pod "fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5" (UID: "fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 21:59:45.711129 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.711088    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-config" pod "fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5" (UID: "fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 21:59:45.711333 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.711302    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-oauth-serving-cert" pod "fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5" (UID: "fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 21:59:45.712731 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.712705    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-oauth-config" pod "fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5" (UID: "fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 21:59:45.712878 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.712859    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-serving-cert" pod "fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5" (UID: "fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 21:59:45.712925 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.712880    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-kube-api-access-vscts" pod "fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5" (UID: "fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5"). InnerVolumeSpecName "kube-api-access-vscts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 21:59:45.811447 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.811418    5076 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-oauth-serving-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 21:59:45.811447 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.811450    5076 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-config\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 21:59:45.811604 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.811460    5076 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-oauth-config\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 21:59:45.811604 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.811468    5076 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 21:59:45.811604 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.811477    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vscts\" (UniqueName: \"kubernetes.io/projected/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-kube-api-access-vscts\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 21:59:45.811604 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:45.811489    5076 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5-console-serving-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 21:59:46.431117 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:46.431078    5076 generic.go:356] "Generic (PLEG): container finished" podID="fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5" containerID="c1e9bbace00b277ff470cd5b4f6aa1c84df5fbcd122af40845877d44ac313bdb" exitCode=0
Nov 02 21:59:46.431541 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:46.431126    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbd466867-xzw86"
Nov 02 21:59:46.431541 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:46.431174    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbd466867-xzw86" event={"ID":"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5","Type":"ContainerDied","Data":"c1e9bbace00b277ff470cd5b4f6aa1c84df5fbcd122af40845877d44ac313bdb"}
Nov 02 21:59:46.431541 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:46.431247    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbd466867-xzw86" event={"ID":"fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5","Type":"ContainerDied","Data":"94329facec6eb3d0497ad1002d7ec50c5a26bed23ae0c00d525ae44885885fba"}
Nov 02 21:59:46.431541 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:46.431271    5076 scope.go:122] "RemoveContainer" containerID="c1e9bbace00b277ff470cd5b4f6aa1c84df5fbcd122af40845877d44ac313bdb"
Nov 02 21:59:46.439917 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:46.439898    5076 scope.go:122] "RemoveContainer" containerID="c1e9bbace00b277ff470cd5b4f6aa1c84df5fbcd122af40845877d44ac313bdb"
Nov 02 21:59:46.440321 ip-10-0-142-132 kubenswrapper[5076]: E1102 21:59:46.440183    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1e9bbace00b277ff470cd5b4f6aa1c84df5fbcd122af40845877d44ac313bdb\": container with ID starting with c1e9bbace00b277ff470cd5b4f6aa1c84df5fbcd122af40845877d44ac313bdb not found: ID does not exist" containerID="c1e9bbace00b277ff470cd5b4f6aa1c84df5fbcd122af40845877d44ac313bdb"
Nov 02 21:59:46.440404 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:46.440333    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1e9bbace00b277ff470cd5b4f6aa1c84df5fbcd122af40845877d44ac313bdb"} err="failed to get container status \"c1e9bbace00b277ff470cd5b4f6aa1c84df5fbcd122af40845877d44ac313bdb\": rpc error: code = NotFound desc = could not find container \"c1e9bbace00b277ff470cd5b4f6aa1c84df5fbcd122af40845877d44ac313bdb\": container with ID starting with c1e9bbace00b277ff470cd5b4f6aa1c84df5fbcd122af40845877d44ac313bdb not found: ID does not exist"
Nov 02 21:59:46.451767 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:46.451746    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cbd466867-xzw86"]
Nov 02 21:59:46.454782 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:46.454765    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cbd466867-xzw86"]
Nov 02 21:59:47.050831 ip-10-0-142-132 kubenswrapper[5076]: I1102 21:59:47.050796    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5" path="/var/lib/kubelet/pods/fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5/volumes"
Nov 02 21:59:59.886114 ip-10-0-142-132 kubenswrapper[5076]: E1102 21:59:59.886032    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:00:16.283793 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:16.283758    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:00:16.358574 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:16.358537    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:00:24.750911 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.750874    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-559b7f869d-7ggrq"]
Nov 02 22:00:24.751391 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.751246    5076 cpu_manager.go:414] "containerMap: removing container" podUID="fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5" containerName="console"
Nov 02 22:00:24.751391 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.751264    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5" containerName="console"
Nov 02 22:00:24.751391 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.751357    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="fd8cc6ad-8d9a-4228-85c9-e2fbb6b207c5" containerName="console"
Nov 02 22:00:24.753995 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.753975    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.765441 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.765419    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-559b7f869d-7ggrq"]
Nov 02 22:00:24.822165 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.822118    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:00:24.886059 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.886025    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc1e1250-aa56-4106-b9e4-0cea1bc51773-trusted-ca-bundle\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.886204 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.886063    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc1e1250-aa56-4106-b9e4-0cea1bc51773-console-oauth-config\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.886204 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.886090    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc1e1250-aa56-4106-b9e4-0cea1bc51773-service-ca\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.886204 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.886152    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc1e1250-aa56-4106-b9e4-0cea1bc51773-oauth-serving-cert\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.886371 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.886256    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc1e1250-aa56-4106-b9e4-0cea1bc51773-console-serving-cert\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.886371 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.886293    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdjqs\" (UniqueName: \"kubernetes.io/projected/dc1e1250-aa56-4106-b9e4-0cea1bc51773-kube-api-access-pdjqs\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.886476 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.886386    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc1e1250-aa56-4106-b9e4-0cea1bc51773-console-config\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.886476 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.886446    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc1e1250-aa56-4106-b9e4-0cea1bc51773-tmp\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.895572 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.895544    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:00:24.986895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.986866    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc1e1250-aa56-4106-b9e4-0cea1bc51773-oauth-serving-cert\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.987008 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.986905    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc1e1250-aa56-4106-b9e4-0cea1bc51773-console-serving-cert\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.987008 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.986931    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdjqs\" (UniqueName: \"kubernetes.io/projected/dc1e1250-aa56-4106-b9e4-0cea1bc51773-kube-api-access-pdjqs\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.987008 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.986965    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc1e1250-aa56-4106-b9e4-0cea1bc51773-console-config\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.987008 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.986990    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc1e1250-aa56-4106-b9e4-0cea1bc51773-tmp\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.987203 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.987026    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc1e1250-aa56-4106-b9e4-0cea1bc51773-trusted-ca-bundle\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.987203 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.987155    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc1e1250-aa56-4106-b9e4-0cea1bc51773-console-oauth-config\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.987326 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.987206    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc1e1250-aa56-4106-b9e4-0cea1bc51773-service-ca\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.987782 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.987713    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc1e1250-aa56-4106-b9e4-0cea1bc51773-tmp\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.989247 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.988272    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc1e1250-aa56-4106-b9e4-0cea1bc51773-trusted-ca-bundle\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.989247 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.988324    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc1e1250-aa56-4106-b9e4-0cea1bc51773-console-config\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.989247 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.988327    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc1e1250-aa56-4106-b9e4-0cea1bc51773-service-ca\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.989247 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.988670    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc1e1250-aa56-4106-b9e4-0cea1bc51773-oauth-serving-cert\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.992243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.990323    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc1e1250-aa56-4106-b9e4-0cea1bc51773-console-oauth-config\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.993310 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.993290    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc1e1250-aa56-4106-b9e4-0cea1bc51773-console-serving-cert\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:24.995397 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:24.995379    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdjqs\" (UniqueName: \"kubernetes.io/projected/dc1e1250-aa56-4106-b9e4-0cea1bc51773-kube-api-access-pdjqs\") pod \"console-559b7f869d-7ggrq\" (UID: \"dc1e1250-aa56-4106-b9e4-0cea1bc51773\") " pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:25.066245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:25.066194    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:25.336185 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:25.336110    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-559b7f869d-7ggrq"]
Nov 02 22:00:25.339091 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:00:25.339060    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc1e1250_aa56_4106_b9e4_0cea1bc51773.slice/crio-30ad50d010940c3ee7f6ac9ebc33cace8e2ef7ae6043e0c1abbfb28ca5cdeec2 WatchSource:0}: Error finding container 30ad50d010940c3ee7f6ac9ebc33cace8e2ef7ae6043e0c1abbfb28ca5cdeec2: Status 404 returned error can't find the container with id 30ad50d010940c3ee7f6ac9ebc33cace8e2ef7ae6043e0c1abbfb28ca5cdeec2
Nov 02 22:00:25.418373 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:25.418345    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:00:25.489162 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:25.489123    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:00:25.562585 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:25.562551    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559b7f869d-7ggrq" event={"ID":"dc1e1250-aa56-4106-b9e4-0cea1bc51773","Type":"ContainerStarted","Data":"69393e5f58635d9254e4942f04db7b919aa6b4fc305b747c1ab82bda54b63075"}
Nov 02 22:00:25.562739 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:25.562609    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559b7f869d-7ggrq" event={"ID":"dc1e1250-aa56-4106-b9e4-0cea1bc51773","Type":"ContainerStarted","Data":"30ad50d010940c3ee7f6ac9ebc33cace8e2ef7ae6043e0c1abbfb28ca5cdeec2"}
Nov 02 22:00:25.580771 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:25.580731    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-559b7f869d-7ggrq" podStartSLOduration=1.5807195859999998 podStartE2EDuration="1.580719586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:00:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:00:25.579030951 +0000 UTC m=+134.635365322" watchObservedRunningTime="2026-11-02 22:00:25.580719586 +0000 UTC m=+134.637053966"
Nov 02 22:00:28.982260 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:28.982200    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:00:29.053617 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:29.053589    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:00:29.887306 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:00:29.887276    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:00:32.983293 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:32.983250    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:00:35.067300 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:35.067268    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:35.067746 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:35.067535    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:35.072196 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:35.072176    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:35.597939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:35.597910    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-559b7f869d-7ggrq"
Nov 02 22:00:35.642560 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:35.642533    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cd8db754d-bl495"]
Nov 02 22:00:41.617204 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:41.617168    5076 generic.go:356] "Generic (PLEG): container finished" podID="c9754249-c79c-47f2-ab95-b4ef4ae80032" containerID="294404f7ff029329a1e1c1b8b80b0479fcf3db59b34dda1ffcd11adcbb08aa3d" exitCode=0
Nov 02 22:00:41.617590 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:41.617240    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-7kp2p-ldjgk" event={"ID":"c9754249-c79c-47f2-ab95-b4ef4ae80032","Type":"ContainerDied","Data":"294404f7ff029329a1e1c1b8b80b0479fcf3db59b34dda1ffcd11adcbb08aa3d"}
Nov 02 22:00:42.743552 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:42.743528    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-7kp2p-ldjgk"
Nov 02 22:00:42.809992 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:42.809958    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c9754249-c79c-47f2-ab95-b4ef4ae80032-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/c9754249-c79c-47f2-ab95-b4ef4ae80032-archives-path\") pod \"c9754249-c79c-47f2-ab95-b4ef4ae80032\" (UID: \"c9754249-c79c-47f2-ab95-b4ef4ae80032\") "
Nov 02 22:00:42.810120 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:42.810002    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c9754249-c79c-47f2-ab95-b4ef4ae80032-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9754249-c79c-47f2-ab95-b4ef4ae80032-service-ca-bundle\") pod \"c9754249-c79c-47f2-ab95-b4ef4ae80032\" (UID: \"c9754249-c79c-47f2-ab95-b4ef4ae80032\") "
Nov 02 22:00:42.810120 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:42.810041    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c9754249-c79c-47f2-ab95-b4ef4ae80032-kube-api-access-xfqgq\" (UniqueName: \"kubernetes.io/projected/c9754249-c79c-47f2-ab95-b4ef4ae80032-kube-api-access-xfqgq\") pod \"c9754249-c79c-47f2-ab95-b4ef4ae80032\" (UID: \"c9754249-c79c-47f2-ab95-b4ef4ae80032\") "
Nov 02 22:00:42.810120 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:42.810074    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c9754249-c79c-47f2-ab95-b4ef4ae80032-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9754249-c79c-47f2-ab95-b4ef4ae80032-trusted-ca-bundle\") pod \"c9754249-c79c-47f2-ab95-b4ef4ae80032\" (UID: \"c9754249-c79c-47f2-ab95-b4ef4ae80032\") "
Nov 02 22:00:42.810314 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:42.810292    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9754249-c79c-47f2-ab95-b4ef4ae80032-archives-path" pod "c9754249-c79c-47f2-ab95-b4ef4ae80032" (UID: "c9754249-c79c-47f2-ab95-b4ef4ae80032"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:00:42.810446 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:42.810418    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9754249-c79c-47f2-ab95-b4ef4ae80032-service-ca-bundle" pod "c9754249-c79c-47f2-ab95-b4ef4ae80032" (UID: "c9754249-c79c-47f2-ab95-b4ef4ae80032"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:00:42.810543 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:42.810502    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9754249-c79c-47f2-ab95-b4ef4ae80032-trusted-ca-bundle" pod "c9754249-c79c-47f2-ab95-b4ef4ae80032" (UID: "c9754249-c79c-47f2-ab95-b4ef4ae80032"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:00:42.812041 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:42.812020    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9754249-c79c-47f2-ab95-b4ef4ae80032-kube-api-access-xfqgq" pod "c9754249-c79c-47f2-ab95-b4ef4ae80032" (UID: "c9754249-c79c-47f2-ab95-b4ef4ae80032"). InnerVolumeSpecName "kube-api-access-xfqgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:00:42.910868 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:42.910818    5076 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9754249-c79c-47f2-ab95-b4ef4ae80032-trusted-ca-bundle\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:00:42.910868 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:42.910838    5076 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/c9754249-c79c-47f2-ab95-b4ef4ae80032-archives-path\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:00:42.910868 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:42.910847    5076 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9754249-c79c-47f2-ab95-b4ef4ae80032-service-ca-bundle\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:00:42.910868 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:42.910857    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfqgq\" (UniqueName: \"kubernetes.io/projected/c9754249-c79c-47f2-ab95-b4ef4ae80032-kube-api-access-xfqgq\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:00:43.625408 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:43.625369    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-7kp2p-ldjgk" event={"ID":"c9754249-c79c-47f2-ab95-b4ef4ae80032","Type":"ContainerDied","Data":"a4055823e936489a761cf86519449b1efbb1d826d1ac4349bd887d7d5170d916"}
Nov 02 22:00:43.625408 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:43.625404    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-7kp2p-ldjgk"
Nov 02 22:00:43.625607 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:43.625428    5076 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4055823e936489a761cf86519449b1efbb1d826d1ac4349bd887d7d5170d916"
Nov 02 22:00:44.853605 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:44.853566    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:00:44.953869 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:44.953833    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:00:45.053955 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:45.053922    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:00:58.173771 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:00:58.173737    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:00:59.886624 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:00:59.886588    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:01:00.454710 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:00.454656    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:01:00.529938 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:00.529899    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:01:00.661609 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:00.661567    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-6cd8db754d-bl495" podUID="efa8f650-1c8e-4f91-a2ff-4faf86272116" containerName="console" containerID="cri-o://5e8bbcf8fab202a87489112ff6270e12000b8627f3bd2dfc8fb60617423a9f1b" gracePeriod=15
Nov 02 22:01:00.898292 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:00.898269    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 22:01:00.934912 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:00.934877    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-trusted-ca-bundle\") pod \"efa8f650-1c8e-4f91-a2ff-4faf86272116\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") "
Nov 02 22:01:00.935046 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:00.934953    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-serving-cert\") pod \"efa8f650-1c8e-4f91-a2ff-4faf86272116\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") "
Nov 02 22:01:00.935046 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:00.934974    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/efa8f650-1c8e-4f91-a2ff-4faf86272116-kube-api-access-kwhvf\" (UniqueName: \"kubernetes.io/projected/efa8f650-1c8e-4f91-a2ff-4faf86272116-kube-api-access-kwhvf\") pod \"efa8f650-1c8e-4f91-a2ff-4faf86272116\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") "
Nov 02 22:01:00.935046 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:00.934997    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-oauth-serving-cert\") pod \"efa8f650-1c8e-4f91-a2ff-4faf86272116\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") "
Nov 02 22:01:00.935046 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:00.935022    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-oauth-config\") pod \"efa8f650-1c8e-4f91-a2ff-4faf86272116\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") "
Nov 02 22:01:00.935306 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:00.935054    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-service-ca\" (UniqueName: \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-service-ca\") pod \"efa8f650-1c8e-4f91-a2ff-4faf86272116\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") "
Nov 02 22:01:00.935306 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:00.935081    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-config\" (UniqueName: \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-config\") pod \"efa8f650-1c8e-4f91-a2ff-4faf86272116\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") "
Nov 02 22:01:00.935306 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:00.935113    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/efa8f650-1c8e-4f91-a2ff-4faf86272116-tmp\" (UniqueName: \"kubernetes.io/empty-dir/efa8f650-1c8e-4f91-a2ff-4faf86272116-tmp\") pod \"efa8f650-1c8e-4f91-a2ff-4faf86272116\" (UID: \"efa8f650-1c8e-4f91-a2ff-4faf86272116\") "
Nov 02 22:01:00.935459 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:00.935418    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-trusted-ca-bundle" pod "efa8f650-1c8e-4f91-a2ff-4faf86272116" (UID: "efa8f650-1c8e-4f91-a2ff-4faf86272116"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:01:00.935544 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:00.935519    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efa8f650-1c8e-4f91-a2ff-4faf86272116-tmp" pod "efa8f650-1c8e-4f91-a2ff-4faf86272116" (UID: "efa8f650-1c8e-4f91-a2ff-4faf86272116"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:01:00.935623 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:00.935487    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-oauth-serving-cert" pod "efa8f650-1c8e-4f91-a2ff-4faf86272116" (UID: "efa8f650-1c8e-4f91-a2ff-4faf86272116"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:01:00.935677 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:00.935612    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-config" pod "efa8f650-1c8e-4f91-a2ff-4faf86272116" (UID: "efa8f650-1c8e-4f91-a2ff-4faf86272116"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:01:00.935739 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:00.935718    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-service-ca" pod "efa8f650-1c8e-4f91-a2ff-4faf86272116" (UID: "efa8f650-1c8e-4f91-a2ff-4faf86272116"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:01:00.937182 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:00.937161    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efa8f650-1c8e-4f91-a2ff-4faf86272116-kube-api-access-kwhvf" pod "efa8f650-1c8e-4f91-a2ff-4faf86272116" (UID: "efa8f650-1c8e-4f91-a2ff-4faf86272116"). InnerVolumeSpecName "kube-api-access-kwhvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:01:00.937289 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:00.937190    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-oauth-config" pod "efa8f650-1c8e-4f91-a2ff-4faf86272116" (UID: "efa8f650-1c8e-4f91-a2ff-4faf86272116"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:01:00.937289 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:00.937200    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-serving-cert" pod "efa8f650-1c8e-4f91-a2ff-4faf86272116" (UID: "efa8f650-1c8e-4f91-a2ff-4faf86272116"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:01:01.036017 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:01.035947    5076 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-serving-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:01:01.036017 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:01.035983    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwhvf\" (UniqueName: \"kubernetes.io/projected/efa8f650-1c8e-4f91-a2ff-4faf86272116-kube-api-access-kwhvf\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:01:01.036017 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:01.035994    5076 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-oauth-serving-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:01:01.036017 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:01.036003    5076 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-oauth-config\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:01:01.036017 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:01.036011    5076 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:01:01.036017 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:01.036020    5076 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-console-config\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:01:01.036017 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:01.036029    5076 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efa8f650-1c8e-4f91-a2ff-4faf86272116-tmp\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:01:01.036339 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:01.036038    5076 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa8f650-1c8e-4f91-a2ff-4faf86272116-trusted-ca-bundle\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:01:01.685529 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:01.685492    5076 generic.go:356] "Generic (PLEG): container finished" podID="efa8f650-1c8e-4f91-a2ff-4faf86272116" containerID="5e8bbcf8fab202a87489112ff6270e12000b8627f3bd2dfc8fb60617423a9f1b" exitCode=0
Nov 02 22:01:01.685738 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:01.685538    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cd8db754d-bl495" event={"ID":"efa8f650-1c8e-4f91-a2ff-4faf86272116","Type":"ContainerDied","Data":"5e8bbcf8fab202a87489112ff6270e12000b8627f3bd2dfc8fb60617423a9f1b"}
Nov 02 22:01:01.685738 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:01.685559    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cd8db754d-bl495"
Nov 02 22:01:01.685738 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:01.685585    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cd8db754d-bl495" event={"ID":"efa8f650-1c8e-4f91-a2ff-4faf86272116","Type":"ContainerDied","Data":"54d0b1f1624e5df3eecc23c8264773c0aefd152845954b2ce0c43fe990d1e31d"}
Nov 02 22:01:01.685738 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:01.685605    5076 scope.go:122] "RemoveContainer" containerID="5e8bbcf8fab202a87489112ff6270e12000b8627f3bd2dfc8fb60617423a9f1b"
Nov 02 22:01:01.693280 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:01.693259    5076 scope.go:122] "RemoveContainer" containerID="5e8bbcf8fab202a87489112ff6270e12000b8627f3bd2dfc8fb60617423a9f1b"
Nov 02 22:01:01.693561 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:01:01.693539    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e8bbcf8fab202a87489112ff6270e12000b8627f3bd2dfc8fb60617423a9f1b\": container with ID starting with 5e8bbcf8fab202a87489112ff6270e12000b8627f3bd2dfc8fb60617423a9f1b not found: ID does not exist" containerID="5e8bbcf8fab202a87489112ff6270e12000b8627f3bd2dfc8fb60617423a9f1b"
Nov 02 22:01:01.693629 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:01.693572    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e8bbcf8fab202a87489112ff6270e12000b8627f3bd2dfc8fb60617423a9f1b"} err="failed to get container status \"5e8bbcf8fab202a87489112ff6270e12000b8627f3bd2dfc8fb60617423a9f1b\": rpc error: code = NotFound desc = could not find container \"5e8bbcf8fab202a87489112ff6270e12000b8627f3bd2dfc8fb60617423a9f1b\": container with ID starting with 5e8bbcf8fab202a87489112ff6270e12000b8627f3bd2dfc8fb60617423a9f1b not found: ID does not exist"
Nov 02 22:01:01.701972 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:01.701946    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cd8db754d-bl495"]
Nov 02 22:01:01.704656 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:01.704634    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cd8db754d-bl495"]
Nov 02 22:01:03.051369 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:03.051341    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="efa8f650-1c8e-4f91-a2ff-4faf86272116" path="/var/lib/kubelet/pods/efa8f650-1c8e-4f91-a2ff-4faf86272116/volumes"
Nov 02 22:01:17.663375 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:17.663333    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:01:29.886933 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:01:29.886846    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:01:33.035623 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:01:33.035588    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:01:59.886782 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:01:59.886743    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:02:28.006103 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:28.006064    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:02:28.203587 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:28.203550    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:02:28.312400 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:28.312311    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:02:28.907864 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:28.907829    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4"]
Nov 02 22:02:28.908266 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:28.908248    5076 cpu_manager.go:414] "containerMap: removing container" podUID="c9754249-c79c-47f2-ab95-b4ef4ae80032" containerName="insights-gathering"
Nov 02 22:02:28.908334 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:28.908267    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c9754249-c79c-47f2-ab95-b4ef4ae80032" containerName="insights-gathering"
Nov 02 22:02:28.908334 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:28.908284    5076 cpu_manager.go:414] "containerMap: removing container" podUID="efa8f650-1c8e-4f91-a2ff-4faf86272116" containerName="console"
Nov 02 22:02:28.908334 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:28.908289    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="efa8f650-1c8e-4f91-a2ff-4faf86272116" containerName="console"
Nov 02 22:02:28.908450 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:28.908335    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="c9754249-c79c-47f2-ab95-b4ef4ae80032" containerName="insights-gathering"
Nov 02 22:02:28.908450 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:28.908345    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="efa8f650-1c8e-4f91-a2ff-4faf86272116" containerName="console"
Nov 02 22:02:28.911291 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:28.911269    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4"
Nov 02 22:02:28.911964 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:28.911941    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn"]
Nov 02 22:02:28.914927 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:28.914905    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn"
Nov 02 22:02:28.915976 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:28.915947    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-tz9rd\""
Nov 02 22:02:28.919702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:28.919682    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4"]
Nov 02 22:02:28.920144 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:28.920124    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Nov 02 22:02:28.920415 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:28.920396    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Nov 02 22:02:28.926073 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:28.923594    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn"]
Nov 02 22:02:29.018067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.018046    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-c5zrm\""
Nov 02 22:02:29.025222 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.025195    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bed5557-fd36-4224-9178-f26d7734fd2c-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn\" (UID: \"5bed5557-fd36-4224-9178-f26d7734fd2c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn"
Nov 02 22:02:29.025329 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.025242    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4tmr\" (UniqueName: \"kubernetes.io/projected/ca59114b-c02c-44e7-b02a-ec8d89df7fea-kube-api-access-k4tmr\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4\" (UID: \"ca59114b-c02c-44e7-b02a-ec8d89df7fea\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4"
Nov 02 22:02:29.025329 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.025265    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca59114b-c02c-44e7-b02a-ec8d89df7fea-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4\" (UID: \"ca59114b-c02c-44e7-b02a-ec8d89df7fea\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4"
Nov 02 22:02:29.025422 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.025406    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca59114b-c02c-44e7-b02a-ec8d89df7fea-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4\" (UID: \"ca59114b-c02c-44e7-b02a-ec8d89df7fea\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4"
Nov 02 22:02:29.025458 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.025431    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzf78\" (UniqueName: \"kubernetes.io/projected/5bed5557-fd36-4224-9178-f26d7734fd2c-kube-api-access-nzf78\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn\" (UID: \"5bed5557-fd36-4224-9178-f26d7734fd2c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn"
Nov 02 22:02:29.025458 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.025450    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bed5557-fd36-4224-9178-f26d7734fd2c-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn\" (UID: \"5bed5557-fd36-4224-9178-f26d7734fd2c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn"
Nov 02 22:02:29.126526 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.126497    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bed5557-fd36-4224-9178-f26d7734fd2c-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn\" (UID: \"5bed5557-fd36-4224-9178-f26d7734fd2c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn"
Nov 02 22:02:29.126652 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.126554    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4tmr\" (UniqueName: \"kubernetes.io/projected/ca59114b-c02c-44e7-b02a-ec8d89df7fea-kube-api-access-k4tmr\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4\" (UID: \"ca59114b-c02c-44e7-b02a-ec8d89df7fea\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4"
Nov 02 22:02:29.126652 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.126593    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca59114b-c02c-44e7-b02a-ec8d89df7fea-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4\" (UID: \"ca59114b-c02c-44e7-b02a-ec8d89df7fea\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4"
Nov 02 22:02:29.126777 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.126670    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca59114b-c02c-44e7-b02a-ec8d89df7fea-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4\" (UID: \"ca59114b-c02c-44e7-b02a-ec8d89df7fea\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4"
Nov 02 22:02:29.126777 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.126699    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzf78\" (UniqueName: \"kubernetes.io/projected/5bed5557-fd36-4224-9178-f26d7734fd2c-kube-api-access-nzf78\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn\" (UID: \"5bed5557-fd36-4224-9178-f26d7734fd2c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn"
Nov 02 22:02:29.126777 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.126725    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bed5557-fd36-4224-9178-f26d7734fd2c-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn\" (UID: \"5bed5557-fd36-4224-9178-f26d7734fd2c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn"
Nov 02 22:02:29.126964 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.126939    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bed5557-fd36-4224-9178-f26d7734fd2c-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn\" (UID: \"5bed5557-fd36-4224-9178-f26d7734fd2c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn"
Nov 02 22:02:29.126964 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.126958    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca59114b-c02c-44e7-b02a-ec8d89df7fea-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4\" (UID: \"ca59114b-c02c-44e7-b02a-ec8d89df7fea\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4"
Nov 02 22:02:29.127077 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.127014    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca59114b-c02c-44e7-b02a-ec8d89df7fea-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4\" (UID: \"ca59114b-c02c-44e7-b02a-ec8d89df7fea\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4"
Nov 02 22:02:29.127077 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.127052    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bed5557-fd36-4224-9178-f26d7734fd2c-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn\" (UID: \"5bed5557-fd36-4224-9178-f26d7734fd2c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn"
Nov 02 22:02:29.135172 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.135149    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4tmr\" (UniqueName: \"kubernetes.io/projected/ca59114b-c02c-44e7-b02a-ec8d89df7fea-kube-api-access-k4tmr\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4\" (UID: \"ca59114b-c02c-44e7-b02a-ec8d89df7fea\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4"
Nov 02 22:02:29.135297 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.135235    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzf78\" (UniqueName: \"kubernetes.io/projected/5bed5557-fd36-4224-9178-f26d7734fd2c-kube-api-access-nzf78\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn\" (UID: \"5bed5557-fd36-4224-9178-f26d7734fd2c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn"
Nov 02 22:02:29.228628 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.228545    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4"
Nov 02 22:02:29.234652 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.234630    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn"
Nov 02 22:02:29.334247 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.332574    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:02:29.425855 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.425821    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:02:29.507986 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.507922    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4"]
Nov 02 22:02:29.511408 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.511304    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn"]
Nov 02 22:02:29.511597 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:02:29.511572    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca59114b_c02c_44e7_b02a_ec8d89df7fea.slice/crio-f7cbe3584482b3bede40b4f223407fb37908cc4492c2c12490f05b5b8846e6a6 WatchSource:0}: Error finding container f7cbe3584482b3bede40b4f223407fb37908cc4492c2c12490f05b5b8846e6a6: Status 404 returned error can't find the container with id f7cbe3584482b3bede40b4f223407fb37908cc4492c2c12490f05b5b8846e6a6
Nov 02 22:02:29.513689 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:02:29.513661    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bed5557_fd36_4224_9178_f26d7734fd2c.slice/crio-0ed360176a98d9f17c086dbaba553503bae34196c73b2e7a5e006059e5f1fc48 WatchSource:0}: Error finding container 0ed360176a98d9f17c086dbaba553503bae34196c73b2e7a5e006059e5f1fc48: Status 404 returned error can't find the container with id 0ed360176a98d9f17c086dbaba553503bae34196c73b2e7a5e006059e5f1fc48
Nov 02 22:02:29.885927 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:02:29.885888    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:02:29.968442 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.968408    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn" event={"ID":"5bed5557-fd36-4224-9178-f26d7734fd2c","Type":"ContainerStarted","Data":"0ed360176a98d9f17c086dbaba553503bae34196c73b2e7a5e006059e5f1fc48"}
Nov 02 22:02:29.969606 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:29.969575    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4" event={"ID":"ca59114b-c02c-44e7-b02a-ec8d89df7fea","Type":"ContainerStarted","Data":"f7cbe3584482b3bede40b4f223407fb37908cc4492c2c12490f05b5b8846e6a6"}
Nov 02 22:02:30.283449 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:30.283350    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:02:31.074836 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:31.074802    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749"]
Nov 02 22:02:31.079228 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:31.079118    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749"
Nov 02 22:02:31.085125 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:31.085100    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749"]
Nov 02 22:02:31.088056 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:31.088023    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-vw2gs\""
Nov 02 22:02:31.246391 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:31.246348    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f3d838a-2725-438b-abda-128cf718aefa-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749\" (UID: \"6f3d838a-2725-438b-abda-128cf718aefa\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749"
Nov 02 22:02:31.246579 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:31.246404    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xh44\" (UniqueName: \"kubernetes.io/projected/6f3d838a-2725-438b-abda-128cf718aefa-kube-api-access-6xh44\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749\" (UID: \"6f3d838a-2725-438b-abda-128cf718aefa\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749"
Nov 02 22:02:31.246579 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:31.246523    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f3d838a-2725-438b-abda-128cf718aefa-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749\" (UID: \"6f3d838a-2725-438b-abda-128cf718aefa\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749"
Nov 02 22:02:31.347585 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:31.347499    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xh44\" (UniqueName: \"kubernetes.io/projected/6f3d838a-2725-438b-abda-128cf718aefa-kube-api-access-6xh44\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749\" (UID: \"6f3d838a-2725-438b-abda-128cf718aefa\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749"
Nov 02 22:02:31.347585 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:31.347569    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f3d838a-2725-438b-abda-128cf718aefa-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749\" (UID: \"6f3d838a-2725-438b-abda-128cf718aefa\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749"
Nov 02 22:02:31.348105 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:31.347632    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f3d838a-2725-438b-abda-128cf718aefa-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749\" (UID: \"6f3d838a-2725-438b-abda-128cf718aefa\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749"
Nov 02 22:02:31.348105 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:31.348020    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f3d838a-2725-438b-abda-128cf718aefa-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749\" (UID: \"6f3d838a-2725-438b-abda-128cf718aefa\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749"
Nov 02 22:02:31.348616 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:31.348594    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f3d838a-2725-438b-abda-128cf718aefa-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749\" (UID: \"6f3d838a-2725-438b-abda-128cf718aefa\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749"
Nov 02 22:02:31.356506 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:31.356483    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xh44\" (UniqueName: \"kubernetes.io/projected/6f3d838a-2725-438b-abda-128cf718aefa-kube-api-access-6xh44\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749\" (UID: \"6f3d838a-2725-438b-abda-128cf718aefa\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749"
Nov 02 22:02:31.401045 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:31.401020    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749"
Nov 02 22:02:31.690967 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:31.690941    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749"]
Nov 02 22:02:31.693487 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:02:31.693457    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f3d838a_2725_438b_abda_128cf718aefa.slice/crio-77819af493f713dd2fd40ef56a2a8d9755ba81400f041f6f5d9367b241d6ceb9 WatchSource:0}: Error finding container 77819af493f713dd2fd40ef56a2a8d9755ba81400f041f6f5d9367b241d6ceb9: Status 404 returned error can't find the container with id 77819af493f713dd2fd40ef56a2a8d9755ba81400f041f6f5d9367b241d6ceb9
Nov 02 22:02:31.980983 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:31.980895    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749" event={"ID":"6f3d838a-2725-438b-abda-128cf718aefa","Type":"ContainerStarted","Data":"77819af493f713dd2fd40ef56a2a8d9755ba81400f041f6f5d9367b241d6ceb9"}
Nov 02 22:02:33.090455 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.090357    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:02:33.624011 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.623923    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:02:33.726425 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.726393    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:02:33.816904 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.816868    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"]
Nov 02 22:02:33.820736 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.820714    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:33.829945 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.829628    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-mctrp\""
Nov 02 22:02:33.829945 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.829738    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 02 22:02:33.829945 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.829861    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 02 22:02:33.829945 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.829921    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 02 22:02:33.833596 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.833570    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"]
Nov 02 22:02:33.867172 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.867122    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:02:33.886880 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.886813    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"]
Nov 02 22:02:33.890393 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.890351    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:33.905233 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.905077    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"]
Nov 02 22:02:33.929790 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.929748    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-t4m67\""
Nov 02 22:02:33.963130 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.963096    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:02:33.971050 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.970607    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-istio-token\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:33.971050 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.970654    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-workload-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:33.971050 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.970687    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-istio-envoy\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:33.971050 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.970734    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk667\" (UniqueName: \"kubernetes.io/projected/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-kube-api-access-zk667\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:33.971050 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.970764    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-istio-data\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:33.971050 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.970799    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-credential-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:33.971050 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.970824    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-workload-certs\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:33.971050 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.970846    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:33.971050 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:33.970875    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-istio-podinfo\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:34.005840 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.005800    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt"]
Nov 02 22:02:34.009994 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.009972    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt"
Nov 02 22:02:34.015990 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.015951    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-fm2l8\""
Nov 02 22:02:34.022758 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.022726    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt"]
Nov 02 22:02:34.072228 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.072195    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-istio-data\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:34.072367 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.072253    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.072407 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.072364    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.072446 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.072399    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwjfx\" (UniqueName: \"kubernetes.io/projected/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-kube-api-access-pwjfx\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.072479 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.072449    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-credential-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:34.074948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.072522    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-workload-certs\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:34.074948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.072566    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:34.074948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.072605    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-istio-podinfo\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:34.074948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.072647    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.074948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.072698    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-istio-token\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:34.074948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.072739    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.074948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.072777    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-workload-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:34.074948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.072802    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.074948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.072821    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-istio-envoy\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:34.074948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.072838    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.074948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.072866    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.074948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.073282    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-istio-data\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:34.074948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.073479    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-credential-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:34.074948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.073589    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-workload-certs\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:34.074948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.073830    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-workload-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:34.074948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.074185    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:34.076114 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.072906    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk667\" (UniqueName: \"kubernetes.io/projected/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-kube-api-access-zk667\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:34.076114 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.075956    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.076114 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.076028    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-istio-envoy\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:34.076502 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.076448    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-istio-podinfo\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:34.080081 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.080029    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:02:34.082683 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.082639    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-istio-token\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:34.083587 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.083563    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk667\" (UniqueName: \"kubernetes.io/projected/c0d2ada9-88d6-40b1-96d3-ef5d72c48295-kube-api-access-zk667\") pod \"maas-default-gateway-openshift-default-696f47c6c-wxsbd\" (UID: \"c0d2ada9-88d6-40b1-96d3-ef5d72c48295\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:34.108789 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.108761    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w"]
Nov 02 22:02:34.114530 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.114010    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w"
Nov 02 22:02:34.118718 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.118680    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-4f4c7\""
Nov 02 22:02:34.119699 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.119679    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w"]
Nov 02 22:02:34.139571 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.139517    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:34.177039 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.177004    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.177171 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.177069    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6536e3ee-5772-44c3-bac1-8303af3426f5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt\" (UID: \"6536e3ee-5772-44c3-bac1-8303af3426f5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt"
Nov 02 22:02:34.177171 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.177115    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.177171 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.177158    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.177332 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.177188    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.177332 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.177255    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.177332 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.177294    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.177444 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.177333    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.177444 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.177361    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.177444 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.177393    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwjfx\" (UniqueName: \"kubernetes.io/projected/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-kube-api-access-pwjfx\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.177444 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.177427    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm4ns\" (UniqueName: \"kubernetes.io/projected/6536e3ee-5772-44c3-bac1-8303af3426f5-kube-api-access-tm4ns\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt\" (UID: \"6536e3ee-5772-44c3-bac1-8303af3426f5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt"
Nov 02 22:02:34.177600 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.177464    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6536e3ee-5772-44c3-bac1-8303af3426f5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt\" (UID: \"6536e3ee-5772-44c3-bac1-8303af3426f5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt"
Nov 02 22:02:34.178044 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.178005    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.178151 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.178040    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.178151 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.178099    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.178498 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.178341    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.178498 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.178488    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.180485 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.180461    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.185232 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.181314    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.195516 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.193690    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwjfx\" (UniqueName: \"kubernetes.io/projected/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-kube-api-access-pwjfx\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.195516 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.194505    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96"]
Nov 02 22:02:34.195516 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.195425    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcdcd5b0-4a1c-4d67-a46e-ae643424c08a-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj\" (UID: \"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.219556 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.219298    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:34.221197 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.221060    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96"]
Nov 02 22:02:34.221197 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.221191    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96"
Nov 02 22:02:34.225409 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.225379    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-q98xs\""
Nov 02 22:02:34.279602 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.279559    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6536e3ee-5772-44c3-bac1-8303af3426f5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt\" (UID: \"6536e3ee-5772-44c3-bac1-8303af3426f5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt"
Nov 02 22:02:34.279758 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.279631    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b9feef8-7f68-4689-b53d-f00eac54b2e3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w\" (UID: \"6b9feef8-7f68-4689-b53d-f00eac54b2e3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w"
Nov 02 22:02:34.279758 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.279684    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68kfb\" (UniqueName: \"kubernetes.io/projected/6b9feef8-7f68-4689-b53d-f00eac54b2e3-kube-api-access-68kfb\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w\" (UID: \"6b9feef8-7f68-4689-b53d-f00eac54b2e3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w"
Nov 02 22:02:34.279758 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.279733    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b9feef8-7f68-4689-b53d-f00eac54b2e3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w\" (UID: \"6b9feef8-7f68-4689-b53d-f00eac54b2e3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w"
Nov 02 22:02:34.279891 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.279781    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm4ns\" (UniqueName: \"kubernetes.io/projected/6536e3ee-5772-44c3-bac1-8303af3426f5-kube-api-access-tm4ns\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt\" (UID: \"6536e3ee-5772-44c3-bac1-8303af3426f5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt"
Nov 02 22:02:34.279891 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.279817    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6536e3ee-5772-44c3-bac1-8303af3426f5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt\" (UID: \"6536e3ee-5772-44c3-bac1-8303af3426f5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt"
Nov 02 22:02:34.280955 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.280288    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6536e3ee-5772-44c3-bac1-8303af3426f5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt\" (UID: \"6536e3ee-5772-44c3-bac1-8303af3426f5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt"
Nov 02 22:02:34.280955 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.280547    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6536e3ee-5772-44c3-bac1-8303af3426f5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt\" (UID: \"6536e3ee-5772-44c3-bac1-8303af3426f5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt"
Nov 02 22:02:34.294925 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.294904    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj"]
Nov 02 22:02:34.304098 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.304036    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm4ns\" (UniqueName: \"kubernetes.io/projected/6536e3ee-5772-44c3-bac1-8303af3426f5-kube-api-access-tm4ns\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt\" (UID: \"6536e3ee-5772-44c3-bac1-8303af3426f5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt"
Nov 02 22:02:34.305153 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.305136    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj"]
Nov 02 22:02:34.305294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.305276    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj"
Nov 02 22:02:34.331350 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.331326    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt"
Nov 02 22:02:34.348361 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.348337    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-rwsgm\""
Nov 02 22:02:34.381472 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.380695    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68kfb\" (UniqueName: \"kubernetes.io/projected/6b9feef8-7f68-4689-b53d-f00eac54b2e3-kube-api-access-68kfb\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w\" (UID: \"6b9feef8-7f68-4689-b53d-f00eac54b2e3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w"
Nov 02 22:02:34.381472 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.380765    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b9feef8-7f68-4689-b53d-f00eac54b2e3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w\" (UID: \"6b9feef8-7f68-4689-b53d-f00eac54b2e3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w"
Nov 02 22:02:34.381472 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.380850    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4faf0e1-4048-4266-a419-328b0dc0ed80-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96\" (UID: \"e4faf0e1-4048-4266-a419-328b0dc0ed80\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96"
Nov 02 22:02:34.381472 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.380891    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msqck\" (UniqueName: \"kubernetes.io/projected/e4faf0e1-4048-4266-a419-328b0dc0ed80-kube-api-access-msqck\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96\" (UID: \"e4faf0e1-4048-4266-a419-328b0dc0ed80\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96"
Nov 02 22:02:34.381472 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.380925    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4faf0e1-4048-4266-a419-328b0dc0ed80-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96\" (UID: \"e4faf0e1-4048-4266-a419-328b0dc0ed80\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96"
Nov 02 22:02:34.381472 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.380960    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b9feef8-7f68-4689-b53d-f00eac54b2e3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w\" (UID: \"6b9feef8-7f68-4689-b53d-f00eac54b2e3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w"
Nov 02 22:02:34.381472 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.381406    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b9feef8-7f68-4689-b53d-f00eac54b2e3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w\" (UID: \"6b9feef8-7f68-4689-b53d-f00eac54b2e3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w"
Nov 02 22:02:34.382201 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.382179    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b9feef8-7f68-4689-b53d-f00eac54b2e3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w\" (UID: \"6b9feef8-7f68-4689-b53d-f00eac54b2e3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w"
Nov 02 22:02:34.391504 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.391442    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68kfb\" (UniqueName: \"kubernetes.io/projected/6b9feef8-7f68-4689-b53d-f00eac54b2e3-kube-api-access-68kfb\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w\" (UID: \"6b9feef8-7f68-4689-b53d-f00eac54b2e3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w"
Nov 02 22:02:34.429704 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.429673    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"]
Nov 02 22:02:34.435416 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:02:34.435376    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d2ada9_88d6_40b1_96d3_ef5d72c48295.slice/crio-a85a0438f2aa1db1601464e1aaa8b0851e4a4be107281eff6f5ba71bf099bc07 WatchSource:0}: Error finding container a85a0438f2aa1db1601464e1aaa8b0851e4a4be107281eff6f5ba71bf099bc07: Status 404 returned error can't find the container with id a85a0438f2aa1db1601464e1aaa8b0851e4a4be107281eff6f5ba71bf099bc07
Nov 02 22:02:34.440630 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.440517    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w"
Nov 02 22:02:34.483555 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.482064    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4faf0e1-4048-4266-a419-328b0dc0ed80-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96\" (UID: \"e4faf0e1-4048-4266-a419-328b0dc0ed80\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96"
Nov 02 22:02:34.483555 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.482149    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkwrr\" (UniqueName: \"kubernetes.io/projected/0b26f716-f234-4de4-a7dc-290f9c43dea4-kube-api-access-hkwrr\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj\" (UID: \"0b26f716-f234-4de4-a7dc-290f9c43dea4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj"
Nov 02 22:02:34.483555 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.482197    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b26f716-f234-4de4-a7dc-290f9c43dea4-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj\" (UID: \"0b26f716-f234-4de4-a7dc-290f9c43dea4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj"
Nov 02 22:02:34.483555 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.482273    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4faf0e1-4048-4266-a419-328b0dc0ed80-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96\" (UID: \"e4faf0e1-4048-4266-a419-328b0dc0ed80\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96"
Nov 02 22:02:34.483555 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.482299    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b26f716-f234-4de4-a7dc-290f9c43dea4-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj\" (UID: \"0b26f716-f234-4de4-a7dc-290f9c43dea4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj"
Nov 02 22:02:34.483555 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.482338    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msqck\" (UniqueName: \"kubernetes.io/projected/e4faf0e1-4048-4266-a419-328b0dc0ed80-kube-api-access-msqck\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96\" (UID: \"e4faf0e1-4048-4266-a419-328b0dc0ed80\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96"
Nov 02 22:02:34.483555 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.483050    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4faf0e1-4048-4266-a419-328b0dc0ed80-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96\" (UID: \"e4faf0e1-4048-4266-a419-328b0dc0ed80\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96"
Nov 02 22:02:34.483555 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.483492    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4faf0e1-4048-4266-a419-328b0dc0ed80-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96\" (UID: \"e4faf0e1-4048-4266-a419-328b0dc0ed80\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96"
Nov 02 22:02:34.491876 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.491810    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msqck\" (UniqueName: \"kubernetes.io/projected/e4faf0e1-4048-4266-a419-328b0dc0ed80-kube-api-access-msqck\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96\" (UID: \"e4faf0e1-4048-4266-a419-328b0dc0ed80\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96"
Nov 02 22:02:34.508372 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.508289    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"]
Nov 02 22:02:34.517707 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:02:34.517667    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcdcd5b0_4a1c_4d67_a46e_ae643424c08a.slice/crio-db1153d98cadb6a4818a5cf2716c2651e0d6820e19f25508d1ba8f8af08c04b6 WatchSource:0}: Error finding container db1153d98cadb6a4818a5cf2716c2651e0d6820e19f25508d1ba8f8af08c04b6: Status 404 returned error can't find the container with id db1153d98cadb6a4818a5cf2716c2651e0d6820e19f25508d1ba8f8af08c04b6
Nov 02 22:02:34.543520 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.542777    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96"
Nov 02 22:02:34.582884 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.582845    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkwrr\" (UniqueName: \"kubernetes.io/projected/0b26f716-f234-4de4-a7dc-290f9c43dea4-kube-api-access-hkwrr\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj\" (UID: \"0b26f716-f234-4de4-a7dc-290f9c43dea4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj"
Nov 02 22:02:34.583045 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.582902    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b26f716-f234-4de4-a7dc-290f9c43dea4-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj\" (UID: \"0b26f716-f234-4de4-a7dc-290f9c43dea4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj"
Nov 02 22:02:34.583045 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.582941    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b26f716-f234-4de4-a7dc-290f9c43dea4-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj\" (UID: \"0b26f716-f234-4de4-a7dc-290f9c43dea4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj"
Nov 02 22:02:34.583791 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.583764    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b26f716-f234-4de4-a7dc-290f9c43dea4-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj\" (UID: \"0b26f716-f234-4de4-a7dc-290f9c43dea4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj"
Nov 02 22:02:34.583943 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.583933    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b26f716-f234-4de4-a7dc-290f9c43dea4-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj\" (UID: \"0b26f716-f234-4de4-a7dc-290f9c43dea4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj"
Nov 02 22:02:34.591365 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.591340    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkwrr\" (UniqueName: \"kubernetes.io/projected/0b26f716-f234-4de4-a7dc-290f9c43dea4-kube-api-access-hkwrr\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj\" (UID: \"0b26f716-f234-4de4-a7dc-290f9c43dea4\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj"
Nov 02 22:02:34.616689 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.616110    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt"]
Nov 02 22:02:34.624549 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.624343    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj"
Nov 02 22:02:34.741557 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.741490    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w"]
Nov 02 22:02:34.745104 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:02:34.745064    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b9feef8_7f68_4689_b53d_f00eac54b2e3.slice/crio-0074d525b4394cc0bd379cbfc4fea3a8074e4c48857189226d9e510f24d2bf90 WatchSource:0}: Error finding container 0074d525b4394cc0bd379cbfc4fea3a8074e4c48857189226d9e510f24d2bf90: Status 404 returned error can't find the container with id 0074d525b4394cc0bd379cbfc4fea3a8074e4c48857189226d9e510f24d2bf90
Nov 02 22:02:34.832051 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.832010    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96"]
Nov 02 22:02:34.918574 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.918545    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj"]
Nov 02 22:02:34.923674 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:02:34.923638    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b26f716_f234_4de4_a7dc_290f9c43dea4.slice/crio-877b7d43f9f00ad9d83ce425d2786e144e371b99a471925ba84c1067c05ceeab WatchSource:0}: Error finding container 877b7d43f9f00ad9d83ce425d2786e144e371b99a471925ba84c1067c05ceeab: Status 404 returned error can't find the container with id 877b7d43f9f00ad9d83ce425d2786e144e371b99a471925ba84c1067c05ceeab
Nov 02 22:02:34.998323 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:34.998235    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd" event={"ID":"c0d2ada9-88d6-40b1-96d3-ef5d72c48295","Type":"ContainerStarted","Data":"a85a0438f2aa1db1601464e1aaa8b0851e4a4be107281eff6f5ba71bf099bc07"}
Nov 02 22:02:35.000149 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:35.000119    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj" event={"ID":"0b26f716-f234-4de4-a7dc-290f9c43dea4","Type":"ContainerStarted","Data":"877b7d43f9f00ad9d83ce425d2786e144e371b99a471925ba84c1067c05ceeab"}
Nov 02 22:02:35.001616 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:35.001556    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96" event={"ID":"e4faf0e1-4048-4266-a419-328b0dc0ed80","Type":"ContainerStarted","Data":"f5529e454d77812ed287f1b06e6c6ae2962c123d74638baf04f979e5f779bbe5"}
Nov 02 22:02:35.003091 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:35.003061    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w" event={"ID":"6b9feef8-7f68-4689-b53d-f00eac54b2e3","Type":"ContainerStarted","Data":"0074d525b4394cc0bd379cbfc4fea3a8074e4c48857189226d9e510f24d2bf90"}
Nov 02 22:02:35.004868 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:35.004840    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt" event={"ID":"6536e3ee-5772-44c3-bac1-8303af3426f5","Type":"ContainerStarted","Data":"fdf5adf19a7bd5e6437c9d9d58f8b52ccdd10d0fbc4d05c6910e63d0efb5ca56"}
Nov 02 22:02:35.006741 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:35.006687    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj" event={"ID":"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a","Type":"ContainerStarted","Data":"db1153d98cadb6a4818a5cf2716c2651e0d6820e19f25508d1ba8f8af08c04b6"}
Nov 02 22:02:35.203527 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:35.201496    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5"]
Nov 02 22:02:35.206984 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:35.206463    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5"
Nov 02 22:02:35.214262 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:35.214188    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5"]
Nov 02 22:02:35.391721 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:35.391430    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbrb4\" (UniqueName: \"kubernetes.io/projected/591e1b9e-3cde-423f-8f10-aeada52e4087-kube-api-access-kbrb4\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5\" (UID: \"591e1b9e-3cde-423f-8f10-aeada52e4087\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5"
Nov 02 22:02:35.391721 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:35.391493    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/591e1b9e-3cde-423f-8f10-aeada52e4087-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5\" (UID: \"591e1b9e-3cde-423f-8f10-aeada52e4087\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5"
Nov 02 22:02:35.391721 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:35.391584    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/591e1b9e-3cde-423f-8f10-aeada52e4087-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5\" (UID: \"591e1b9e-3cde-423f-8f10-aeada52e4087\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5"
Nov 02 22:02:35.493355 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:35.492489    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/591e1b9e-3cde-423f-8f10-aeada52e4087-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5\" (UID: \"591e1b9e-3cde-423f-8f10-aeada52e4087\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5"
Nov 02 22:02:35.493355 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:35.492579    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbrb4\" (UniqueName: \"kubernetes.io/projected/591e1b9e-3cde-423f-8f10-aeada52e4087-kube-api-access-kbrb4\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5\" (UID: \"591e1b9e-3cde-423f-8f10-aeada52e4087\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5"
Nov 02 22:02:35.493355 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:35.492621    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/591e1b9e-3cde-423f-8f10-aeada52e4087-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5\" (UID: \"591e1b9e-3cde-423f-8f10-aeada52e4087\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5"
Nov 02 22:02:35.493355 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:35.493046    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/591e1b9e-3cde-423f-8f10-aeada52e4087-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5\" (UID: \"591e1b9e-3cde-423f-8f10-aeada52e4087\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5"
Nov 02 22:02:35.493355 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:35.493315    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/591e1b9e-3cde-423f-8f10-aeada52e4087-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5\" (UID: \"591e1b9e-3cde-423f-8f10-aeada52e4087\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5"
Nov 02 22:02:35.502489 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:35.502425    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbrb4\" (UniqueName: \"kubernetes.io/projected/591e1b9e-3cde-423f-8f10-aeada52e4087-kube-api-access-kbrb4\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5\" (UID: \"591e1b9e-3cde-423f-8f10-aeada52e4087\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5"
Nov 02 22:02:35.537665 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:35.537405    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5"
Nov 02 22:02:35.894594 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:35.894561    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5"]
Nov 02 22:02:35.901333 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:02:35.901291    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod591e1b9e_3cde_423f_8f10_aeada52e4087.slice/crio-eb5ab2b43848eaf34391c071a3c28496dbcab6620adf748f409c39319fbf02d1 WatchSource:0}: Error finding container eb5ab2b43848eaf34391c071a3c28496dbcab6620adf748f409c39319fbf02d1: Status 404 returned error can't find the container with id eb5ab2b43848eaf34391c071a3c28496dbcab6620adf748f409c39319fbf02d1
Nov 02 22:02:36.030511 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:36.030396    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5" event={"ID":"591e1b9e-3cde-423f-8f10-aeada52e4087","Type":"ContainerStarted","Data":"eb5ab2b43848eaf34391c071a3c28496dbcab6620adf748f409c39319fbf02d1"}
Nov 02 22:02:36.386747 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:36.386674    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9"]
Nov 02 22:02:36.394173 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:36.393747    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9"
Nov 02 22:02:36.396462 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:36.396399    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9"]
Nov 02 22:02:36.511056 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:36.510398    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffec8411-50ac-484e-85f9-a1dc11101f56-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9\" (UID: \"ffec8411-50ac-484e-85f9-a1dc11101f56\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9"
Nov 02 22:02:36.511056 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:36.510480    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffec8411-50ac-484e-85f9-a1dc11101f56-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9\" (UID: \"ffec8411-50ac-484e-85f9-a1dc11101f56\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9"
Nov 02 22:02:36.511056 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:36.510512    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7ntl\" (UniqueName: \"kubernetes.io/projected/ffec8411-50ac-484e-85f9-a1dc11101f56-kube-api-access-j7ntl\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9\" (UID: \"ffec8411-50ac-484e-85f9-a1dc11101f56\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9"
Nov 02 22:02:36.512718 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:36.512667    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:02:36.612611 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:36.611446    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffec8411-50ac-484e-85f9-a1dc11101f56-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9\" (UID: \"ffec8411-50ac-484e-85f9-a1dc11101f56\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9"
Nov 02 22:02:36.612611 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:36.611536    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffec8411-50ac-484e-85f9-a1dc11101f56-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9\" (UID: \"ffec8411-50ac-484e-85f9-a1dc11101f56\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9"
Nov 02 22:02:36.612611 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:36.611569    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7ntl\" (UniqueName: \"kubernetes.io/projected/ffec8411-50ac-484e-85f9-a1dc11101f56-kube-api-access-j7ntl\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9\" (UID: \"ffec8411-50ac-484e-85f9-a1dc11101f56\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9"
Nov 02 22:02:36.612611 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:36.612306    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffec8411-50ac-484e-85f9-a1dc11101f56-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9\" (UID: \"ffec8411-50ac-484e-85f9-a1dc11101f56\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9"
Nov 02 22:02:36.612611 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:36.612562    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffec8411-50ac-484e-85f9-a1dc11101f56-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9\" (UID: \"ffec8411-50ac-484e-85f9-a1dc11101f56\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9"
Nov 02 22:02:36.641193 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:36.641079    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7ntl\" (UniqueName: \"kubernetes.io/projected/ffec8411-50ac-484e-85f9-a1dc11101f56-kube-api-access-j7ntl\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9\" (UID: \"ffec8411-50ac-484e-85f9-a1dc11101f56\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9"
Nov 02 22:02:36.729560 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:36.729321    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9"
Nov 02 22:02:37.032703 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:37.032315    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9"]
Nov 02 22:02:37.038416 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:02:37.038365    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffec8411_50ac_484e_85f9_a1dc11101f56.slice/crio-844378390cbcad0fd29c49138422213eed2fa241f50ccbab6a11679004439850 WatchSource:0}: Error finding container 844378390cbcad0fd29c49138422213eed2fa241f50ccbab6a11679004439850: Status 404 returned error can't find the container with id 844378390cbcad0fd29c49138422213eed2fa241f50ccbab6a11679004439850
Nov 02 22:02:38.054166 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:38.054125    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9" event={"ID":"ffec8411-50ac-484e-85f9-a1dc11101f56","Type":"ContainerStarted","Data":"844378390cbcad0fd29c49138422213eed2fa241f50ccbab6a11679004439850"}
Nov 02 22:02:42.094084 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:42.094038    5076 generic.go:356] "Generic (PLEG): container finished" podID="ca59114b-c02c-44e7-b02a-ec8d89df7fea" containerID="6352441aa1cac012cb9600ffb4de75b9b0baedecd7c0531fa31a0b760a39857d" exitCode=0
Nov 02 22:02:42.094532 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:42.094175    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4" event={"ID":"ca59114b-c02c-44e7-b02a-ec8d89df7fea","Type":"ContainerDied","Data":"6352441aa1cac012cb9600ffb4de75b9b0baedecd7c0531fa31a0b760a39857d"}
Nov 02 22:02:43.103521 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:43.102498    5076 generic.go:356] "Generic (PLEG): container finished" podID="5bed5557-fd36-4224-9178-f26d7734fd2c" containerID="9593e139c2f5160ed251e8a163108a0012f73518f89357d79e346115a091f2f9" exitCode=0
Nov 02 22:02:43.103521 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:43.102565    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn" event={"ID":"5bed5557-fd36-4224-9178-f26d7734fd2c","Type":"ContainerDied","Data":"9593e139c2f5160ed251e8a163108a0012f73518f89357d79e346115a091f2f9"}
Nov 02 22:02:43.806730 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:43.806686    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:02:43.806862 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:43.806802    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:02:43.806862 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:43.806850    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:02:43.823332 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:43.822749    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:02:43.823332 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:43.822822    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:02:43.823332 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:43.822867    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:02:44.126712 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:44.126672    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj" event={"ID":"fcdcd5b0-4a1c-4d67-a46e-ae643424c08a","Type":"ContainerStarted","Data":"dffad38bc91b695edef4a3781cbac0d42ff131f151969c552c2442f23b38dea9"}
Nov 02 22:02:44.130398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:44.130367    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd" event={"ID":"c0d2ada9-88d6-40b1-96d3-ef5d72c48295","Type":"ContainerStarted","Data":"2f65293ec85e72813bfa00ba83a0301972fb0b97db992877d6d450983df39069"}
Nov 02 22:02:44.139999 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:44.139936    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:44.141535 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:44.141468    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-wxsbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" start-of-body=
Nov 02 22:02:44.141657 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:44.141561    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd" podUID="c0d2ada9-88d6-40b1-96d3-ef5d72c48295" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused"
Nov 02 22:02:44.157091 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:44.157039    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj" podStartSLOduration=1.856027136 podStartE2EDuration="11.157023855s" totalImagesPullingTime="9.300996719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:02:44.154581888 +0000 UTC m=+273.210916270" watchObservedRunningTime="2026-11-02 22:02:44.157023855 +0000 UTC m=+273.213358234"
Nov 02 22:02:44.174114 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:44.172919    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd" podStartSLOduration=1.805547518 podStartE2EDuration="11.172904257s" totalImagesPullingTime="9.367356739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:02:44.172500816 +0000 UTC m=+273.228835243" watchObservedRunningTime="2026-11-02 22:02:44.172904257 +0000 UTC m=+273.229238635"
Nov 02 22:02:44.222311 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:44.220681    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:44.226797 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:44.226610    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:45.138846 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:45.138816    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:45.140331 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:45.140102    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj"
Nov 02 22:02:45.146067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:45.146012    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:46.146803 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:46.146767    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96" event={"ID":"e4faf0e1-4048-4266-a419-328b0dc0ed80","Type":"ContainerStarted","Data":"d6e114a6c3b2098ba2fa98b09010fa3832128d673f6eeeed9999d4146d61f808"}
Nov 02 22:02:46.151448 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:46.151414    5076 generic.go:356] "Generic (PLEG): container finished" podID="6b9feef8-7f68-4689-b53d-f00eac54b2e3" containerID="d756dc4945a232e9f00e921f7642983a2299c768c6ed501ce5c9acc3c57db89f" exitCode=0
Nov 02 22:02:46.151657 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:46.151593    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w" event={"ID":"6b9feef8-7f68-4689-b53d-f00eac54b2e3","Type":"ContainerDied","Data":"d756dc4945a232e9f00e921f7642983a2299c768c6ed501ce5c9acc3c57db89f"}
Nov 02 22:02:46.152695 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:46.152504    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:46.153662 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:46.153645    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:02:47.157008 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:47.156963    5076 generic.go:356] "Generic (PLEG): container finished" podID="ca59114b-c02c-44e7-b02a-ec8d89df7fea" containerID="1016e15c2aac282b31f7c6612ceccb32cf1fdafbd95b65f1559ee8a4114f8c6f" exitCode=0
Nov 02 22:02:47.157468 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:47.157049    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4" event={"ID":"ca59114b-c02c-44e7-b02a-ec8d89df7fea","Type":"ContainerDied","Data":"1016e15c2aac282b31f7c6612ceccb32cf1fdafbd95b65f1559ee8a4114f8c6f"}
Nov 02 22:02:47.158749 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:47.158720    5076 generic.go:356] "Generic (PLEG): container finished" podID="6536e3ee-5772-44c3-bac1-8303af3426f5" containerID="52c54261a10f08bbe8c22e03674357a8c4472adc8c9f24f147a383f73e1f9d2b" exitCode=0
Nov 02 22:02:47.158859 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:47.158823    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt" event={"ID":"6536e3ee-5772-44c3-bac1-8303af3426f5","Type":"ContainerDied","Data":"52c54261a10f08bbe8c22e03674357a8c4472adc8c9f24f147a383f73e1f9d2b"}
Nov 02 22:02:47.160717 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:47.160686    5076 generic.go:356] "Generic (PLEG): container finished" podID="6f3d838a-2725-438b-abda-128cf718aefa" containerID="4de73186fa8a450983ebfab32b210c0c0124aa4a34e0f46b50e11e054afac2aa" exitCode=0
Nov 02 22:02:47.160831 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:47.160799    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749" event={"ID":"6f3d838a-2725-438b-abda-128cf718aefa","Type":"ContainerDied","Data":"4de73186fa8a450983ebfab32b210c0c0124aa4a34e0f46b50e11e054afac2aa"}
Nov 02 22:02:47.163803 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:47.163778    5076 generic.go:356] "Generic (PLEG): container finished" podID="e4faf0e1-4048-4266-a419-328b0dc0ed80" containerID="d6e114a6c3b2098ba2fa98b09010fa3832128d673f6eeeed9999d4146d61f808" exitCode=0
Nov 02 22:02:47.163891 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:47.163860    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96" event={"ID":"e4faf0e1-4048-4266-a419-328b0dc0ed80","Type":"ContainerDied","Data":"d6e114a6c3b2098ba2fa98b09010fa3832128d673f6eeeed9999d4146d61f808"}
Nov 02 22:02:48.170403 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:48.170367    5076 generic.go:356] "Generic (PLEG): container finished" podID="0b26f716-f234-4de4-a7dc-290f9c43dea4" containerID="d6ea89d19bbcf403297b3187c0e642917b362240596815cd02e5dfc37a63d09d" exitCode=0
Nov 02 22:02:48.170859 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:48.170507    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj" event={"ID":"0b26f716-f234-4de4-a7dc-290f9c43dea4","Type":"ContainerDied","Data":"d6ea89d19bbcf403297b3187c0e642917b362240596815cd02e5dfc37a63d09d"}
Nov 02 22:02:48.172950 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:48.172926    5076 generic.go:356] "Generic (PLEG): container finished" podID="6b9feef8-7f68-4689-b53d-f00eac54b2e3" containerID="b6260b6a0f809e0a8cf62a791d10d9a76795194278f754d82793712c558fa8c2" exitCode=0
Nov 02 22:02:48.173064 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:48.173037    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w" event={"ID":"6b9feef8-7f68-4689-b53d-f00eac54b2e3","Type":"ContainerDied","Data":"b6260b6a0f809e0a8cf62a791d10d9a76795194278f754d82793712c558fa8c2"}
Nov 02 22:02:48.176317 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:48.176294    5076 generic.go:356] "Generic (PLEG): container finished" podID="6f3d838a-2725-438b-abda-128cf718aefa" containerID="0eb3c5b5f75b9f28b1ed3119e2fdaf810268d3fbbb0add1720ce8972a120e669" exitCode=0
Nov 02 22:02:48.176422 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:48.176361    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749" event={"ID":"6f3d838a-2725-438b-abda-128cf718aefa","Type":"ContainerDied","Data":"0eb3c5b5f75b9f28b1ed3119e2fdaf810268d3fbbb0add1720ce8972a120e669"}
Nov 02 22:02:48.178420 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:48.178396    5076 generic.go:356] "Generic (PLEG): container finished" podID="ffec8411-50ac-484e-85f9-a1dc11101f56" containerID="f905b33bf5f0964ec23659a1e490dc847efb327182660bc2dc5ca8cb65d563a6" exitCode=0
Nov 02 22:02:48.178503 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:48.178477    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9" event={"ID":"ffec8411-50ac-484e-85f9-a1dc11101f56","Type":"ContainerDied","Data":"f905b33bf5f0964ec23659a1e490dc847efb327182660bc2dc5ca8cb65d563a6"}
Nov 02 22:02:49.188205 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:49.188160    5076 generic.go:356] "Generic (PLEG): container finished" podID="e4faf0e1-4048-4266-a419-328b0dc0ed80" containerID="c94418b6fce8e7042580f9317a374013b9b24be6744109a32aa139ce65623cc2" exitCode=0
Nov 02 22:02:49.188704 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:49.188336    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96" event={"ID":"e4faf0e1-4048-4266-a419-328b0dc0ed80","Type":"ContainerDied","Data":"c94418b6fce8e7042580f9317a374013b9b24be6744109a32aa139ce65623cc2"}
Nov 02 22:02:49.198488 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:49.198450    5076 generic.go:356] "Generic (PLEG): container finished" podID="6536e3ee-5772-44c3-bac1-8303af3426f5" containerID="6e66bdb362f81bed7dcc746200d795dfd8740be9d9115340bb7568ccfe490901" exitCode=0
Nov 02 22:02:49.198587 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:49.198526    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt" event={"ID":"6536e3ee-5772-44c3-bac1-8303af3426f5","Type":"ContainerDied","Data":"6e66bdb362f81bed7dcc746200d795dfd8740be9d9115340bb7568ccfe490901"}
Nov 02 22:02:50.211661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:50.210707    5076 generic.go:356] "Generic (PLEG): container finished" podID="0b26f716-f234-4de4-a7dc-290f9c43dea4" containerID="f790aba55505dc7cb85c3308e9f0c625c1a2b18ad2c9558c88b3339de5aba55b" exitCode=0
Nov 02 22:02:50.211661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:50.210785    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj" event={"ID":"0b26f716-f234-4de4-a7dc-290f9c43dea4","Type":"ContainerDied","Data":"f790aba55505dc7cb85c3308e9f0c625c1a2b18ad2c9558c88b3339de5aba55b"}
Nov 02 22:02:52.235139 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:52.234151    5076 generic.go:356] "Generic (PLEG): container finished" podID="591e1b9e-3cde-423f-8f10-aeada52e4087" containerID="49d465b7be4c725a48394db523ef5f770853e8ea66b7541ec226e22d6fda5e2c" exitCode=0
Nov 02 22:02:52.235139 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:52.234261    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5" event={"ID":"591e1b9e-3cde-423f-8f10-aeada52e4087","Type":"ContainerDied","Data":"49d465b7be4c725a48394db523ef5f770853e8ea66b7541ec226e22d6fda5e2c"}
Nov 02 22:02:53.257538 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:53.256154    5076 generic.go:356] "Generic (PLEG): container finished" podID="591e1b9e-3cde-423f-8f10-aeada52e4087" containerID="eb24b046b18e7f1c3ad9a1c21a03c423a4d0eb500d87f649a6ecab57d0e95dee" exitCode=0
Nov 02 22:02:53.257538 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:53.256314    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5" event={"ID":"591e1b9e-3cde-423f-8f10-aeada52e4087","Type":"ContainerDied","Data":"eb24b046b18e7f1c3ad9a1c21a03c423a4d0eb500d87f649a6ecab57d0e95dee"}
Nov 02 22:02:54.267075 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:54.265976    5076 generic.go:356] "Generic (PLEG): container finished" podID="ffec8411-50ac-484e-85f9-a1dc11101f56" containerID="e6f7a5ba631557e17dfb0c2903c05305ec4ec8fb2af7b411dd6657e409970b57" exitCode=0
Nov 02 22:02:54.267075 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:54.266046    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9" event={"ID":"ffec8411-50ac-484e-85f9-a1dc11101f56","Type":"ContainerDied","Data":"e6f7a5ba631557e17dfb0c2903c05305ec4ec8fb2af7b411dd6657e409970b57"}
Nov 02 22:02:57.289660 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:57.289624    5076 generic.go:356] "Generic (PLEG): container finished" podID="5bed5557-fd36-4224-9178-f26d7734fd2c" containerID="76788c4e8f023b0251eac7ea24f60be03cd0fe14ac821ffb732fc8c7a494e4dc" exitCode=0
Nov 02 22:02:57.290148 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:02:57.289727    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn" event={"ID":"5bed5557-fd36-4224-9178-f26d7734fd2c","Type":"ContainerDied","Data":"76788c4e8f023b0251eac7ea24f60be03cd0fe14ac821ffb732fc8c7a494e4dc"}
Nov 02 22:02:59.919410 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:02:59.919247    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:03:02.336370 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:02.336091    5076 generic.go:356] "Generic (PLEG): container finished" podID="ca59114b-c02c-44e7-b02a-ec8d89df7fea" containerID="e1fb2caa6416fd3c9a7f4d72d22bc672479c50062be509844e58091182255ce8" exitCode=0
Nov 02 22:03:02.336370 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:02.336247    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4" event={"ID":"ca59114b-c02c-44e7-b02a-ec8d89df7fea","Type":"ContainerDied","Data":"e1fb2caa6416fd3c9a7f4d72d22bc672479c50062be509844e58091182255ce8"}
Nov 02 22:03:02.340416 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:02.340269    5076 generic.go:356] "Generic (PLEG): container finished" podID="6f3d838a-2725-438b-abda-128cf718aefa" containerID="a795349e73c4202827501bd5177ec4d9d6e78284c0554345bd60a88a692e4c2c" exitCode=0
Nov 02 22:03:02.340416 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:02.340310    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749" event={"ID":"6f3d838a-2725-438b-abda-128cf718aefa","Type":"ContainerDied","Data":"a795349e73c4202827501bd5177ec4d9d6e78284c0554345bd60a88a692e4c2c"}
Nov 02 22:03:03.573545 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:03.573239    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4"
Nov 02 22:03:03.587317 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:03.587290    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749"
Nov 02 22:03:03.703783 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:03.703705    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f3d838a-2725-438b-abda-128cf718aefa-kube-api-access-6xh44\" (UniqueName: \"kubernetes.io/projected/6f3d838a-2725-438b-abda-128cf718aefa-kube-api-access-6xh44\") pod \"6f3d838a-2725-438b-abda-128cf718aefa\" (UID: \"6f3d838a-2725-438b-abda-128cf718aefa\") "
Nov 02 22:03:03.703783 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:03.703774    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca59114b-c02c-44e7-b02a-ec8d89df7fea-util\" (UniqueName: \"kubernetes.io/empty-dir/ca59114b-c02c-44e7-b02a-ec8d89df7fea-util\") pod \"ca59114b-c02c-44e7-b02a-ec8d89df7fea\" (UID: \"ca59114b-c02c-44e7-b02a-ec8d89df7fea\") "
Nov 02 22:03:03.704008 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:03.703810    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f3d838a-2725-438b-abda-128cf718aefa-util\" (UniqueName: \"kubernetes.io/empty-dir/6f3d838a-2725-438b-abda-128cf718aefa-util\") pod \"6f3d838a-2725-438b-abda-128cf718aefa\" (UID: \"6f3d838a-2725-438b-abda-128cf718aefa\") "
Nov 02 22:03:03.704008 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:03.703871    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f3d838a-2725-438b-abda-128cf718aefa-bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f3d838a-2725-438b-abda-128cf718aefa-bundle\") pod \"6f3d838a-2725-438b-abda-128cf718aefa\" (UID: \"6f3d838a-2725-438b-abda-128cf718aefa\") "
Nov 02 22:03:03.704008 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:03.703907    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca59114b-c02c-44e7-b02a-ec8d89df7fea-bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca59114b-c02c-44e7-b02a-ec8d89df7fea-bundle\") pod \"ca59114b-c02c-44e7-b02a-ec8d89df7fea\" (UID: \"ca59114b-c02c-44e7-b02a-ec8d89df7fea\") "
Nov 02 22:03:03.704008 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:03.703990    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ca59114b-c02c-44e7-b02a-ec8d89df7fea-kube-api-access-k4tmr\" (UniqueName: \"kubernetes.io/projected/ca59114b-c02c-44e7-b02a-ec8d89df7fea-kube-api-access-k4tmr\") pod \"ca59114b-c02c-44e7-b02a-ec8d89df7fea\" (UID: \"ca59114b-c02c-44e7-b02a-ec8d89df7fea\") "
Nov 02 22:03:03.705579 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:03.705528    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f3d838a-2725-438b-abda-128cf718aefa-bundle" pod "6f3d838a-2725-438b-abda-128cf718aefa" (UID: "6f3d838a-2725-438b-abda-128cf718aefa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:03:03.705709 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:03.705638    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca59114b-c02c-44e7-b02a-ec8d89df7fea-bundle" pod "ca59114b-c02c-44e7-b02a-ec8d89df7fea" (UID: "ca59114b-c02c-44e7-b02a-ec8d89df7fea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:03:03.708100 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:03.708066    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca59114b-c02c-44e7-b02a-ec8d89df7fea-kube-api-access-k4tmr" pod "ca59114b-c02c-44e7-b02a-ec8d89df7fea" (UID: "ca59114b-c02c-44e7-b02a-ec8d89df7fea"). InnerVolumeSpecName "kube-api-access-k4tmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:03:03.710910 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:03.710883    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca59114b-c02c-44e7-b02a-ec8d89df7fea-util" pod "ca59114b-c02c-44e7-b02a-ec8d89df7fea" (UID: "ca59114b-c02c-44e7-b02a-ec8d89df7fea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:03:03.714159 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:03.714135    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f3d838a-2725-438b-abda-128cf718aefa-util" pod "6f3d838a-2725-438b-abda-128cf718aefa" (UID: "6f3d838a-2725-438b-abda-128cf718aefa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:03:03.721175 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:03.721151    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f3d838a-2725-438b-abda-128cf718aefa-kube-api-access-6xh44" pod "6f3d838a-2725-438b-abda-128cf718aefa" (UID: "6f3d838a-2725-438b-abda-128cf718aefa"). InnerVolumeSpecName "kube-api-access-6xh44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:03:03.804867 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:03.804760    5076 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f3d838a-2725-438b-abda-128cf718aefa-bundle\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:03.804867 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:03.804791    5076 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca59114b-c02c-44e7-b02a-ec8d89df7fea-bundle\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:03.804867 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:03.804807    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4tmr\" (UniqueName: \"kubernetes.io/projected/ca59114b-c02c-44e7-b02a-ec8d89df7fea-kube-api-access-k4tmr\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:03.804867 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:03.804822    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xh44\" (UniqueName: \"kubernetes.io/projected/6f3d838a-2725-438b-abda-128cf718aefa-kube-api-access-6xh44\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:03.804867 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:03.804836    5076 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca59114b-c02c-44e7-b02a-ec8d89df7fea-util\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:03.804867 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:03.804849    5076 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f3d838a-2725-438b-abda-128cf718aefa-util\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:04.365261 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:04.361563    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4" event={"ID":"ca59114b-c02c-44e7-b02a-ec8d89df7fea","Type":"ContainerDied","Data":"f7cbe3584482b3bede40b4f223407fb37908cc4492c2c12490f05b5b8846e6a6"}
Nov 02 22:03:04.365261 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:04.361620    5076 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7cbe3584482b3bede40b4f223407fb37908cc4492c2c12490f05b5b8846e6a6"
Nov 02 22:03:04.365261 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:04.361707    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctp9z4"
Nov 02 22:03:04.368929 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:04.368702    5076 generic.go:356] "Generic (PLEG): container finished" podID="6b9feef8-7f68-4689-b53d-f00eac54b2e3" containerID="88c2c19e906386820ca049cef383479404e3b911adbf173774f625d96e601a2f" exitCode=0
Nov 02 22:03:04.368929 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:04.368812    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w" event={"ID":"6b9feef8-7f68-4689-b53d-f00eac54b2e3","Type":"ContainerDied","Data":"88c2c19e906386820ca049cef383479404e3b911adbf173774f625d96e601a2f"}
Nov 02 22:03:04.381048 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:04.381019    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749" event={"ID":"6f3d838a-2725-438b-abda-128cf718aefa","Type":"ContainerDied","Data":"77819af493f713dd2fd40ef56a2a8d9755ba81400f041f6f5d9367b241d6ceb9"}
Nov 02 22:03:04.381285 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:04.381267    5076 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77819af493f713dd2fd40ef56a2a8d9755ba81400f041f6f5d9367b241d6ceb9"
Nov 02 22:03:04.381468 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:04.381456    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71bf749"
Nov 02 22:03:05.389702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:05.389668    5076 generic.go:356] "Generic (PLEG): container finished" podID="ffec8411-50ac-484e-85f9-a1dc11101f56" containerID="40475026fb1dc08a9544cf8a4e97926e20999033a0cfe8cd15122c92a26cfb04" exitCode=0
Nov 02 22:03:05.390139 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:05.389752    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9" event={"ID":"ffec8411-50ac-484e-85f9-a1dc11101f56","Type":"ContainerDied","Data":"40475026fb1dc08a9544cf8a4e97926e20999033a0cfe8cd15122c92a26cfb04"}
Nov 02 22:03:05.392433 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:05.392410    5076 generic.go:356] "Generic (PLEG): container finished" podID="591e1b9e-3cde-423f-8f10-aeada52e4087" containerID="b0ceba2c5644c092766e051733799535cc296efb66244fa1d60d7b8483e963c1" exitCode=0
Nov 02 22:03:05.392564 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:05.392507    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5" event={"ID":"591e1b9e-3cde-423f-8f10-aeada52e4087","Type":"ContainerDied","Data":"b0ceba2c5644c092766e051733799535cc296efb66244fa1d60d7b8483e963c1"}
Nov 02 22:03:05.395119 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:05.395096    5076 generic.go:356] "Generic (PLEG): container finished" podID="e4faf0e1-4048-4266-a419-328b0dc0ed80" containerID="0a58689877cd3994a7f0eecffc415da97fe0ba3c198570f0d8be983ec852f8f6" exitCode=0
Nov 02 22:03:05.395242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:05.395176    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96" event={"ID":"e4faf0e1-4048-4266-a419-328b0dc0ed80","Type":"ContainerDied","Data":"0a58689877cd3994a7f0eecffc415da97fe0ba3c198570f0d8be983ec852f8f6"}
Nov 02 22:03:05.397457 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:05.397436    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt" event={"ID":"6536e3ee-5772-44c3-bac1-8303af3426f5","Type":"ContainerStarted","Data":"d904eea820d5c4e30fb2b6950bcfabeb7c336ae4fc79f5a351f24792548afb6d"}
Nov 02 22:03:05.545085 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:05.545056    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w"
Nov 02 22:03:05.625017 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:05.624987    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b9feef8-7f68-4689-b53d-f00eac54b2e3-bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b9feef8-7f68-4689-b53d-f00eac54b2e3-bundle\") pod \"6b9feef8-7f68-4689-b53d-f00eac54b2e3\" (UID: \"6b9feef8-7f68-4689-b53d-f00eac54b2e3\") "
Nov 02 22:03:05.625171 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:05.625030    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b9feef8-7f68-4689-b53d-f00eac54b2e3-util\" (UniqueName: \"kubernetes.io/empty-dir/6b9feef8-7f68-4689-b53d-f00eac54b2e3-util\") pod \"6b9feef8-7f68-4689-b53d-f00eac54b2e3\" (UID: \"6b9feef8-7f68-4689-b53d-f00eac54b2e3\") "
Nov 02 22:03:05.625171 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:05.625063    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6b9feef8-7f68-4689-b53d-f00eac54b2e3-kube-api-access-68kfb\" (UniqueName: \"kubernetes.io/projected/6b9feef8-7f68-4689-b53d-f00eac54b2e3-kube-api-access-68kfb\") pod \"6b9feef8-7f68-4689-b53d-f00eac54b2e3\" (UID: \"6b9feef8-7f68-4689-b53d-f00eac54b2e3\") "
Nov 02 22:03:05.625582 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:05.625530    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b9feef8-7f68-4689-b53d-f00eac54b2e3-bundle" pod "6b9feef8-7f68-4689-b53d-f00eac54b2e3" (UID: "6b9feef8-7f68-4689-b53d-f00eac54b2e3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:03:05.627675 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:05.627649    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b9feef8-7f68-4689-b53d-f00eac54b2e3-kube-api-access-68kfb" pod "6b9feef8-7f68-4689-b53d-f00eac54b2e3" (UID: "6b9feef8-7f68-4689-b53d-f00eac54b2e3"). InnerVolumeSpecName "kube-api-access-68kfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:03:05.631449 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:05.631424    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b9feef8-7f68-4689-b53d-f00eac54b2e3-util" pod "6b9feef8-7f68-4689-b53d-f00eac54b2e3" (UID: "6b9feef8-7f68-4689-b53d-f00eac54b2e3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:03:05.726099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:05.726065    5076 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b9feef8-7f68-4689-b53d-f00eac54b2e3-bundle\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:05.726099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:05.726098    5076 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b9feef8-7f68-4689-b53d-f00eac54b2e3-util\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:05.726331 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:05.726108    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68kfb\" (UniqueName: \"kubernetes.io/projected/6b9feef8-7f68-4689-b53d-f00eac54b2e3-kube-api-access-68kfb\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:06.405138 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.405105    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w" event={"ID":"6b9feef8-7f68-4689-b53d-f00eac54b2e3","Type":"ContainerDied","Data":"0074d525b4394cc0bd379cbfc4fea3a8074e4c48857189226d9e510f24d2bf90"}
Nov 02 22:03:06.405605 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.405138    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xsd9w"
Nov 02 22:03:06.405605 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.405159    5076 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0074d525b4394cc0bd379cbfc4fea3a8074e4c48857189226d9e510f24d2bf90"
Nov 02 22:03:06.411440 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.411411    5076 generic.go:356] "Generic (PLEG): container finished" podID="6536e3ee-5772-44c3-bac1-8303af3426f5" containerID="d904eea820d5c4e30fb2b6950bcfabeb7c336ae4fc79f5a351f24792548afb6d" exitCode=0
Nov 02 22:03:06.411577 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.411552    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt" event={"ID":"6536e3ee-5772-44c3-bac1-8303af3426f5","Type":"ContainerDied","Data":"d904eea820d5c4e30fb2b6950bcfabeb7c336ae4fc79f5a351f24792548afb6d"}
Nov 02 22:03:06.589069 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.588806    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9"
Nov 02 22:03:06.686367 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.686336    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt"
Nov 02 22:03:06.690173 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.690150    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5"
Nov 02 22:03:06.692640 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.692618    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96"
Nov 02 22:03:06.739688 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.739660    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ffec8411-50ac-484e-85f9-a1dc11101f56-bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffec8411-50ac-484e-85f9-a1dc11101f56-bundle\") pod \"ffec8411-50ac-484e-85f9-a1dc11101f56\" (UID: \"ffec8411-50ac-484e-85f9-a1dc11101f56\") "
Nov 02 22:03:06.739799 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.739782    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ffec8411-50ac-484e-85f9-a1dc11101f56-util\" (UniqueName: \"kubernetes.io/empty-dir/ffec8411-50ac-484e-85f9-a1dc11101f56-util\") pod \"ffec8411-50ac-484e-85f9-a1dc11101f56\" (UID: \"ffec8411-50ac-484e-85f9-a1dc11101f56\") "
Nov 02 22:03:06.739867 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.739825    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ffec8411-50ac-484e-85f9-a1dc11101f56-kube-api-access-j7ntl\" (UniqueName: \"kubernetes.io/projected/ffec8411-50ac-484e-85f9-a1dc11101f56-kube-api-access-j7ntl\") pod \"ffec8411-50ac-484e-85f9-a1dc11101f56\" (UID: \"ffec8411-50ac-484e-85f9-a1dc11101f56\") "
Nov 02 22:03:06.740204 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.740176    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffec8411-50ac-484e-85f9-a1dc11101f56-bundle" pod "ffec8411-50ac-484e-85f9-a1dc11101f56" (UID: "ffec8411-50ac-484e-85f9-a1dc11101f56"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:03:06.742237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.742193    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffec8411-50ac-484e-85f9-a1dc11101f56-kube-api-access-j7ntl" pod "ffec8411-50ac-484e-85f9-a1dc11101f56" (UID: "ffec8411-50ac-484e-85f9-a1dc11101f56"). InnerVolumeSpecName "kube-api-access-j7ntl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:03:06.746543 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.746519    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffec8411-50ac-484e-85f9-a1dc11101f56-util" pod "ffec8411-50ac-484e-85f9-a1dc11101f56" (UID: "ffec8411-50ac-484e-85f9-a1dc11101f56"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:03:06.840768 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.840736    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6536e3ee-5772-44c3-bac1-8303af3426f5-util\" (UniqueName: \"kubernetes.io/empty-dir/6536e3ee-5772-44c3-bac1-8303af3426f5-util\") pod \"6536e3ee-5772-44c3-bac1-8303af3426f5\" (UID: \"6536e3ee-5772-44c3-bac1-8303af3426f5\") "
Nov 02 22:03:06.840917 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.840785    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6536e3ee-5772-44c3-bac1-8303af3426f5-bundle\" (UniqueName: \"kubernetes.io/empty-dir/6536e3ee-5772-44c3-bac1-8303af3426f5-bundle\") pod \"6536e3ee-5772-44c3-bac1-8303af3426f5\" (UID: \"6536e3ee-5772-44c3-bac1-8303af3426f5\") "
Nov 02 22:03:06.840917 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.840804    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e4faf0e1-4048-4266-a419-328b0dc0ed80-util\" (UniqueName: \"kubernetes.io/empty-dir/e4faf0e1-4048-4266-a419-328b0dc0ed80-util\") pod \"e4faf0e1-4048-4266-a419-328b0dc0ed80\" (UID: \"e4faf0e1-4048-4266-a419-328b0dc0ed80\") "
Nov 02 22:03:06.840917 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.840834    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/591e1b9e-3cde-423f-8f10-aeada52e4087-kube-api-access-kbrb4\" (UniqueName: \"kubernetes.io/projected/591e1b9e-3cde-423f-8f10-aeada52e4087-kube-api-access-kbrb4\") pod \"591e1b9e-3cde-423f-8f10-aeada52e4087\" (UID: \"591e1b9e-3cde-423f-8f10-aeada52e4087\") "
Nov 02 22:03:06.840917 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.840863    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/591e1b9e-3cde-423f-8f10-aeada52e4087-bundle\" (UniqueName: \"kubernetes.io/empty-dir/591e1b9e-3cde-423f-8f10-aeada52e4087-bundle\") pod \"591e1b9e-3cde-423f-8f10-aeada52e4087\" (UID: \"591e1b9e-3cde-423f-8f10-aeada52e4087\") "
Nov 02 22:03:06.840917 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.840892    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6536e3ee-5772-44c3-bac1-8303af3426f5-kube-api-access-tm4ns\" (UniqueName: \"kubernetes.io/projected/6536e3ee-5772-44c3-bac1-8303af3426f5-kube-api-access-tm4ns\") pod \"6536e3ee-5772-44c3-bac1-8303af3426f5\" (UID: \"6536e3ee-5772-44c3-bac1-8303af3426f5\") "
Nov 02 22:03:06.841190 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.840967    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e4faf0e1-4048-4266-a419-328b0dc0ed80-bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4faf0e1-4048-4266-a419-328b0dc0ed80-bundle\") pod \"e4faf0e1-4048-4266-a419-328b0dc0ed80\" (UID: \"e4faf0e1-4048-4266-a419-328b0dc0ed80\") "
Nov 02 22:03:06.841190 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.841000    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e4faf0e1-4048-4266-a419-328b0dc0ed80-kube-api-access-msqck\" (UniqueName: \"kubernetes.io/projected/e4faf0e1-4048-4266-a419-328b0dc0ed80-kube-api-access-msqck\") pod \"e4faf0e1-4048-4266-a419-328b0dc0ed80\" (UID: \"e4faf0e1-4048-4266-a419-328b0dc0ed80\") "
Nov 02 22:03:06.841190 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.841030    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/591e1b9e-3cde-423f-8f10-aeada52e4087-util\" (UniqueName: \"kubernetes.io/empty-dir/591e1b9e-3cde-423f-8f10-aeada52e4087-util\") pod \"591e1b9e-3cde-423f-8f10-aeada52e4087\" (UID: \"591e1b9e-3cde-423f-8f10-aeada52e4087\") "
Nov 02 22:03:06.841362 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.841318    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6536e3ee-5772-44c3-bac1-8303af3426f5-bundle" pod "6536e3ee-5772-44c3-bac1-8303af3426f5" (UID: "6536e3ee-5772-44c3-bac1-8303af3426f5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:03:06.841362 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.841346    5076 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffec8411-50ac-484e-85f9-a1dc11101f56-bundle\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:06.841476 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.841366    5076 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffec8411-50ac-484e-85f9-a1dc11101f56-util\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:06.841476 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.841382    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7ntl\" (UniqueName: \"kubernetes.io/projected/ffec8411-50ac-484e-85f9-a1dc11101f56-kube-api-access-j7ntl\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:06.841919 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.841623    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/591e1b9e-3cde-423f-8f10-aeada52e4087-bundle" pod "591e1b9e-3cde-423f-8f10-aeada52e4087" (UID: "591e1b9e-3cde-423f-8f10-aeada52e4087"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:03:06.841919 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.841802    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4faf0e1-4048-4266-a419-328b0dc0ed80-bundle" pod "e4faf0e1-4048-4266-a419-328b0dc0ed80" (UID: "e4faf0e1-4048-4266-a419-328b0dc0ed80"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:03:06.843661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.843633    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/591e1b9e-3cde-423f-8f10-aeada52e4087-kube-api-access-kbrb4" pod "591e1b9e-3cde-423f-8f10-aeada52e4087" (UID: "591e1b9e-3cde-423f-8f10-aeada52e4087"). InnerVolumeSpecName "kube-api-access-kbrb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:03:06.844600 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.844574    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4faf0e1-4048-4266-a419-328b0dc0ed80-kube-api-access-msqck" pod "e4faf0e1-4048-4266-a419-328b0dc0ed80" (UID: "e4faf0e1-4048-4266-a419-328b0dc0ed80"). InnerVolumeSpecName "kube-api-access-msqck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:03:06.844722 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.844706    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6536e3ee-5772-44c3-bac1-8303af3426f5-kube-api-access-tm4ns" pod "6536e3ee-5772-44c3-bac1-8303af3426f5" (UID: "6536e3ee-5772-44c3-bac1-8303af3426f5"). InnerVolumeSpecName "kube-api-access-tm4ns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:03:06.848172 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.848151    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6536e3ee-5772-44c3-bac1-8303af3426f5-util" pod "6536e3ee-5772-44c3-bac1-8303af3426f5" (UID: "6536e3ee-5772-44c3-bac1-8303af3426f5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:03:06.849112 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.849092    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/591e1b9e-3cde-423f-8f10-aeada52e4087-util" pod "591e1b9e-3cde-423f-8f10-aeada52e4087" (UID: "591e1b9e-3cde-423f-8f10-aeada52e4087"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:03:06.850123 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.850099    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4faf0e1-4048-4266-a419-328b0dc0ed80-util" pod "e4faf0e1-4048-4266-a419-328b0dc0ed80" (UID: "e4faf0e1-4048-4266-a419-328b0dc0ed80"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:03:06.942310 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.942258    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbrb4\" (UniqueName: \"kubernetes.io/projected/591e1b9e-3cde-423f-8f10-aeada52e4087-kube-api-access-kbrb4\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:06.942310 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.942281    5076 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/591e1b9e-3cde-423f-8f10-aeada52e4087-bundle\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:06.942310 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.942291    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tm4ns\" (UniqueName: \"kubernetes.io/projected/6536e3ee-5772-44c3-bac1-8303af3426f5-kube-api-access-tm4ns\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:06.942310 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.942301    5076 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4faf0e1-4048-4266-a419-328b0dc0ed80-bundle\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:06.942482 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.942315    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msqck\" (UniqueName: \"kubernetes.io/projected/e4faf0e1-4048-4266-a419-328b0dc0ed80-kube-api-access-msqck\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:06.942482 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.942323    5076 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/591e1b9e-3cde-423f-8f10-aeada52e4087-util\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:06.942482 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.942331    5076 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6536e3ee-5772-44c3-bac1-8303af3426f5-util\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:06.942482 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.942339    5076 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6536e3ee-5772-44c3-bac1-8303af3426f5-bundle\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:06.942482 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:06.942346    5076 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4faf0e1-4048-4266-a419-328b0dc0ed80-util\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:07.417394 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:07.417362    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt"
Nov 02 22:03:07.417394 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:07.417380    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67prxt" event={"ID":"6536e3ee-5772-44c3-bac1-8303af3426f5","Type":"ContainerDied","Data":"fdf5adf19a7bd5e6437c9d9d58f8b52ccdd10d0fbc4d05c6910e63d0efb5ca56"}
Nov 02 22:03:07.417850 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:07.417434    5076 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdf5adf19a7bd5e6437c9d9d58f8b52ccdd10d0fbc4d05c6910e63d0efb5ca56"
Nov 02 22:03:07.419491 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:07.419426    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9" event={"ID":"ffec8411-50ac-484e-85f9-a1dc11101f56","Type":"ContainerDied","Data":"844378390cbcad0fd29c49138422213eed2fa241f50ccbab6a11679004439850"}
Nov 02 22:03:07.419491 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:07.419446    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644jqng9"
Nov 02 22:03:07.419491 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:07.419472    5076 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="844378390cbcad0fd29c49138422213eed2fa241f50ccbab6a11679004439850"
Nov 02 22:03:07.422095 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:07.422073    5076 generic.go:356] "Generic (PLEG): container finished" podID="5bed5557-fd36-4224-9178-f26d7734fd2c" containerID="ed091f585e14e65bb6f3ab2d752511c93a4f1670e2fe90863264c25093c6e97d" exitCode=0
Nov 02 22:03:07.422191 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:07.422151    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn" event={"ID":"5bed5557-fd36-4224-9178-f26d7734fd2c","Type":"ContainerDied","Data":"ed091f585e14e65bb6f3ab2d752511c93a4f1670e2fe90863264c25093c6e97d"}
Nov 02 22:03:07.424156 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:07.424137    5076 generic.go:356] "Generic (PLEG): container finished" podID="0b26f716-f234-4de4-a7dc-290f9c43dea4" containerID="19527ca41d4d532376619a36b95b50e8aa0da3f5d7eefea6d801d1c9509bf744" exitCode=0
Nov 02 22:03:07.424264 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:07.424191    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj" event={"ID":"0b26f716-f234-4de4-a7dc-290f9c43dea4","Type":"ContainerDied","Data":"19527ca41d4d532376619a36b95b50e8aa0da3f5d7eefea6d801d1c9509bf744"}
Nov 02 22:03:07.425901 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:07.425883    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5"
Nov 02 22:03:07.425901 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:07.425895    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c44jl5" event={"ID":"591e1b9e-3cde-423f-8f10-aeada52e4087","Type":"ContainerDied","Data":"eb5ab2b43848eaf34391c071a3c28496dbcab6620adf748f409c39319fbf02d1"}
Nov 02 22:03:07.426015 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:07.425922    5076 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb5ab2b43848eaf34391c071a3c28496dbcab6620adf748f409c39319fbf02d1"
Nov 02 22:03:07.427787 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:07.427764    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96" event={"ID":"e4faf0e1-4048-4266-a419-328b0dc0ed80","Type":"ContainerDied","Data":"f5529e454d77812ed287f1b06e6c6ae2962c123d74638baf04f979e5f779bbe5"}
Nov 02 22:03:07.427953 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:07.427925    5076 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5529e454d77812ed287f1b06e6c6ae2962c123d74638baf04f979e5f779bbe5"
Nov 02 22:03:07.427953 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:07.427817    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpgt96"
Nov 02 22:03:08.555949 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.555928    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj"
Nov 02 22:03:08.585705 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.585685    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn"
Nov 02 22:03:08.653179 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.653149    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0b26f716-f234-4de4-a7dc-290f9c43dea4-kube-api-access-hkwrr\" (UniqueName: \"kubernetes.io/projected/0b26f716-f234-4de4-a7dc-290f9c43dea4-kube-api-access-hkwrr\") pod \"0b26f716-f234-4de4-a7dc-290f9c43dea4\" (UID: \"0b26f716-f234-4de4-a7dc-290f9c43dea4\") "
Nov 02 22:03:08.653379 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.653194    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b26f716-f234-4de4-a7dc-290f9c43dea4-util\" (UniqueName: \"kubernetes.io/empty-dir/0b26f716-f234-4de4-a7dc-290f9c43dea4-util\") pod \"0b26f716-f234-4de4-a7dc-290f9c43dea4\" (UID: \"0b26f716-f234-4de4-a7dc-290f9c43dea4\") "
Nov 02 22:03:08.653379 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.653282    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b26f716-f234-4de4-a7dc-290f9c43dea4-bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b26f716-f234-4de4-a7dc-290f9c43dea4-bundle\") pod \"0b26f716-f234-4de4-a7dc-290f9c43dea4\" (UID: \"0b26f716-f234-4de4-a7dc-290f9c43dea4\") "
Nov 02 22:03:08.653946 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.653916    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b26f716-f234-4de4-a7dc-290f9c43dea4-bundle" pod "0b26f716-f234-4de4-a7dc-290f9c43dea4" (UID: "0b26f716-f234-4de4-a7dc-290f9c43dea4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:03:08.655458 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.655432    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b26f716-f234-4de4-a7dc-290f9c43dea4-kube-api-access-hkwrr" pod "0b26f716-f234-4de4-a7dc-290f9c43dea4" (UID: "0b26f716-f234-4de4-a7dc-290f9c43dea4"). InnerVolumeSpecName "kube-api-access-hkwrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:03:08.661965 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.661936    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b26f716-f234-4de4-a7dc-290f9c43dea4-util" pod "0b26f716-f234-4de4-a7dc-290f9c43dea4" (UID: "0b26f716-f234-4de4-a7dc-290f9c43dea4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:03:08.715865 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.715783    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:08.753872 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.753842    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bed5557-fd36-4224-9178-f26d7734fd2c-bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bed5557-fd36-4224-9178-f26d7734fd2c-bundle\") pod \"5bed5557-fd36-4224-9178-f26d7734fd2c\" (UID: \"5bed5557-fd36-4224-9178-f26d7734fd2c\") "
Nov 02 22:03:08.754038 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.753929    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bed5557-fd36-4224-9178-f26d7734fd2c-util\" (UniqueName: \"kubernetes.io/empty-dir/5bed5557-fd36-4224-9178-f26d7734fd2c-util\") pod \"5bed5557-fd36-4224-9178-f26d7734fd2c\" (UID: \"5bed5557-fd36-4224-9178-f26d7734fd2c\") "
Nov 02 22:03:08.754038 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.753967    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5bed5557-fd36-4224-9178-f26d7734fd2c-kube-api-access-nzf78\" (UniqueName: \"kubernetes.io/projected/5bed5557-fd36-4224-9178-f26d7734fd2c-kube-api-access-nzf78\") pod \"5bed5557-fd36-4224-9178-f26d7734fd2c\" (UID: \"5bed5557-fd36-4224-9178-f26d7734fd2c\") "
Nov 02 22:03:08.754250 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.754206    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkwrr\" (UniqueName: \"kubernetes.io/projected/0b26f716-f234-4de4-a7dc-290f9c43dea4-kube-api-access-hkwrr\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:08.754369 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.754253    5076 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b26f716-f234-4de4-a7dc-290f9c43dea4-util\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:08.754369 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.754267    5076 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b26f716-f234-4de4-a7dc-290f9c43dea4-bundle\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:08.754369 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.754308    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bed5557-fd36-4224-9178-f26d7734fd2c-bundle" pod "5bed5557-fd36-4224-9178-f26d7734fd2c" (UID: "5bed5557-fd36-4224-9178-f26d7734fd2c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:03:08.755961 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.755930    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bed5557-fd36-4224-9178-f26d7734fd2c-kube-api-access-nzf78" pod "5bed5557-fd36-4224-9178-f26d7734fd2c" (UID: "5bed5557-fd36-4224-9178-f26d7734fd2c"). InnerVolumeSpecName "kube-api-access-nzf78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:03:08.758972 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.758950    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bed5557-fd36-4224-9178-f26d7734fd2c-util" pod "5bed5557-fd36-4224-9178-f26d7734fd2c" (UID: "5bed5557-fd36-4224-9178-f26d7734fd2c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:03:08.820084 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.820052    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:08.854802 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.854776    5076 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bed5557-fd36-4224-9178-f26d7734fd2c-bundle\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:08.854802 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.854799    5076 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bed5557-fd36-4224-9178-f26d7734fd2c-util\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:08.854802 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:08.854809    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzf78\" (UniqueName: \"kubernetes.io/projected/5bed5557-fd36-4224-9178-f26d7734fd2c-kube-api-access-nzf78\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:03:09.326846 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.326760    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:09.437986 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.437959    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn"
Nov 02 22:03:09.438312 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.437958    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644fc9sn" event={"ID":"5bed5557-fd36-4224-9178-f26d7734fd2c","Type":"ContainerDied","Data":"0ed360176a98d9f17c086dbaba553503bae34196c73b2e7a5e006059e5f1fc48"}
Nov 02 22:03:09.438312 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.438080    5076 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ed360176a98d9f17c086dbaba553503bae34196c73b2e7a5e006059e5f1fc48"
Nov 02 22:03:09.440205 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.440175    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj" event={"ID":"0b26f716-f234-4de4-a7dc-290f9c43dea4","Type":"ContainerDied","Data":"877b7d43f9f00ad9d83ce425d2786e144e371b99a471925ba84c1067c05ceeab"}
Nov 02 22:03:09.440371 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.440243    5076 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="877b7d43f9f00ad9d83ce425d2786e144e371b99a471925ba84c1067c05ceeab"
Nov 02 22:03:09.440371 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.440306    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar8lxj"
Nov 02 22:03:09.456378 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456352    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"]
Nov 02 22:03:09.456616 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456604    5076 cpu_manager.go:414] "containerMap: removing container" podUID="6b9feef8-7f68-4689-b53d-f00eac54b2e3" containerName="pull"
Nov 02 22:03:09.456658 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456618    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6b9feef8-7f68-4689-b53d-f00eac54b2e3" containerName="pull"
Nov 02 22:03:09.456658 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456627    5076 cpu_manager.go:414] "containerMap: removing container" podUID="6f3d838a-2725-438b-abda-128cf718aefa" containerName="pull"
Nov 02 22:03:09.456658 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456632    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f3d838a-2725-438b-abda-128cf718aefa" containerName="pull"
Nov 02 22:03:09.456658 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456642    5076 cpu_manager.go:414] "containerMap: removing container" podUID="6536e3ee-5772-44c3-bac1-8303af3426f5" containerName="pull"
Nov 02 22:03:09.456658 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456650    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6536e3ee-5772-44c3-bac1-8303af3426f5" containerName="pull"
Nov 02 22:03:09.456658 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456658    5076 cpu_manager.go:414] "containerMap: removing container" podUID="0b26f716-f234-4de4-a7dc-290f9c43dea4" containerName="extract"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456663    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0b26f716-f234-4de4-a7dc-290f9c43dea4" containerName="extract"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456670    5076 cpu_manager.go:414] "containerMap: removing container" podUID="6536e3ee-5772-44c3-bac1-8303af3426f5" containerName="extract"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456674    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6536e3ee-5772-44c3-bac1-8303af3426f5" containerName="extract"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456681    5076 cpu_manager.go:414] "containerMap: removing container" podUID="5bed5557-fd36-4224-9178-f26d7734fd2c" containerName="extract"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456685    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5bed5557-fd36-4224-9178-f26d7734fd2c" containerName="extract"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456694    5076 cpu_manager.go:414] "containerMap: removing container" podUID="ca59114b-c02c-44e7-b02a-ec8d89df7fea" containerName="util"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456698    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca59114b-c02c-44e7-b02a-ec8d89df7fea" containerName="util"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456705    5076 cpu_manager.go:414] "containerMap: removing container" podUID="6b9feef8-7f68-4689-b53d-f00eac54b2e3" containerName="util"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456709    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6b9feef8-7f68-4689-b53d-f00eac54b2e3" containerName="util"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456718    5076 cpu_manager.go:414] "containerMap: removing container" podUID="e4faf0e1-4048-4266-a419-328b0dc0ed80" containerName="pull"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456724    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e4faf0e1-4048-4266-a419-328b0dc0ed80" containerName="pull"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456733    5076 cpu_manager.go:414] "containerMap: removing container" podUID="6b9feef8-7f68-4689-b53d-f00eac54b2e3" containerName="extract"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456738    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6b9feef8-7f68-4689-b53d-f00eac54b2e3" containerName="extract"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456746    5076 cpu_manager.go:414] "containerMap: removing container" podUID="5bed5557-fd36-4224-9178-f26d7734fd2c" containerName="util"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456751    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5bed5557-fd36-4224-9178-f26d7734fd2c" containerName="util"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456756    5076 cpu_manager.go:414] "containerMap: removing container" podUID="ffec8411-50ac-484e-85f9-a1dc11101f56" containerName="util"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456760    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ffec8411-50ac-484e-85f9-a1dc11101f56" containerName="util"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456767    5076 cpu_manager.go:414] "containerMap: removing container" podUID="591e1b9e-3cde-423f-8f10-aeada52e4087" containerName="util"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456773    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="591e1b9e-3cde-423f-8f10-aeada52e4087" containerName="util"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456783    5076 cpu_manager.go:414] "containerMap: removing container" podUID="e4faf0e1-4048-4266-a419-328b0dc0ed80" containerName="util"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456789    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e4faf0e1-4048-4266-a419-328b0dc0ed80" containerName="util"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456801    5076 cpu_manager.go:414] "containerMap: removing container" podUID="e4faf0e1-4048-4266-a419-328b0dc0ed80" containerName="extract"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456808    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e4faf0e1-4048-4266-a419-328b0dc0ed80" containerName="extract"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456818    5076 cpu_manager.go:414] "containerMap: removing container" podUID="ca59114b-c02c-44e7-b02a-ec8d89df7fea" containerName="pull"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456823    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca59114b-c02c-44e7-b02a-ec8d89df7fea" containerName="pull"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456833    5076 cpu_manager.go:414] "containerMap: removing container" podUID="591e1b9e-3cde-423f-8f10-aeada52e4087" containerName="pull"
Nov 02 22:03:09.456828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456837    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="591e1b9e-3cde-423f-8f10-aeada52e4087" containerName="pull"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456845    5076 cpu_manager.go:414] "containerMap: removing container" podUID="0b26f716-f234-4de4-a7dc-290f9c43dea4" containerName="util"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456849    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0b26f716-f234-4de4-a7dc-290f9c43dea4" containerName="util"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456854    5076 cpu_manager.go:414] "containerMap: removing container" podUID="ffec8411-50ac-484e-85f9-a1dc11101f56" containerName="pull"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456858    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ffec8411-50ac-484e-85f9-a1dc11101f56" containerName="pull"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456864    5076 cpu_manager.go:414] "containerMap: removing container" podUID="ffec8411-50ac-484e-85f9-a1dc11101f56" containerName="extract"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456868    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ffec8411-50ac-484e-85f9-a1dc11101f56" containerName="extract"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456881    5076 cpu_manager.go:414] "containerMap: removing container" podUID="6f3d838a-2725-438b-abda-128cf718aefa" containerName="util"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456888    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f3d838a-2725-438b-abda-128cf718aefa" containerName="util"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456894    5076 cpu_manager.go:414] "containerMap: removing container" podUID="6536e3ee-5772-44c3-bac1-8303af3426f5" containerName="util"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456898    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6536e3ee-5772-44c3-bac1-8303af3426f5" containerName="util"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456903    5076 cpu_manager.go:414] "containerMap: removing container" podUID="0b26f716-f234-4de4-a7dc-290f9c43dea4" containerName="pull"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456907    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0b26f716-f234-4de4-a7dc-290f9c43dea4" containerName="pull"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456912    5076 cpu_manager.go:414] "containerMap: removing container" podUID="6f3d838a-2725-438b-abda-128cf718aefa" containerName="extract"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456917    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f3d838a-2725-438b-abda-128cf718aefa" containerName="extract"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456923    5076 cpu_manager.go:414] "containerMap: removing container" podUID="591e1b9e-3cde-423f-8f10-aeada52e4087" containerName="extract"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456927    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="591e1b9e-3cde-423f-8f10-aeada52e4087" containerName="extract"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456934    5076 cpu_manager.go:414] "containerMap: removing container" podUID="5bed5557-fd36-4224-9178-f26d7734fd2c" containerName="pull"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456938    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5bed5557-fd36-4224-9178-f26d7734fd2c" containerName="pull"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456943    5076 cpu_manager.go:414] "containerMap: removing container" podUID="ca59114b-c02c-44e7-b02a-ec8d89df7fea" containerName="extract"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456948    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca59114b-c02c-44e7-b02a-ec8d89df7fea" containerName="extract"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.456995    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="6b9feef8-7f68-4689-b53d-f00eac54b2e3" containerName="extract"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.457004    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="e4faf0e1-4048-4266-a419-328b0dc0ed80" containerName="extract"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.457011    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="ffec8411-50ac-484e-85f9-a1dc11101f56" containerName="extract"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.457017    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f3d838a-2725-438b-abda-128cf718aefa" containerName="extract"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.457022    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="591e1b9e-3cde-423f-8f10-aeada52e4087" containerName="extract"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.457027    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="ca59114b-c02c-44e7-b02a-ec8d89df7fea" containerName="extract"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.457033    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="0b26f716-f234-4de4-a7dc-290f9c43dea4" containerName="extract"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.457041    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="6536e3ee-5772-44c3-bac1-8303af3426f5" containerName="extract"
Nov 02 22:03:09.457603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.457048    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="5bed5557-fd36-4224-9178-f26d7734fd2c" containerName="extract"
Nov 02 22:03:09.488044 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.487907    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:09.489718 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.489695    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"]
Nov 02 22:03:09.492151 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.492121    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Nov 02 22:03:09.492298 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.492274    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-8qjb7\""
Nov 02 22:03:09.492369 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.492331    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Nov 02 22:03:09.492909 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.492891    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Nov 02 22:03:09.493156 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.493144    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Nov 02 22:03:09.493198 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.493158    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Nov 02 22:03:09.634778 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.634741    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:09.660632 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.660600    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvn6t\" (UniqueName: \"kubernetes.io/projected/2bf38393-9b8f-4bed-a3bb-13730a3c1c9c-kube-api-access-rvn6t\") pod \"opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr\" (UID: \"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:09.660753 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.660640    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bf38393-9b8f-4bed-a3bb-13730a3c1c9c-tmp\") pod \"opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr\" (UID: \"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:09.660753 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.660726    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2bf38393-9b8f-4bed-a3bb-13730a3c1c9c-metrics-cert\") pod \"opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr\" (UID: \"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:09.660884 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.660769    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2bf38393-9b8f-4bed-a3bb-13730a3c1c9c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr\" (UID: \"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:09.660884 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.660865    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2bf38393-9b8f-4bed-a3bb-13730a3c1c9c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr\" (UID: \"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:09.660983 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.660905    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2bf38393-9b8f-4bed-a3bb-13730a3c1c9c-manifests\") pod \"opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr\" (UID: \"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:09.734678 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.734638    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:09.761603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.761575    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2bf38393-9b8f-4bed-a3bb-13730a3c1c9c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr\" (UID: \"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:09.761801 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.761610    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2bf38393-9b8f-4bed-a3bb-13730a3c1c9c-manifests\") pod \"opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr\" (UID: \"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:09.761801 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.761674    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvn6t\" (UniqueName: \"kubernetes.io/projected/2bf38393-9b8f-4bed-a3bb-13730a3c1c9c-kube-api-access-rvn6t\") pod \"opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr\" (UID: \"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:09.761801 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.761700    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bf38393-9b8f-4bed-a3bb-13730a3c1c9c-tmp\") pod \"opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr\" (UID: \"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:09.761801 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.761737    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2bf38393-9b8f-4bed-a3bb-13730a3c1c9c-metrics-cert\") pod \"opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr\" (UID: \"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:09.761801 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.761776    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2bf38393-9b8f-4bed-a3bb-13730a3c1c9c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr\" (UID: \"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:09.762056 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.762036    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2bf38393-9b8f-4bed-a3bb-13730a3c1c9c-manifests\") pod \"opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr\" (UID: \"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:09.764127 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.764093    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bf38393-9b8f-4bed-a3bb-13730a3c1c9c-tmp\") pod \"opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr\" (UID: \"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:09.764127 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.764122    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2bf38393-9b8f-4bed-a3bb-13730a3c1c9c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr\" (UID: \"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:09.764320 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.764236    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2bf38393-9b8f-4bed-a3bb-13730a3c1c9c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr\" (UID: \"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:09.764320 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.764234    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2bf38393-9b8f-4bed-a3bb-13730a3c1c9c-metrics-cert\") pod \"opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr\" (UID: \"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:09.769436 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.769417    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvn6t\" (UniqueName: \"kubernetes.io/projected/2bf38393-9b8f-4bed-a3bb-13730a3c1c9c-kube-api-access-rvn6t\") pod \"opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr\" (UID: \"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:09.837750 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.837712    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:09.842249 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.842204    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:09.939083 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:09.939048    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:10.159788 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:10.159762    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"]
Nov 02 22:03:10.166176 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:03:10.166115    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bf38393_9b8f_4bed_a3bb_13730a3c1c9c.slice/crio-2fca1bb1fcc027b4a9a486d65b23fd40aa3af92ed5c22701a50b1e0065b920c4 WatchSource:0}: Error finding container 2fca1bb1fcc027b4a9a486d65b23fd40aa3af92ed5c22701a50b1e0065b920c4: Status 404 returned error can't find the container with id 2fca1bb1fcc027b4a9a486d65b23fd40aa3af92ed5c22701a50b1e0065b920c4
Nov 02 22:03:10.446084 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:10.446015    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr" event={"ID":"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c","Type":"ContainerStarted","Data":"2fca1bb1fcc027b4a9a486d65b23fd40aa3af92ed5c22701a50b1e0065b920c4"}
Nov 02 22:03:10.728712 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:10.728627    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:12.549179 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:12.549132    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:12.649409 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:12.649366    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:15.927673 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:15.927634    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:19.107019 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:19.106986    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:19.201078 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:19.201041    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:19.330072 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:19.330041    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-sdjbx"]
Nov 02 22:03:19.333481 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:19.333465    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-sdjbx"
Nov 02 22:03:19.340438 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:19.340391    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Nov 02 22:03:19.340573 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:19.340474    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Nov 02 22:03:19.341887 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:19.341856    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-tfhrm\""
Nov 02 22:03:19.342299 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:19.342272    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-sdjbx"]
Nov 02 22:03:19.443960 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:19.443879    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skjld\" (UniqueName: \"kubernetes.io/projected/bc3565cb-9021-4e7c-bf61-70e83d593306-kube-api-access-skjld\") pod \"limitador-operator-controller-manager-5778bb4449-sdjbx\" (UID: \"bc3565cb-9021-4e7c-bf61-70e83d593306\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-sdjbx"
Nov 02 22:03:19.544777 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:19.544740    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skjld\" (UniqueName: \"kubernetes.io/projected/bc3565cb-9021-4e7c-bf61-70e83d593306-kube-api-access-skjld\") pod \"limitador-operator-controller-manager-5778bb4449-sdjbx\" (UID: \"bc3565cb-9021-4e7c-bf61-70e83d593306\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-sdjbx"
Nov 02 22:03:19.560846 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:19.560820    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skjld\" (UniqueName: \"kubernetes.io/projected/bc3565cb-9021-4e7c-bf61-70e83d593306-kube-api-access-skjld\") pod \"limitador-operator-controller-manager-5778bb4449-sdjbx\" (UID: \"bc3565cb-9021-4e7c-bf61-70e83d593306\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-sdjbx"
Nov 02 22:03:19.646711 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:19.646671    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-sdjbx"
Nov 02 22:03:19.922279 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:19.922254    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-sdjbx"]
Nov 02 22:03:19.924827 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:03:19.924803    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc3565cb_9021_4e7c_bf61_70e83d593306.slice/crio-06776c162e81d9775fd81d4522c0df70ad122557e36e99001c62842610d3da85 WatchSource:0}: Error finding container 06776c162e81d9775fd81d4522c0df70ad122557e36e99001c62842610d3da85: Status 404 returned error can't find the container with id 06776c162e81d9775fd81d4522c0df70ad122557e36e99001c62842610d3da85
Nov 02 22:03:19.927104 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:19.927080    5076 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 22:03:20.489996 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:20.489960    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-sdjbx" event={"ID":"bc3565cb-9021-4e7c-bf61-70e83d593306","Type":"ContainerStarted","Data":"06776c162e81d9775fd81d4522c0df70ad122557e36e99001c62842610d3da85"}
Nov 02 22:03:20.493581 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:20.493553    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:21.288802 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:21.288765    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:22.122330 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:22.122298    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:22.488251 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:22.488194    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:22.501778 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:22.501749    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr" event={"ID":"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c","Type":"ContainerStarted","Data":"2f59f664f7b56c92a2f468b7995af32af49508275fa832d91f310ecc5d0e03a0"}
Nov 02 22:03:23.508433 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:23.508395    5076 generic.go:356] "Generic (PLEG): container finished" podID="2bf38393-9b8f-4bed-a3bb-13730a3c1c9c" containerID="2f59f664f7b56c92a2f468b7995af32af49508275fa832d91f310ecc5d0e03a0" exitCode=0
Nov 02 22:03:23.508904 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:23.508469    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr" event={"ID":"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c","Type":"ContainerDied","Data":"2f59f664f7b56c92a2f468b7995af32af49508275fa832d91f310ecc5d0e03a0"}
Nov 02 22:03:24.514210 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:24.514171    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-sdjbx" event={"ID":"bc3565cb-9021-4e7c-bf61-70e83d593306","Type":"ContainerStarted","Data":"5e4ef056ba3fd2fd572fdbf139e62122d66c196b30216218243d80b440b5b229"}
Nov 02 22:03:24.514685 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:24.514381    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-sdjbx"
Nov 02 22:03:24.516375 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:24.516349    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr" event={"ID":"2bf38393-9b8f-4bed-a3bb-13730a3c1c9c","Type":"ContainerStarted","Data":"603dcd4071e49a0fb809c470a009ea627eef236cfb9bfaf9eb577e10fce5ef99"}
Nov 02 22:03:24.516490 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:24.516395    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:24.531729 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:24.531659    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-sdjbx" podStartSLOduration=1.181079413 podStartE2EDuration="5.531644993s" totalImagesPullingTime="4.35056558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:03:24.530326999 +0000 UTC m=+313.586661378" watchObservedRunningTime="2026-11-02 22:03:24.531644993 +0000 UTC m=+313.587979373"
Nov 02 22:03:24.562621 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:24.562573    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr" podStartSLOduration=2.619789302 podStartE2EDuration="15.562558376s" totalImagesPullingTime="12.387142681s" totalInitContainerRuntime="555.626393ms" isStatefulPod=false podCreationTimestamp="2026-11-02 22:03:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:03:24.55999454 +0000 UTC m=+313.616328932" watchObservedRunningTime="2026-11-02 22:03:24.562558376 +0000 UTC m=+313.618892757"
Nov 02 22:03:25.188768 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:25.188728    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:26.448889 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:26.448857    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-szkdt"]
Nov 02 22:03:26.452068 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:26.452050    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-szkdt"
Nov 02 22:03:26.463440 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:26.463408    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Nov 02 22:03:26.463440 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:26.463426    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-gwg5h\""
Nov 02 22:03:26.463440 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:26.463408    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Nov 02 22:03:26.465130 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:26.465108    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-szkdt"]
Nov 02 22:03:26.497198 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:26.497167    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6prx4\" (UniqueName: \"kubernetes.io/projected/bd56b66b-ece1-4c28-93f6-09cfb7ace2e7-kube-api-access-6prx4\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-szkdt\" (UID: \"bd56b66b-ece1-4c28-93f6-09cfb7ace2e7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-szkdt"
Nov 02 22:03:26.497347 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:26.497271    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd56b66b-ece1-4c28-93f6-09cfb7ace2e7-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-szkdt\" (UID: \"bd56b66b-ece1-4c28-93f6-09cfb7ace2e7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-szkdt"
Nov 02 22:03:26.598136 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:26.598102    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd56b66b-ece1-4c28-93f6-09cfb7ace2e7-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-szkdt\" (UID: \"bd56b66b-ece1-4c28-93f6-09cfb7ace2e7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-szkdt"
Nov 02 22:03:26.598297 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:26.598181    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6prx4\" (UniqueName: \"kubernetes.io/projected/bd56b66b-ece1-4c28-93f6-09cfb7ace2e7-kube-api-access-6prx4\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-szkdt\" (UID: \"bd56b66b-ece1-4c28-93f6-09cfb7ace2e7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-szkdt"
Nov 02 22:03:26.598503 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:26.598487    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd56b66b-ece1-4c28-93f6-09cfb7ace2e7-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-szkdt\" (UID: \"bd56b66b-ece1-4c28-93f6-09cfb7ace2e7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-szkdt"
Nov 02 22:03:26.606160 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:26.606138    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6prx4\" (UniqueName: \"kubernetes.io/projected/bd56b66b-ece1-4c28-93f6-09cfb7ace2e7-kube-api-access-6prx4\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-szkdt\" (UID: \"bd56b66b-ece1-4c28-93f6-09cfb7ace2e7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-szkdt"
Nov 02 22:03:26.762818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:26.762755    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-szkdt"
Nov 02 22:03:27.042438 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:27.042411    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-szkdt"]
Nov 02 22:03:27.044958 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:03:27.044928    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd56b66b_ece1_4c28_93f6_09cfb7ace2e7.slice/crio-58ebd0399d514dc6c0272a7d70ddf773e8c236f20d53162928d32c6a135368e3 WatchSource:0}: Error finding container 58ebd0399d514dc6c0272a7d70ddf773e8c236f20d53162928d32c6a135368e3: Status 404 returned error can't find the container with id 58ebd0399d514dc6c0272a7d70ddf773e8c236f20d53162928d32c6a135368e3
Nov 02 22:03:27.533583 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:27.533548    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-szkdt" event={"ID":"bd56b66b-ece1-4c28-93f6-09cfb7ace2e7","Type":"ContainerStarted","Data":"58ebd0399d514dc6c0272a7d70ddf773e8c236f20d53162928d32c6a135368e3"}
Nov 02 22:03:27.641511 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:27.641477    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d"]
Nov 02 22:03:27.648097 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:27.648077    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d"
Nov 02 22:03:27.659961 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:27.655134    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7kl6p\""
Nov 02 22:03:27.659961 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:27.659375    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d"]
Nov 02 22:03:27.708153 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:27.708125    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2ef0096-cac9-4843-9e28-ccbb91449558-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-bfs9d\" (UID: \"b2ef0096-cac9-4843-9e28-ccbb91449558\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d"
Nov 02 22:03:27.708309 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:27.708159    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6xx9\" (UniqueName: \"kubernetes.io/projected/b2ef0096-cac9-4843-9e28-ccbb91449558-kube-api-access-x6xx9\") pod \"kuadrant-operator-controller-manager-cf8469d7b-bfs9d\" (UID: \"b2ef0096-cac9-4843-9e28-ccbb91449558\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d"
Nov 02 22:03:27.741405 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:27.741372    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:27.809321 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:27.809255    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2ef0096-cac9-4843-9e28-ccbb91449558-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-bfs9d\" (UID: \"b2ef0096-cac9-4843-9e28-ccbb91449558\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d"
Nov 02 22:03:27.809321 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:27.809296    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6xx9\" (UniqueName: \"kubernetes.io/projected/b2ef0096-cac9-4843-9e28-ccbb91449558-kube-api-access-x6xx9\") pod \"kuadrant-operator-controller-manager-cf8469d7b-bfs9d\" (UID: \"b2ef0096-cac9-4843-9e28-ccbb91449558\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d"
Nov 02 22:03:27.809638 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:27.809619    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2ef0096-cac9-4843-9e28-ccbb91449558-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-bfs9d\" (UID: \"b2ef0096-cac9-4843-9e28-ccbb91449558\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d"
Nov 02 22:03:27.819373 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:27.819343    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6xx9\" (UniqueName: \"kubernetes.io/projected/b2ef0096-cac9-4843-9e28-ccbb91449558-kube-api-access-x6xx9\") pod \"kuadrant-operator-controller-manager-cf8469d7b-bfs9d\" (UID: \"b2ef0096-cac9-4843-9e28-ccbb91449558\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d"
Nov 02 22:03:27.843588 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:27.843561    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:27.943174 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:27.943129    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:27.968044 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:27.968002    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d"
Nov 02 22:03:28.257443 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:28.257297    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d"]
Nov 02 22:03:28.260330 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:03:28.260298    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ef0096_cac9_4843_9e28_ccbb91449558.slice/crio-4d170f676b528a271e36b16f1b5653498df4bb23aa82c423398bfea93ffa9913 WatchSource:0}: Error finding container 4d170f676b528a271e36b16f1b5653498df4bb23aa82c423398bfea93ffa9913: Status 404 returned error can't find the container with id 4d170f676b528a271e36b16f1b5653498df4bb23aa82c423398bfea93ffa9913
Nov 02 22:03:28.540985 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:28.540891    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d" event={"ID":"b2ef0096-cac9-4843-9e28-ccbb91449558","Type":"ContainerStarted","Data":"4d170f676b528a271e36b16f1b5653498df4bb23aa82c423398bfea93ffa9913"}
Nov 02 22:03:28.711031 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:28.710990    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:28.949625 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:28.949590    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:29.546504 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:29.546471    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-szkdt" event={"ID":"bd56b66b-ece1-4c28-93f6-09cfb7ace2e7","Type":"ContainerStarted","Data":"1f79366abb8fa463808daaca48b5cbfed85e016899ef80f6a52b8ed39ce951aa"}
Nov 02 22:03:29.568209 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:29.568163    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-szkdt" podStartSLOduration=1.137474523 podStartE2EDuration="3.56814888s" totalImagesPullingTime="2.430674357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:03:29.566036835 +0000 UTC m=+318.622371216" watchObservedRunningTime="2026-11-02 22:03:29.56814888 +0000 UTC m=+318.624483259"
Nov 02 22:03:29.888384 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:03:29.888349    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:03:30.843100 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:30.843064    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:31.266586 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:31.266552    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:31.384190 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:31.384156    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:32.733429 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:32.733396    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-6p4g4"]
Nov 02 22:03:32.737048 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:32.737032    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-6p4g4"
Nov 02 22:03:32.743881 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:32.743628    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5ctc\" (UniqueName: \"kubernetes.io/projected/8a3ea507-f664-4d36-b470-219f725b4022-kube-api-access-r5ctc\") pod \"authorino-operator-7b7bb4bc77-6p4g4\" (UID: \"8a3ea507-f664-4d36-b470-219f725b4022\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-6p4g4"
Nov 02 22:03:32.746626 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:32.746137    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-6p4g4"]
Nov 02 22:03:32.748327 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:32.748298    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-lv7n6\""
Nov 02 22:03:32.844365 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:32.844333    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5ctc\" (UniqueName: \"kubernetes.io/projected/8a3ea507-f664-4d36-b470-219f725b4022-kube-api-access-r5ctc\") pod \"authorino-operator-7b7bb4bc77-6p4g4\" (UID: \"8a3ea507-f664-4d36-b470-219f725b4022\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-6p4g4"
Nov 02 22:03:32.852629 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:32.852607    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5ctc\" (UniqueName: \"kubernetes.io/projected/8a3ea507-f664-4d36-b470-219f725b4022-kube-api-access-r5ctc\") pod \"authorino-operator-7b7bb4bc77-6p4g4\" (UID: \"8a3ea507-f664-4d36-b470-219f725b4022\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-6p4g4"
Nov 02 22:03:33.051721 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:33.051648    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-6p4g4"
Nov 02 22:03:33.125320 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:33.125284    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:33.312736 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:33.312644    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:33.326723 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:33.326700    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-6p4g4"]
Nov 02 22:03:33.328531 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:03:33.328491    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3ea507_f664_4d36_b470_219f725b4022.slice/crio-dac344843922a7c4dcf3ea32623960c9cfaddfc73fad23aefd4c4949423382d0 WatchSource:0}: Error finding container dac344843922a7c4dcf3ea32623960c9cfaddfc73fad23aefd4c4949423382d0: Status 404 returned error can't find the container with id dac344843922a7c4dcf3ea32623960c9cfaddfc73fad23aefd4c4949423382d0
Nov 02 22:03:33.566320 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:33.566235    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-6p4g4" event={"ID":"8a3ea507-f664-4d36-b470-219f725b4022","Type":"ContainerStarted","Data":"dac344843922a7c4dcf3ea32623960c9cfaddfc73fad23aefd4c4949423382d0"}
Nov 02 22:03:33.714704 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:33.714671    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:33.912371 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:33.912333    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:35.524150 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:35.524120    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-sdjbx"
Nov 02 22:03:35.524606 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:35.524364    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr"
Nov 02 22:03:36.748789 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:36.748735    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:37.026930 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:37.026857    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-fjj4r"]
Nov 02 22:03:37.030162 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:37.030144    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-fjj4r"
Nov 02 22:03:37.041983 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:37.041964    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lfwxz\""
Nov 02 22:03:37.041983 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:37.041965    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Nov 02 22:03:37.057566 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:37.057542    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-fjj4r"]
Nov 02 22:03:37.074068 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:37.074043    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqgdm\" (UniqueName: \"kubernetes.io/projected/4668a7b8-e3c2-4037-a38c-c21f0c7e0bc8-kube-api-access-jqgdm\") pod \"dns-operator-controller-manager-8557cbdb84-fjj4r\" (UID: \"4668a7b8-e3c2-4037-a38c-c21f0c7e0bc8\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-fjj4r"
Nov 02 22:03:37.174917 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:37.174881    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqgdm\" (UniqueName: \"kubernetes.io/projected/4668a7b8-e3c2-4037-a38c-c21f0c7e0bc8-kube-api-access-jqgdm\") pod \"dns-operator-controller-manager-8557cbdb84-fjj4r\" (UID: \"4668a7b8-e3c2-4037-a38c-c21f0c7e0bc8\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-fjj4r"
Nov 02 22:03:37.183350 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:37.183323    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqgdm\" (UniqueName: \"kubernetes.io/projected/4668a7b8-e3c2-4037-a38c-c21f0c7e0bc8-kube-api-access-jqgdm\") pod \"dns-operator-controller-manager-8557cbdb84-fjj4r\" (UID: \"4668a7b8-e3c2-4037-a38c-c21f0c7e0bc8\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-fjj4r"
Nov 02 22:03:37.346233 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:37.346145    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-fjj4r"
Nov 02 22:03:37.625195 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:37.625095    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-fjj4r"]
Nov 02 22:03:37.627362 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:03:37.627333    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4668a7b8_e3c2_4037_a38c_c21f0c7e0bc8.slice/crio-7e39a4689e4bc6f33fbe8fd1c7521262f29a76f115104cb26f46cd7c8eb600eb WatchSource:0}: Error finding container 7e39a4689e4bc6f33fbe8fd1c7521262f29a76f115104cb26f46cd7c8eb600eb: Status 404 returned error can't find the container with id 7e39a4689e4bc6f33fbe8fd1c7521262f29a76f115104cb26f46cd7c8eb600eb
Nov 02 22:03:38.593791 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:38.593754    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-fjj4r" event={"ID":"4668a7b8-e3c2-4037-a38c-c21f0c7e0bc8","Type":"ContainerStarted","Data":"7e39a4689e4bc6f33fbe8fd1c7521262f29a76f115104cb26f46cd7c8eb600eb"}
Nov 02 22:03:38.735103 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:38.735060    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:38.908172 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:38.908126    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:39.006595 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:39.006558    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:40.604755 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:40.604719    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-6p4g4" event={"ID":"8a3ea507-f664-4d36-b470-219f725b4022","Type":"ContainerStarted","Data":"370baf101a1124ffadd88ab3bd8e81ec2fefb4584824057b6d16e49fc50657bf"}
Nov 02 22:03:40.605240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:40.604892    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-6p4g4"
Nov 02 22:03:40.606391 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:40.606370    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-fjj4r" event={"ID":"4668a7b8-e3c2-4037-a38c-c21f0c7e0bc8","Type":"ContainerStarted","Data":"892aeabba16bf18797d14c0f558366b26b37006c98b21ca1bbaab9bb4bf9644f"}
Nov 02 22:03:40.606496 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:40.606459    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-fjj4r"
Nov 02 22:03:40.621273 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:40.621209    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-6p4g4" podStartSLOduration=2.139802532 podStartE2EDuration="8.621197652s" totalImagesPullingTime="6.48139512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:03:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:03:40.619783467 +0000 UTC m=+329.676117849" watchObservedRunningTime="2026-11-02 22:03:40.621197652 +0000 UTC m=+329.677532032"
Nov 02 22:03:40.636305 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:40.636262    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-fjj4r" podStartSLOduration=2.011807913 podStartE2EDuration="4.636249811s" totalImagesPullingTime="2.624441898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:03:40.634438477 +0000 UTC m=+329.690772848" watchObservedRunningTime="2026-11-02 22:03:40.636249811 +0000 UTC m=+329.692584190"
Nov 02 22:03:41.875505 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:41.875469    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:42.736782 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:42.736745    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:42.837208 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:42.837170    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:43.735818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:43.735775    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:43.862896 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:43.862868    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:43.963083 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:43.963045    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:44.895322 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:44.895289    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:44.979120 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:44.979080    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:50.355872 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:50.355831    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:50.464406 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:50.464368    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:50.694584 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:50.694508    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:50.868007 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:50.867972    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:50.868647 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:50.868624    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"]
Nov 02 22:03:50.876485 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:50.876467    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:50.887057 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:50.887030    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"]
Nov 02 22:03:50.887508 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:50.887482    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-rdd8g\""
Nov 02 22:03:50.964591 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:50.964517    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:50.991317 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:50.991288    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/219c8f92-c6fd-406a-9472-a414db84d828-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:50.991438 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:50.991321    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/219c8f92-c6fd-406a-9472-a414db84d828-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:50.991438 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:50.991360    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/219c8f92-c6fd-406a-9472-a414db84d828-istio-data\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:50.991529 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:50.991434    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/219c8f92-c6fd-406a-9472-a414db84d828-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:50.991529 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:50.991460    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/219c8f92-c6fd-406a-9472-a414db84d828-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:50.991594 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:50.991564    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/219c8f92-c6fd-406a-9472-a414db84d828-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:50.991637 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:50.991594    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbmsh\" (UniqueName: \"kubernetes.io/projected/219c8f92-c6fd-406a-9472-a414db84d828-kube-api-access-gbmsh\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:50.991675 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:50.991666    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/219c8f92-c6fd-406a-9472-a414db84d828-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:50.991717 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:50.991690    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/219c8f92-c6fd-406a-9472-a414db84d828-istio-token\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:51.064940 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.064907    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:51.092935 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.092896    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/219c8f92-c6fd-406a-9472-a414db84d828-istio-data\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:51.092935 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.092938    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/219c8f92-c6fd-406a-9472-a414db84d828-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:51.093153 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.092957    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/219c8f92-c6fd-406a-9472-a414db84d828-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:51.093153 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.092983    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/219c8f92-c6fd-406a-9472-a414db84d828-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:51.093153 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.093015    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbmsh\" (UniqueName: \"kubernetes.io/projected/219c8f92-c6fd-406a-9472-a414db84d828-kube-api-access-gbmsh\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:51.093153 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.093082    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/219c8f92-c6fd-406a-9472-a414db84d828-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:51.093153 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.093115    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/219c8f92-c6fd-406a-9472-a414db84d828-istio-token\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:51.093153 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.093142    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/219c8f92-c6fd-406a-9472-a414db84d828-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:51.093525 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.093165    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/219c8f92-c6fd-406a-9472-a414db84d828-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:51.093525 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.093346    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/219c8f92-c6fd-406a-9472-a414db84d828-istio-data\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:51.093638 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.093581    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/219c8f92-c6fd-406a-9472-a414db84d828-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:51.093696 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.093639    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/219c8f92-c6fd-406a-9472-a414db84d828-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:51.093749 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.093721    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/219c8f92-c6fd-406a-9472-a414db84d828-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:51.094034 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.094010    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/219c8f92-c6fd-406a-9472-a414db84d828-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:51.095639 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.095607    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/219c8f92-c6fd-406a-9472-a414db84d828-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:51.095733 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.095705    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/219c8f92-c6fd-406a-9472-a414db84d828-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:51.101127 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.101097    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbmsh\" (UniqueName: \"kubernetes.io/projected/219c8f92-c6fd-406a-9472-a414db84d828-kube-api-access-gbmsh\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:51.101554 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.101538    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/219c8f92-c6fd-406a-9472-a414db84d828-istio-token\") pod \"data-science-gateway-data-science-gateway-class-55fd48578969dh5\" (UID: \"219c8f92-c6fd-406a-9472-a414db84d828\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:51.190858 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.190830    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:51.479013 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.478990    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"]
Nov 02 22:03:51.480961 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:03:51.480933    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod219c8f92_c6fd_406a_9472_a414db84d828.slice/crio-e3076aba33ffbe802d60979a6453bd908beca1c0574ca89e04d79c23d8d72662 WatchSource:0}: Error finding container e3076aba33ffbe802d60979a6453bd908beca1c0574ca89e04d79c23d8d72662: Status 404 returned error can't find the container with id e3076aba33ffbe802d60979a6453bd908beca1c0574ca89e04d79c23d8d72662
Nov 02 22:03:51.483595 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.483555    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:03:51.483678 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.483640    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:03:51.483716 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.483681    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:03:51.612851 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.612814    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-fjj4r"
Nov 02 22:03:51.613031 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.612984    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-6p4g4"
Nov 02 22:03:51.662752 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.662706    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5" event={"ID":"219c8f92-c6fd-406a-9472-a414db84d828","Type":"ContainerStarted","Data":"747029fbfdf68f70cdac1766c559e726521b3657add6a5cdd6c3b1d669684344"}
Nov 02 22:03:51.662914 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.662766    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5" event={"ID":"219c8f92-c6fd-406a-9472-a414db84d828","Type":"ContainerStarted","Data":"e3076aba33ffbe802d60979a6453bd908beca1c0574ca89e04d79c23d8d72662"}
Nov 02 22:03:51.689725 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.689670    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5" podStartSLOduration=1.689651075 podStartE2EDuration="1.689651075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:03:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:03:51.687039358 +0000 UTC m=+340.743373738" watchObservedRunningTime="2026-11-02 22:03:51.689651075 +0000 UTC m=+340.745985456"
Nov 02 22:03:51.885424 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.885393    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-597b95cb84-24r75"]
Nov 02 22:03:51.889034 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.889017    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-24r75"
Nov 02 22:03:51.896564 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.896532    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Nov 02 22:03:51.896702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.896676    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Nov 02 22:03:51.896869 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.896853    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-2wm2n\""
Nov 02 22:03:51.897119 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.897092    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-24r75"]
Nov 02 22:03:51.998889 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:51.998856    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:52.001920 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:52.001891    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eccb8672-d8bb-4f10-9918-e02ca022e958-bound-sa-token\") pod \"cert-manager-597b95cb84-24r75\" (UID: \"eccb8672-d8bb-4f10-9918-e02ca022e958\") " pod="cert-manager/cert-manager-597b95cb84-24r75"
Nov 02 22:03:52.002016 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:52.002000    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7958\" (UniqueName: \"kubernetes.io/projected/eccb8672-d8bb-4f10-9918-e02ca022e958-kube-api-access-c7958\") pod \"cert-manager-597b95cb84-24r75\" (UID: \"eccb8672-d8bb-4f10-9918-e02ca022e958\") " pod="cert-manager/cert-manager-597b95cb84-24r75"
Nov 02 22:03:52.103035 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:52.102999    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7958\" (UniqueName: \"kubernetes.io/projected/eccb8672-d8bb-4f10-9918-e02ca022e958-kube-api-access-c7958\") pod \"cert-manager-597b95cb84-24r75\" (UID: \"eccb8672-d8bb-4f10-9918-e02ca022e958\") " pod="cert-manager/cert-manager-597b95cb84-24r75"
Nov 02 22:03:52.103174 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:52.103052    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eccb8672-d8bb-4f10-9918-e02ca022e958-bound-sa-token\") pod \"cert-manager-597b95cb84-24r75\" (UID: \"eccb8672-d8bb-4f10-9918-e02ca022e958\") " pod="cert-manager/cert-manager-597b95cb84-24r75"
Nov 02 22:03:52.112330 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:52.112304    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eccb8672-d8bb-4f10-9918-e02ca022e958-bound-sa-token\") pod \"cert-manager-597b95cb84-24r75\" (UID: \"eccb8672-d8bb-4f10-9918-e02ca022e958\") " pod="cert-manager/cert-manager-597b95cb84-24r75"
Nov 02 22:03:52.112522 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:52.112501    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7958\" (UniqueName: \"kubernetes.io/projected/eccb8672-d8bb-4f10-9918-e02ca022e958-kube-api-access-c7958\") pod \"cert-manager-597b95cb84-24r75\" (UID: \"eccb8672-d8bb-4f10-9918-e02ca022e958\") " pod="cert-manager/cert-manager-597b95cb84-24r75"
Nov 02 22:03:52.190994 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:52.190920    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:52.195527 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:52.195504    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:52.212324 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:52.212301    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-24r75"
Nov 02 22:03:52.492418 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:52.492388    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-24r75"]
Nov 02 22:03:52.493942 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:03:52.493915    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeccb8672_d8bb_4f10_9918_e02ca022e958.slice/crio-2ee7055e13cf6ba262bb08087ad7366ffeaca4b204ea8058a01996f38cab3a33 WatchSource:0}: Error finding container 2ee7055e13cf6ba262bb08087ad7366ffeaca4b204ea8058a01996f38cab3a33: Status 404 returned error can't find the container with id 2ee7055e13cf6ba262bb08087ad7366ffeaca4b204ea8058a01996f38cab3a33
Nov 02 22:03:52.668984 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:52.668944    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-24r75" event={"ID":"eccb8672-d8bb-4f10-9918-e02ca022e958","Type":"ContainerStarted","Data":"2ee7055e13cf6ba262bb08087ad7366ffeaca4b204ea8058a01996f38cab3a33"}
Nov 02 22:03:52.669165 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:52.669149    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:52.670175 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:52.670153    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-55fd48578969dh5"
Nov 02 22:03:52.818203 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:52.818097    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:52.919467 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:52.919434    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:53.019644 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:53.019603    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:53.943534 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:53.943494    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf"]
Nov 02 22:03:53.947210 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:53.947186    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf"
Nov 02 22:03:53.953840 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:53.953813    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-tmzpv\""
Nov 02 22:03:53.955671 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:53.955626    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Nov 02 22:03:53.956545 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:53.956332    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Nov 02 22:03:53.959630 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:53.959607    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\""
Nov 02 22:03:53.961343 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:53.961283    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf"]
Nov 02 22:03:54.020828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:54.020785    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-tpqbf\" (UID: \"ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf"
Nov 02 22:03:54.020995 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:54.020840    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-tpqbf\" (UID: \"ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf"
Nov 02 22:03:54.020995 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:54.020885    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-tpqbf\" (UID: \"ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf"
Nov 02 22:03:54.020995 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:54.020946    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wshjx\" (UniqueName: \"kubernetes.io/projected/ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31-kube-api-access-wshjx\") pod \"kserve-module-controller-manager-7566cf5fc8-tpqbf\" (UID: \"ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf"
Nov 02 22:03:54.121751 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:54.121378    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-tpqbf\" (UID: \"ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf"
Nov 02 22:03:54.121751 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:54.121471    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wshjx\" (UniqueName: \"kubernetes.io/projected/ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31-kube-api-access-wshjx\") pod \"kserve-module-controller-manager-7566cf5fc8-tpqbf\" (UID: \"ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf"
Nov 02 22:03:54.121751 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:54.121505    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-tpqbf\" (UID: \"ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf"
Nov 02 22:03:54.121751 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:54.121532    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-tpqbf\" (UID: \"ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf"
Nov 02 22:03:54.122105 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:54.121841    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-tpqbf\" (UID: \"ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf"
Nov 02 22:03:54.122376 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:54.122350    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-tpqbf\" (UID: \"ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf"
Nov 02 22:03:54.122880 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:54.122859    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-tpqbf\" (UID: \"ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf"
Nov 02 22:03:54.130184 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:54.130160    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wshjx\" (UniqueName: \"kubernetes.io/projected/ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31-kube-api-access-wshjx\") pod \"kserve-module-controller-manager-7566cf5fc8-tpqbf\" (UID: \"ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf"
Nov 02 22:03:54.263861 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:54.263787    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf"
Nov 02 22:03:54.565051 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:54.564951    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf"]
Nov 02 22:03:54.567740 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:03:54.567707    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccb79fe1_02f1_4cb1_a2e6_67852d4d9c31.slice/crio-0b1e82e2383b8f36ef0b01d4bf22f66f8c10d4995829bc80f59f753c43468beb WatchSource:0}: Error finding container 0b1e82e2383b8f36ef0b01d4bf22f66f8c10d4995829bc80f59f753c43468beb: Status 404 returned error can't find the container with id 0b1e82e2383b8f36ef0b01d4bf22f66f8c10d4995829bc80f59f753c43468beb
Nov 02 22:03:54.682055 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:54.681977    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf" event={"ID":"ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31","Type":"ContainerStarted","Data":"0b1e82e2383b8f36ef0b01d4bf22f66f8c10d4995829bc80f59f753c43468beb"}
Nov 02 22:03:55.355491 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:55.355456    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:55.455621 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:55.455582    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:55.692825 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:55.692735    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d" event={"ID":"b2ef0096-cac9-4843-9e28-ccbb91449558","Type":"ContainerStarted","Data":"eac418ac4ef782c37960f79aa6f58ce1823487af52a296aa2ebd142496fa176e"}
Nov 02 22:03:55.693316 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:55.693294    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d"
Nov 02 22:03:55.717536 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:55.717476    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d" podStartSLOduration=2.006203365 podStartE2EDuration="28.717457098s" totalImagesPullingTime="26.711253733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:03:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:03:55.713498283 +0000 UTC m=+344.769832665" watchObservedRunningTime="2026-11-02 22:03:55.717457098 +0000 UTC m=+344.773791478"
Nov 02 22:03:56.391729 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:56.391693    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:56.492647 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:56.492558    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:56.699774 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:56.699693    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-24r75" event={"ID":"eccb8672-d8bb-4f10-9918-e02ca022e958","Type":"ContainerStarted","Data":"0b017b6109f4d6a82b47f4379b072b6210a58fdff7414dfffdc93888104a8be2"}
Nov 02 22:03:56.719901 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:56.719842    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-597b95cb84-24r75" podStartSLOduration=2.377879413 podStartE2EDuration="5.719826568s" totalImagesPullingTime="3.341947155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:03:56.717400106 +0000 UTC m=+345.773734486" watchObservedRunningTime="2026-11-02 22:03:56.719826568 +0000 UTC m=+345.776160948"
Nov 02 22:03:57.539474 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:57.539395    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-sl8xb"]
Nov 02 22:03:57.541593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:57.541569    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-sl8xb"
Nov 02 22:03:57.551121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:57.551096    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-sl8xb"]
Nov 02 22:03:57.554659 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:57.554629    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:57.627761 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:57.627731    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vjchw\""
Nov 02 22:03:57.643064 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:57.638666    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-sl8xb"]
Nov 02 22:03:57.643676 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:57.643651    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Nov 02 22:03:57.657986 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:57.657952    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba6f6213-7c92-479e-b5b2-a659d68c477c-config-file\") pod \"limitador-limitador-74dfcfb894-sl8xb\" (UID: \"ba6f6213-7c92-479e-b5b2-a659d68c477c\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-sl8xb"
Nov 02 22:03:57.658094 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:57.657997    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcf2x\" (UniqueName: \"kubernetes.io/projected/ba6f6213-7c92-479e-b5b2-a659d68c477c-kube-api-access-bcf2x\") pod \"limitador-limitador-74dfcfb894-sl8xb\" (UID: \"ba6f6213-7c92-479e-b5b2-a659d68c477c\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-sl8xb"
Nov 02 22:03:57.665019 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:57.664986    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:57.706196 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:57.706162    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf" event={"ID":"ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31","Type":"ContainerStarted","Data":"5d4f936fc6de4ca688f1e67ccaf6678ad60686d592f3994474e8557340e2c176"}
Nov 02 22:03:57.706361 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:57.706344    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf"
Nov 02 22:03:57.724925 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:57.724884    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf" podStartSLOduration=2.014993229 podStartE2EDuration="4.724871816s" totalImagesPullingTime="2.709878587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:03:57.723750111 +0000 UTC m=+346.780084493" watchObservedRunningTime="2026-11-02 22:03:57.724871816 +0000 UTC m=+346.781206196"
Nov 02 22:03:57.759019 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:57.758984    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba6f6213-7c92-479e-b5b2-a659d68c477c-config-file\") pod \"limitador-limitador-74dfcfb894-sl8xb\" (UID: \"ba6f6213-7c92-479e-b5b2-a659d68c477c\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-sl8xb"
Nov 02 22:03:57.759171 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:57.759023    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcf2x\" (UniqueName: \"kubernetes.io/projected/ba6f6213-7c92-479e-b5b2-a659d68c477c-kube-api-access-bcf2x\") pod \"limitador-limitador-74dfcfb894-sl8xb\" (UID: \"ba6f6213-7c92-479e-b5b2-a659d68c477c\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-sl8xb"
Nov 02 22:03:57.759716 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:57.759694    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba6f6213-7c92-479e-b5b2-a659d68c477c-config-file\") pod \"limitador-limitador-74dfcfb894-sl8xb\" (UID: \"ba6f6213-7c92-479e-b5b2-a659d68c477c\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-sl8xb"
Nov 02 22:03:57.764722 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:57.764680    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:57.767262 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:57.767238    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcf2x\" (UniqueName: \"kubernetes.io/projected/ba6f6213-7c92-479e-b5b2-a659d68c477c-kube-api-access-bcf2x\") pod \"limitador-limitador-74dfcfb894-sl8xb\" (UID: \"ba6f6213-7c92-479e-b5b2-a659d68c477c\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-sl8xb"
Nov 02 22:03:57.853550 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:57.853524    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-sl8xb"
Nov 02 22:03:57.939429 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:57.939390    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:58.129702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.129679    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-sl8xb"]
Nov 02 22:03:58.132023 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:03:58.131995    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba6f6213_7c92_479e_b5b2_a659d68c477c.slice/crio-5490cdc0093de5290527cb77383e97f517c0ff60d621379bb6da12fcea6bbb98 WatchSource:0}: Error finding container 5490cdc0093de5290527cb77383e97f517c0ff60d621379bb6da12fcea6bbb98: Status 404 returned error can't find the container with id 5490cdc0093de5290527cb77383e97f517c0ff60d621379bb6da12fcea6bbb98
Nov 02 22:03:58.176434 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.176401    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:58.325118 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.325084    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-fmf7s"]
Nov 02 22:03:58.328032 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.328004    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-fmf7s"
Nov 02 22:03:58.334307 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.334262    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fppbs\""
Nov 02 22:03:58.335313 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.335291    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-fmf7s"]
Nov 02 22:03:58.372974 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.372942    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:58.464782 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.464705    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt7j2\" (UniqueName: \"kubernetes.io/projected/1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772-kube-api-access-gt7j2\") pod \"authorino-57f7f8659f-fmf7s\" (UID: \"1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772\") " pod="kuadrant-system/authorino-57f7f8659f-fmf7s"
Nov 02 22:03:58.472723 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.472691    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:58.565720 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.565679    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt7j2\" (UniqueName: \"kubernetes.io/projected/1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772-kube-api-access-gt7j2\") pod \"authorino-57f7f8659f-fmf7s\" (UID: \"1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772\") " pod="kuadrant-system/authorino-57f7f8659f-fmf7s"
Nov 02 22:03:58.568195 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.568170    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-jc8z9"]
Nov 02 22:03:58.570290 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.570272    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-jc8z9"
Nov 02 22:03:58.577102 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.577082    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt7j2\" (UniqueName: \"kubernetes.io/projected/1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772-kube-api-access-gt7j2\") pod \"authorino-57f7f8659f-fmf7s\" (UID: \"1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772\") " pod="kuadrant-system/authorino-57f7f8659f-fmf7s"
Nov 02 22:03:58.579301 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.579279    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-jc8z9"]
Nov 02 22:03:58.639946 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.639917    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-fmf7s"
Nov 02 22:03:58.666165 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.666136    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w24zq\" (UniqueName: \"kubernetes.io/projected/1d4485e5-3432-4a5c-a279-a198a5ddcb1d-kube-api-access-w24zq\") pod \"authorino-56c6c9ddd5-jc8z9\" (UID: \"1d4485e5-3432-4a5c-a279-a198a5ddcb1d\") " pod="kuadrant-system/authorino-56c6c9ddd5-jc8z9"
Nov 02 22:03:58.714601 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.714564    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-sl8xb" event={"ID":"ba6f6213-7c92-479e-b5b2-a659d68c477c","Type":"ContainerStarted","Data":"5490cdc0093de5290527cb77383e97f517c0ff60d621379bb6da12fcea6bbb98"}
Nov 02 22:03:58.766650 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.766573    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w24zq\" (UniqueName: \"kubernetes.io/projected/1d4485e5-3432-4a5c-a279-a198a5ddcb1d-kube-api-access-w24zq\") pod \"authorino-56c6c9ddd5-jc8z9\" (UID: \"1d4485e5-3432-4a5c-a279-a198a5ddcb1d\") " pod="kuadrant-system/authorino-56c6c9ddd5-jc8z9"
Nov 02 22:03:58.774292 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.774268    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w24zq\" (UniqueName: \"kubernetes.io/projected/1d4485e5-3432-4a5c-a279-a198a5ddcb1d-kube-api-access-w24zq\") pod \"authorino-56c6c9ddd5-jc8z9\" (UID: \"1d4485e5-3432-4a5c-a279-a198a5ddcb1d\") " pod="kuadrant-system/authorino-56c6c9ddd5-jc8z9"
Nov 02 22:03:58.888356 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.888326    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-jc8z9"
Nov 02 22:03:58.910830 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:58.910802    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-fmf7s"]
Nov 02 22:03:58.912513 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:03:58.912491    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b4cb3b1_370c_4dc7_9c7c_50e0b4b48772.slice/crio-91250b764ca32a266fbda839072c478857f8655d621d8307bd66201585000e0c WatchSource:0}: Error finding container 91250b764ca32a266fbda839072c478857f8655d621d8307bd66201585000e0c: Status 404 returned error can't find the container with id 91250b764ca32a266fbda839072c478857f8655d621d8307bd66201585000e0c
Nov 02 22:03:59.180891 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:59.180867    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-jc8z9"]
Nov 02 22:03:59.182807 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:03:59.182781    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d4485e5_3432_4a5c_a279_a198a5ddcb1d.slice/crio-ccf0398461bb72e4ade98109c1aebdad585da4b23ae228fad0e7e29de646fca0 WatchSource:0}: Error finding container ccf0398461bb72e4ade98109c1aebdad585da4b23ae228fad0e7e29de646fca0: Status 404 returned error can't find the container with id ccf0398461bb72e4ade98109c1aebdad585da4b23ae228fad0e7e29de646fca0
Nov 02 22:03:59.721906 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:59.721863    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-jc8z9" event={"ID":"1d4485e5-3432-4a5c-a279-a198a5ddcb1d","Type":"ContainerStarted","Data":"ccf0398461bb72e4ade98109c1aebdad585da4b23ae228fad0e7e29de646fca0"}
Nov 02 22:03:59.723322 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:59.723289    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-fmf7s" event={"ID":"1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772","Type":"ContainerStarted","Data":"91250b764ca32a266fbda839072c478857f8655d621d8307bd66201585000e0c"}
Nov 02 22:03:59.734447 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:59.734419    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:59.841447 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:03:59.841419    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:03:59.887717 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:03:59.887685    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:04:00.733094 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:00.732616    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-sl8xb" event={"ID":"ba6f6213-7c92-479e-b5b2-a659d68c477c","Type":"ContainerStarted","Data":"844523e7ce999b988f26b3750afcce8a701e8ff6ead17541dcfc6d4c8c014b73"}
Nov 02 22:04:00.733094 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:00.732755    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-sl8xb"
Nov 02 22:04:01.739365 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:01.739322    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-fmf7s" event={"ID":"1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772","Type":"ContainerStarted","Data":"8633475fd5b362e06f15695e7bddd64c388ca7b293f407f778583b712789b539"}
Nov 02 22:04:01.740803 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:01.740778    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-jc8z9" event={"ID":"1d4485e5-3432-4a5c-a279-a198a5ddcb1d","Type":"ContainerStarted","Data":"a28f7eaef133df0aa139ed588fb13cb8360d5c6318017c8e9de24dfe52df95d4"}
Nov 02 22:04:01.754036 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:01.753991    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-fmf7s" podStartSLOduration=1.575227747 podStartE2EDuration="3.753979083s" totalImagesPullingTime="2.178751336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:04:01.753306747 +0000 UTC m=+350.809641126" watchObservedRunningTime="2026-11-02 22:04:01.753979083 +0000 UTC m=+350.810313460"
Nov 02 22:04:01.754811 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:01.754782    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-sl8xb" podStartSLOduration=3.063803269 podStartE2EDuration="4.754773038s" totalImagesPullingTime="1.690969769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:04:00.750369251 +0000 UTC m=+349.806703631" watchObservedRunningTime="2026-11-02 22:04:01.754773038 +0000 UTC m=+350.811107422"
Nov 02 22:04:01.771743 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:01.771695    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-jc8z9" podStartSLOduration=1.665278277 podStartE2EDuration="3.771686536s" totalImagesPullingTime="2.106408259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:04:01.771132169 +0000 UTC m=+350.827466546" watchObservedRunningTime="2026-11-02 22:04:01.771686536 +0000 UTC m=+350.828020915"
Nov 02 22:04:01.793676 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:01.793648    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-fmf7s"]
Nov 02 22:04:03.303408 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:03.303375    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:03.400513 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:03.400481    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:03.752896 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:03.752852    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-fmf7s" podUID="1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772" containerName="authorino" containerID="cri-o://8633475fd5b362e06f15695e7bddd64c388ca7b293f407f778583b712789b539" gracePeriod=30
Nov 02 22:04:03.991190 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:03.991165    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-fmf7s"
Nov 02 22:04:04.117849 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:04.117818    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772-kube-api-access-gt7j2\" (UniqueName: \"kubernetes.io/projected/1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772-kube-api-access-gt7j2\") pod \"1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772\" (UID: \"1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772\") "
Nov 02 22:04:04.120459 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:04.120421    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772-kube-api-access-gt7j2" pod "1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772" (UID: "1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772"). InnerVolumeSpecName "kube-api-access-gt7j2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:04:04.219316 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:04.219283    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gt7j2\" (UniqueName: \"kubernetes.io/projected/1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772-kube-api-access-gt7j2\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:04:04.758809 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:04.758777    5076 generic.go:356] "Generic (PLEG): container finished" podID="1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772" containerID="8633475fd5b362e06f15695e7bddd64c388ca7b293f407f778583b712789b539" exitCode=0
Nov 02 22:04:04.759324 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:04.758821    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-fmf7s" event={"ID":"1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772","Type":"ContainerDied","Data":"8633475fd5b362e06f15695e7bddd64c388ca7b293f407f778583b712789b539"}
Nov 02 22:04:04.759324 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:04.758840    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-fmf7s"
Nov 02 22:04:04.759324 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:04.758855    5076 scope.go:122] "RemoveContainer" containerID="8633475fd5b362e06f15695e7bddd64c388ca7b293f407f778583b712789b539"
Nov 02 22:04:04.759324 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:04.758846    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-fmf7s" event={"ID":"1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772","Type":"ContainerDied","Data":"91250b764ca32a266fbda839072c478857f8655d621d8307bd66201585000e0c"}
Nov 02 22:04:04.768405 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:04.768384    5076 scope.go:122] "RemoveContainer" containerID="8633475fd5b362e06f15695e7bddd64c388ca7b293f407f778583b712789b539"
Nov 02 22:04:04.768651 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:04:04.768633    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8633475fd5b362e06f15695e7bddd64c388ca7b293f407f778583b712789b539\": container with ID starting with 8633475fd5b362e06f15695e7bddd64c388ca7b293f407f778583b712789b539 not found: ID does not exist" containerID="8633475fd5b362e06f15695e7bddd64c388ca7b293f407f778583b712789b539"
Nov 02 22:04:04.768712 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:04.768658    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8633475fd5b362e06f15695e7bddd64c388ca7b293f407f778583b712789b539"} err="failed to get container status \"8633475fd5b362e06f15695e7bddd64c388ca7b293f407f778583b712789b539\": rpc error: code = NotFound desc = could not find container \"8633475fd5b362e06f15695e7bddd64c388ca7b293f407f778583b712789b539\": container with ID starting with 8633475fd5b362e06f15695e7bddd64c388ca7b293f407f778583b712789b539 not found: ID does not exist"
Nov 02 22:04:04.780265 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:04.780243    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-fmf7s"]
Nov 02 22:04:04.784548 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:04.784525    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-fmf7s"]
Nov 02 22:04:05.052423 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:05.052346    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772" path="/var/lib/kubelet/pods/1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772/volumes"
Nov 02 22:04:06.702600 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:06.702567    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d"
Nov 02 22:04:11.741919 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:11.741888    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-sl8xb"
Nov 02 22:04:12.127334 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:12.127302    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:12.227829 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:12.227798    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:12.339647 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:12.339620    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-sl8xb"]
Nov 02 22:04:12.339888 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:12.339864    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-sl8xb" podUID="ba6f6213-7c92-479e-b5b2-a659d68c477c" containerName="limitador" containerID="cri-o://844523e7ce999b988f26b3750afcce8a701e8ff6ead17541dcfc6d4c8c014b73" gracePeriod=30
Nov 02 22:04:12.804105 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:12.804073    5076 generic.go:356] "Generic (PLEG): container finished" podID="ba6f6213-7c92-479e-b5b2-a659d68c477c" containerID="844523e7ce999b988f26b3750afcce8a701e8ff6ead17541dcfc6d4c8c014b73" exitCode=0
Nov 02 22:04:12.804500 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:12.804154    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-sl8xb" event={"ID":"ba6f6213-7c92-479e-b5b2-a659d68c477c","Type":"ContainerDied","Data":"844523e7ce999b988f26b3750afcce8a701e8ff6ead17541dcfc6d4c8c014b73"}
Nov 02 22:04:13.274956 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:13.274933    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-sl8xb"
Nov 02 22:04:13.397754 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:13.397721    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ba6f6213-7c92-479e-b5b2-a659d68c477c-kube-api-access-bcf2x\" (UniqueName: \"kubernetes.io/projected/ba6f6213-7c92-479e-b5b2-a659d68c477c-kube-api-access-bcf2x\") pod \"ba6f6213-7c92-479e-b5b2-a659d68c477c\" (UID: \"ba6f6213-7c92-479e-b5b2-a659d68c477c\") "
Nov 02 22:04:13.397902 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:13.397826    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ba6f6213-7c92-479e-b5b2-a659d68c477c-config-file\" (UniqueName: \"kubernetes.io/configmap/ba6f6213-7c92-479e-b5b2-a659d68c477c-config-file\") pod \"ba6f6213-7c92-479e-b5b2-a659d68c477c\" (UID: \"ba6f6213-7c92-479e-b5b2-a659d68c477c\") "
Nov 02 22:04:13.398354 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:13.398314    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba6f6213-7c92-479e-b5b2-a659d68c477c-config-file" pod "ba6f6213-7c92-479e-b5b2-a659d68c477c" (UID: "ba6f6213-7c92-479e-b5b2-a659d68c477c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:04:13.400907 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:13.400875    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba6f6213-7c92-479e-b5b2-a659d68c477c-kube-api-access-bcf2x" pod "ba6f6213-7c92-479e-b5b2-a659d68c477c" (UID: "ba6f6213-7c92-479e-b5b2-a659d68c477c"). InnerVolumeSpecName "kube-api-access-bcf2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:04:13.498989 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:13.498955    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcf2x\" (UniqueName: \"kubernetes.io/projected/ba6f6213-7c92-479e-b5b2-a659d68c477c-kube-api-access-bcf2x\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:04:13.498989 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:13.498985    5076 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba6f6213-7c92-479e-b5b2-a659d68c477c-config-file\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:04:13.810423 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:13.810339    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-sl8xb" event={"ID":"ba6f6213-7c92-479e-b5b2-a659d68c477c","Type":"ContainerDied","Data":"5490cdc0093de5290527cb77383e97f517c0ff60d621379bb6da12fcea6bbb98"}
Nov 02 22:04:13.810423 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:13.810405    5076 scope.go:122] "RemoveContainer" containerID="844523e7ce999b988f26b3750afcce8a701e8ff6ead17541dcfc6d4c8c014b73"
Nov 02 22:04:13.811118 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:13.810347    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-sl8xb"
Nov 02 22:04:13.833597 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:13.833571    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-sl8xb"]
Nov 02 22:04:13.837635 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:13.837613    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-sl8xb"]
Nov 02 22:04:14.551573 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:14.551533    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:14.629299 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:14.629265    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:15.052162 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:15.052122    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ba6f6213-7c92-479e-b5b2-a659d68c477c" path="/var/lib/kubelet/pods/ba6f6213-7c92-479e-b5b2-a659d68c477c/volumes"
Nov 02 22:04:18.140004 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:18.139962    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:18.239953 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:18.239914    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:18.715945 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:18.715917    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-tpqbf"
Nov 02 22:04:18.857075 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:18.857042    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-pqk8j"]
Nov 02 22:04:18.857384 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:18.857372    5076 cpu_manager.go:414] "containerMap: removing container" podUID="ba6f6213-7c92-479e-b5b2-a659d68c477c" containerName="limitador"
Nov 02 22:04:18.857433 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:18.857385    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba6f6213-7c92-479e-b5b2-a659d68c477c" containerName="limitador"
Nov 02 22:04:18.857433 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:18.857401    5076 cpu_manager.go:414] "containerMap: removing container" podUID="1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772" containerName="authorino"
Nov 02 22:04:18.857433 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:18.857405    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772" containerName="authorino"
Nov 02 22:04:18.857524 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:18.857468    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="1b4cb3b1-370c-4dc7-9c7c-50e0b4b48772" containerName="authorino"
Nov 02 22:04:18.857524 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:18.857479    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="ba6f6213-7c92-479e-b5b2-a659d68c477c" containerName="limitador"
Nov 02 22:04:18.862542 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:18.862525    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-pqk8j"
Nov 02 22:04:18.868356 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:18.868332    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-pqk8j"]
Nov 02 22:04:18.869066 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:18.869045    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Nov 02 22:04:18.869202 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:18.869073    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 22:04:18.869202 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:18.869191    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-rptcm\""
Nov 02 22:04:18.869376 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:18.869125    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 22:04:18.949420 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:18.949387    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:19.045233 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:19.045123    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/62cbe7e8-f05e-4ecf-ae10-167a578170b0-data\") pod \"postgres-7cdbf6dc44-pqk8j\" (UID: \"62cbe7e8-f05e-4ecf-ae10-167a578170b0\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-pqk8j"
Nov 02 22:04:19.045233 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:19.045183    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbgb7\" (UniqueName: \"kubernetes.io/projected/62cbe7e8-f05e-4ecf-ae10-167a578170b0-kube-api-access-zbgb7\") pod \"postgres-7cdbf6dc44-pqk8j\" (UID: \"62cbe7e8-f05e-4ecf-ae10-167a578170b0\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-pqk8j"
Nov 02 22:04:19.060512 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:19.060481    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:19.146456 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:19.146425    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/62cbe7e8-f05e-4ecf-ae10-167a578170b0-data\") pod \"postgres-7cdbf6dc44-pqk8j\" (UID: \"62cbe7e8-f05e-4ecf-ae10-167a578170b0\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-pqk8j"
Nov 02 22:04:19.146891 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:19.146468    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbgb7\" (UniqueName: \"kubernetes.io/projected/62cbe7e8-f05e-4ecf-ae10-167a578170b0-kube-api-access-zbgb7\") pod \"postgres-7cdbf6dc44-pqk8j\" (UID: \"62cbe7e8-f05e-4ecf-ae10-167a578170b0\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-pqk8j"
Nov 02 22:04:19.146891 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:19.146773    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/62cbe7e8-f05e-4ecf-ae10-167a578170b0-data\") pod \"postgres-7cdbf6dc44-pqk8j\" (UID: \"62cbe7e8-f05e-4ecf-ae10-167a578170b0\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-pqk8j"
Nov 02 22:04:19.154290 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:19.154265    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbgb7\" (UniqueName: \"kubernetes.io/projected/62cbe7e8-f05e-4ecf-ae10-167a578170b0-kube-api-access-zbgb7\") pod \"postgres-7cdbf6dc44-pqk8j\" (UID: \"62cbe7e8-f05e-4ecf-ae10-167a578170b0\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-pqk8j"
Nov 02 22:04:19.177076 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:19.177050    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-pqk8j"
Nov 02 22:04:19.447935 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:19.447906    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-pqk8j"]
Nov 02 22:04:19.449387 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:04:19.449352    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62cbe7e8_f05e_4ecf_ae10_167a578170b0.slice/crio-54b30da66f7934ece7176f39d00e45950824b2329f78f23b12e57e0d2b3de555 WatchSource:0}: Error finding container 54b30da66f7934ece7176f39d00e45950824b2329f78f23b12e57e0d2b3de555: Status 404 returned error can't find the container with id 54b30da66f7934ece7176f39d00e45950824b2329f78f23b12e57e0d2b3de555
Nov 02 22:04:19.841416 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:19.841337    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-pqk8j" event={"ID":"62cbe7e8-f05e-4ecf-ae10-167a578170b0","Type":"ContainerStarted","Data":"54b30da66f7934ece7176f39d00e45950824b2329f78f23b12e57e0d2b3de555"}
Nov 02 22:04:20.595934 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:20.595894    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:22.769412 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:22.769374    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:22.850461 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:22.850374    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:22.955941 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:22.955827    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:23.029136 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:23.029045    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:23.899937 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:23.899901    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d"]
Nov 02 22:04:23.901095 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:23.900181    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d" podUID="b2ef0096-cac9-4843-9e28-ccbb91449558" containerName="manager" containerID="cri-o://eac418ac4ef782c37960f79aa6f58ce1823487af52a296aa2ebd142496fa176e" gracePeriod=10
Nov 02 22:04:23.977092 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:23.977051    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:24.075890 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:24.075846    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:24.180072 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:24.180051    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d"
Nov 02 22:04:24.184340 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:24.184316    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b2ef0096-cac9-4843-9e28-ccbb91449558-kube-api-access-x6xx9\" (UniqueName: \"kubernetes.io/projected/b2ef0096-cac9-4843-9e28-ccbb91449558-kube-api-access-x6xx9\") pod \"b2ef0096-cac9-4843-9e28-ccbb91449558\" (UID: \"b2ef0096-cac9-4843-9e28-ccbb91449558\") "
Nov 02 22:04:24.184471 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:24.184356    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2ef0096-cac9-4843-9e28-ccbb91449558-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2ef0096-cac9-4843-9e28-ccbb91449558-extensions-socket-volume\") pod \"b2ef0096-cac9-4843-9e28-ccbb91449558\" (UID: \"b2ef0096-cac9-4843-9e28-ccbb91449558\") "
Nov 02 22:04:24.184770 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:24.184746    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2ef0096-cac9-4843-9e28-ccbb91449558-extensions-socket-volume" pod "b2ef0096-cac9-4843-9e28-ccbb91449558" (UID: "b2ef0096-cac9-4843-9e28-ccbb91449558"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:04:24.186532 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:24.186508    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2ef0096-cac9-4843-9e28-ccbb91449558-kube-api-access-x6xx9" pod "b2ef0096-cac9-4843-9e28-ccbb91449558" (UID: "b2ef0096-cac9-4843-9e28-ccbb91449558"). InnerVolumeSpecName "kube-api-access-x6xx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:04:24.285483 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:24.285451    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6xx9\" (UniqueName: \"kubernetes.io/projected/b2ef0096-cac9-4843-9e28-ccbb91449558-kube-api-access-x6xx9\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:04:24.285483 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:24.285482    5076 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2ef0096-cac9-4843-9e28-ccbb91449558-extensions-socket-volume\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:04:24.872199 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:24.872163    5076 generic.go:356] "Generic (PLEG): container finished" podID="b2ef0096-cac9-4843-9e28-ccbb91449558" containerID="eac418ac4ef782c37960f79aa6f58ce1823487af52a296aa2ebd142496fa176e" exitCode=0
Nov 02 22:04:24.872386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:24.872208    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d" event={"ID":"b2ef0096-cac9-4843-9e28-ccbb91449558","Type":"ContainerDied","Data":"eac418ac4ef782c37960f79aa6f58ce1823487af52a296aa2ebd142496fa176e"}
Nov 02 22:04:24.872386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:24.872228    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d"
Nov 02 22:04:24.872386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:24.872279    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d" event={"ID":"b2ef0096-cac9-4843-9e28-ccbb91449558","Type":"ContainerDied","Data":"4d170f676b528a271e36b16f1b5653498df4bb23aa82c423398bfea93ffa9913"}
Nov 02 22:04:24.872386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:24.872313    5076 scope.go:122] "RemoveContainer" containerID="eac418ac4ef782c37960f79aa6f58ce1823487af52a296aa2ebd142496fa176e"
Nov 02 22:04:24.883566 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:24.883543    5076 scope.go:122] "RemoveContainer" containerID="eac418ac4ef782c37960f79aa6f58ce1823487af52a296aa2ebd142496fa176e"
Nov 02 22:04:24.883818 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:04:24.883794    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eac418ac4ef782c37960f79aa6f58ce1823487af52a296aa2ebd142496fa176e\": container with ID starting with eac418ac4ef782c37960f79aa6f58ce1823487af52a296aa2ebd142496fa176e not found: ID does not exist" containerID="eac418ac4ef782c37960f79aa6f58ce1823487af52a296aa2ebd142496fa176e"
Nov 02 22:04:24.883891 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:24.883830    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eac418ac4ef782c37960f79aa6f58ce1823487af52a296aa2ebd142496fa176e"} err="failed to get container status \"eac418ac4ef782c37960f79aa6f58ce1823487af52a296aa2ebd142496fa176e\": rpc error: code = NotFound desc = could not find container \"eac418ac4ef782c37960f79aa6f58ce1823487af52a296aa2ebd142496fa176e\": container with ID starting with eac418ac4ef782c37960f79aa6f58ce1823487af52a296aa2ebd142496fa176e not found: ID does not exist"
Nov 02 22:04:24.896753 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:24.896730    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d"]
Nov 02 22:04:24.902928 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:24.902906    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-bfs9d"]
Nov 02 22:04:25.051939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:25.051908    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b2ef0096-cac9-4843-9e28-ccbb91449558" path="/var/lib/kubelet/pods/b2ef0096-cac9-4843-9e28-ccbb91449558/volumes"
Nov 02 22:04:25.883960 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:25.883928    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-pqk8j" event={"ID":"62cbe7e8-f05e-4ecf-ae10-167a578170b0","Type":"ContainerStarted","Data":"72d9efd6b04191731e6f6943f80fdb5c8260f34036939d92c105220dfe0869cb"}
Nov 02 22:04:25.884142 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:25.884034    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-pqk8j"
Nov 02 22:04:25.900723 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:25.900679    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-pqk8j" podStartSLOduration=1.887529673 podStartE2EDuration="7.900665461s" totalImagesPullingTime="6.013135788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:04:25.899422208 +0000 UTC m=+374.955756590" watchObservedRunningTime="2026-11-02 22:04:25.900665461 +0000 UTC m=+374.956999840"
Nov 02 22:04:29.891159 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:04:29.891106    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:04:31.919454 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:31.919428    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-pqk8j"
Nov 02 22:04:33.185133 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:33.185095    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:33.340420 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:33.340383    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:35.614099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:35.614065    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:35.685776 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:35.685741    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:37.439145 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:37.439107    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:37.509024 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:37.508984    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:38.863817 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:38.863776    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:38.935922 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:38.935892    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-579cf7c6d-bl2bc"]
Nov 02 22:04:38.936282 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:38.936267    5076 cpu_manager.go:414] "containerMap: removing container" podUID="b2ef0096-cac9-4843-9e28-ccbb91449558" containerName="manager"
Nov 02 22:04:38.936329 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:38.936283    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2ef0096-cac9-4843-9e28-ccbb91449558" containerName="manager"
Nov 02 22:04:38.936442 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:38.936389    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2ef0096-cac9-4843-9e28-ccbb91449558" containerName="manager"
Nov 02 22:04:38.942386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:38.942367    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-bl2bc"
Nov 02 22:04:38.948203 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:38.948183    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-bl2bc"]
Nov 02 22:04:38.955541 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:38.950304    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Nov 02 22:04:38.955541 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:38.950421    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Nov 02 22:04:38.955541 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:38.950953    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Nov 02 22:04:38.955541 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:38.951005    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pb6j7\""
Nov 02 22:04:38.955541 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:38.951188    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:39.000770 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.000741    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e5b819b-b6db-4ad9-bd62-650f04f1c094-webhook-cert\") pod \"maas-controller-579cf7c6d-bl2bc\" (UID: \"8e5b819b-b6db-4ad9-bd62-650f04f1c094\") " pod="opendatahub/maas-controller-579cf7c6d-bl2bc"
Nov 02 22:04:39.000916 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.000793    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e5b819b-b6db-4ad9-bd62-650f04f1c094-metrics-certs\") pod \"maas-controller-579cf7c6d-bl2bc\" (UID: \"8e5b819b-b6db-4ad9-bd62-650f04f1c094\") " pod="opendatahub/maas-controller-579cf7c6d-bl2bc"
Nov 02 22:04:39.000916 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.000885    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxl8f\" (UniqueName: \"kubernetes.io/projected/8e5b819b-b6db-4ad9-bd62-650f04f1c094-kube-api-access-xxl8f\") pod \"maas-controller-579cf7c6d-bl2bc\" (UID: \"8e5b819b-b6db-4ad9-bd62-650f04f1c094\") " pod="opendatahub/maas-controller-579cf7c6d-bl2bc"
Nov 02 22:04:39.024909 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.024882    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:39.101690 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.101659    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxl8f\" (UniqueName: \"kubernetes.io/projected/8e5b819b-b6db-4ad9-bd62-650f04f1c094-kube-api-access-xxl8f\") pod \"maas-controller-579cf7c6d-bl2bc\" (UID: \"8e5b819b-b6db-4ad9-bd62-650f04f1c094\") " pod="opendatahub/maas-controller-579cf7c6d-bl2bc"
Nov 02 22:04:39.101845 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.101717    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e5b819b-b6db-4ad9-bd62-650f04f1c094-webhook-cert\") pod \"maas-controller-579cf7c6d-bl2bc\" (UID: \"8e5b819b-b6db-4ad9-bd62-650f04f1c094\") " pod="opendatahub/maas-controller-579cf7c6d-bl2bc"
Nov 02 22:04:39.101845 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.101764    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e5b819b-b6db-4ad9-bd62-650f04f1c094-metrics-certs\") pod \"maas-controller-579cf7c6d-bl2bc\" (UID: \"8e5b819b-b6db-4ad9-bd62-650f04f1c094\") " pod="opendatahub/maas-controller-579cf7c6d-bl2bc"
Nov 02 22:04:39.104140 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.104112    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e5b819b-b6db-4ad9-bd62-650f04f1c094-webhook-cert\") pod \"maas-controller-579cf7c6d-bl2bc\" (UID: \"8e5b819b-b6db-4ad9-bd62-650f04f1c094\") " pod="opendatahub/maas-controller-579cf7c6d-bl2bc"
Nov 02 22:04:39.104273 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.104173    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e5b819b-b6db-4ad9-bd62-650f04f1c094-metrics-certs\") pod \"maas-controller-579cf7c6d-bl2bc\" (UID: \"8e5b819b-b6db-4ad9-bd62-650f04f1c094\") " pod="opendatahub/maas-controller-579cf7c6d-bl2bc"
Nov 02 22:04:39.109806 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.109787    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxl8f\" (UniqueName: \"kubernetes.io/projected/8e5b819b-b6db-4ad9-bd62-650f04f1c094-kube-api-access-xxl8f\") pod \"maas-controller-579cf7c6d-bl2bc\" (UID: \"8e5b819b-b6db-4ad9-bd62-650f04f1c094\") " pod="opendatahub/maas-controller-579cf7c6d-bl2bc"
Nov 02 22:04:39.126165 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.126111    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:39.254923 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.254888    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68bfb5556c-4kwpw"]
Nov 02 22:04:39.258899 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.258876    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-bl2bc"
Nov 02 22:04:39.259356 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.259340    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68bfb5556c-4kwpw"
Nov 02 22:04:39.269015 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.268992    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68bfb5556c-4kwpw"]
Nov 02 22:04:39.303353 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.303320    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v66d\" (UniqueName: \"kubernetes.io/projected/85552a19-8cc3-48b4-9a5d-a3a5885c3222-kube-api-access-8v66d\") pod \"maas-controller-68bfb5556c-4kwpw\" (UID: \"85552a19-8cc3-48b4-9a5d-a3a5885c3222\") " pod="opendatahub/maas-controller-68bfb5556c-4kwpw"
Nov 02 22:04:39.303353 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.303356    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85552a19-8cc3-48b4-9a5d-a3a5885c3222-webhook-cert\") pod \"maas-controller-68bfb5556c-4kwpw\" (UID: \"85552a19-8cc3-48b4-9a5d-a3a5885c3222\") " pod="opendatahub/maas-controller-68bfb5556c-4kwpw"
Nov 02 22:04:39.303567 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.303511    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85552a19-8cc3-48b4-9a5d-a3a5885c3222-metrics-certs\") pod \"maas-controller-68bfb5556c-4kwpw\" (UID: \"85552a19-8cc3-48b4-9a5d-a3a5885c3222\") " pod="opendatahub/maas-controller-68bfb5556c-4kwpw"
Nov 02 22:04:39.404691 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.404613    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85552a19-8cc3-48b4-9a5d-a3a5885c3222-metrics-certs\") pod \"maas-controller-68bfb5556c-4kwpw\" (UID: \"85552a19-8cc3-48b4-9a5d-a3a5885c3222\") " pod="opendatahub/maas-controller-68bfb5556c-4kwpw"
Nov 02 22:04:39.404842 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.404684    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v66d\" (UniqueName: \"kubernetes.io/projected/85552a19-8cc3-48b4-9a5d-a3a5885c3222-kube-api-access-8v66d\") pod \"maas-controller-68bfb5556c-4kwpw\" (UID: \"85552a19-8cc3-48b4-9a5d-a3a5885c3222\") " pod="opendatahub/maas-controller-68bfb5556c-4kwpw"
Nov 02 22:04:39.404842 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.404717    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85552a19-8cc3-48b4-9a5d-a3a5885c3222-webhook-cert\") pod \"maas-controller-68bfb5556c-4kwpw\" (UID: \"85552a19-8cc3-48b4-9a5d-a3a5885c3222\") " pod="opendatahub/maas-controller-68bfb5556c-4kwpw"
Nov 02 22:04:39.407111 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.407075    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85552a19-8cc3-48b4-9a5d-a3a5885c3222-webhook-cert\") pod \"maas-controller-68bfb5556c-4kwpw\" (UID: \"85552a19-8cc3-48b4-9a5d-a3a5885c3222\") " pod="opendatahub/maas-controller-68bfb5556c-4kwpw"
Nov 02 22:04:39.407239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.407131    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85552a19-8cc3-48b4-9a5d-a3a5885c3222-metrics-certs\") pod \"maas-controller-68bfb5556c-4kwpw\" (UID: \"85552a19-8cc3-48b4-9a5d-a3a5885c3222\") " pod="opendatahub/maas-controller-68bfb5556c-4kwpw"
Nov 02 22:04:39.413119 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.413095    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v66d\" (UniqueName: \"kubernetes.io/projected/85552a19-8cc3-48b4-9a5d-a3a5885c3222-kube-api-access-8v66d\") pod \"maas-controller-68bfb5556c-4kwpw\" (UID: \"85552a19-8cc3-48b4-9a5d-a3a5885c3222\") " pod="opendatahub/maas-controller-68bfb5556c-4kwpw"
Nov 02 22:04:39.539144 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.539116    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-bl2bc"]
Nov 02 22:04:39.540588 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:04:39.540555    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5b819b_b6db_4ad9_bd62_650f04f1c094.slice/crio-85ed80aee66000e89827fc66645fb14d69606838afdddb475ec023f9c1846c91 WatchSource:0}: Error finding container 85ed80aee66000e89827fc66645fb14d69606838afdddb475ec023f9c1846c91: Status 404 returned error can't find the container with id 85ed80aee66000e89827fc66645fb14d69606838afdddb475ec023f9c1846c91
Nov 02 22:04:39.593478 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.593440    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68bfb5556c-4kwpw"
Nov 02 22:04:39.868003 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.867976    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68bfb5556c-4kwpw"]
Nov 02 22:04:39.869946 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:04:39.869914    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85552a19_8cc3_48b4_9a5d_a3a5885c3222.slice/crio-2fe01f2e1cfe82ce22aa3329977636c9cd357a4fd1c03ca2ebb9d79bd8d1fe1a WatchSource:0}: Error finding container 2fe01f2e1cfe82ce22aa3329977636c9cd357a4fd1c03ca2ebb9d79bd8d1fe1a: Status 404 returned error can't find the container with id 2fe01f2e1cfe82ce22aa3329977636c9cd357a4fd1c03ca2ebb9d79bd8d1fe1a
Nov 02 22:04:39.961598 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.961546    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68bfb5556c-4kwpw" event={"ID":"85552a19-8cc3-48b4-9a5d-a3a5885c3222","Type":"ContainerStarted","Data":"2fe01f2e1cfe82ce22aa3329977636c9cd357a4fd1c03ca2ebb9d79bd8d1fe1a"}
Nov 02 22:04:39.968775 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:39.968727    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-bl2bc" event={"ID":"8e5b819b-b6db-4ad9-bd62-650f04f1c094","Type":"ContainerStarted","Data":"85ed80aee66000e89827fc66645fb14d69606838afdddb475ec023f9c1846c91"}
Nov 02 22:04:40.382375 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:40.382335    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:40.460061 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:40.459962    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:42.968763 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:42.968727    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:42.992530 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:42.992444    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68bfb5556c-4kwpw" event={"ID":"85552a19-8cc3-48b4-9a5d-a3a5885c3222","Type":"ContainerStarted","Data":"d298a6c2d917cd759c09c712884a651eb50847fae8ac9130c4e6b09cb3eb73c2"}
Nov 02 22:04:42.992671 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:42.992650    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68bfb5556c-4kwpw"
Nov 02 22:04:42.994056 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:42.994030    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-bl2bc" event={"ID":"8e5b819b-b6db-4ad9-bd62-650f04f1c094","Type":"ContainerStarted","Data":"f19b144caaba449b65a356207a116692c6071b8bd30e8c31e8a801f80a9a8c83"}
Nov 02 22:04:42.994192 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:42.994175    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-579cf7c6d-bl2bc"
Nov 02 22:04:43.012340 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:43.012286    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-68bfb5556c-4kwpw" podStartSLOduration=1.038156905 podStartE2EDuration="4.012270765s" totalImagesPullingTime="2.97411386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:04:43.010743403 +0000 UTC m=+392.067077780" watchObservedRunningTime="2026-11-02 22:04:43.012270765 +0000 UTC m=+392.068605151"
Nov 02 22:04:43.030694 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:43.030649    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-579cf7c6d-bl2bc" podStartSLOduration=1.843988138 podStartE2EDuration="5.030638121s" totalImagesPullingTime="3.186649983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:04:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:04:43.02902754 +0000 UTC m=+392.085361920" watchObservedRunningTime="2026-11-02 22:04:43.030638121 +0000 UTC m=+392.086972529"
Nov 02 22:04:43.068736 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:43.068704    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:43.998474 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:43.998442    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2"]
Nov 02 22:04:44.006786 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.005365    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2"
Nov 02 22:04:44.011018 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.010995    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2"]
Nov 02 22:04:44.012332 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.012186    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\""
Nov 02 22:04:44.012332 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.012308    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\""
Nov 02 22:04:44.012507 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.012393    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\""
Nov 02 22:04:44.012507 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.012466    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-tr7mf\""
Nov 02 22:04:44.045210 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.045157    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czz47\" (UniqueName: \"kubernetes.io/projected/b256cdd6-7969-421d-9639-3287e938b8c7-kube-api-access-czz47\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6qvf2\" (UID: \"b256cdd6-7969-421d-9639-3287e938b8c7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2"
Nov 02 22:04:44.045386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.045248    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/b256cdd6-7969-421d-9639-3287e938b8c7-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6qvf2\" (UID: \"b256cdd6-7969-421d-9639-3287e938b8c7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2"
Nov 02 22:04:44.045443 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.045387    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b256cdd6-7969-421d-9639-3287e938b8c7-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6qvf2\" (UID: \"b256cdd6-7969-421d-9639-3287e938b8c7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2"
Nov 02 22:04:44.045494 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.045452    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b256cdd6-7969-421d-9639-3287e938b8c7-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6qvf2\" (UID: \"b256cdd6-7969-421d-9639-3287e938b8c7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2"
Nov 02 22:04:44.056899 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.056868    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:44.146417 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.146386    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czz47\" (UniqueName: \"kubernetes.io/projected/b256cdd6-7969-421d-9639-3287e938b8c7-kube-api-access-czz47\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6qvf2\" (UID: \"b256cdd6-7969-421d-9639-3287e938b8c7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2"
Nov 02 22:04:44.146417 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.146421    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/b256cdd6-7969-421d-9639-3287e938b8c7-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6qvf2\" (UID: \"b256cdd6-7969-421d-9639-3287e938b8c7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2"
Nov 02 22:04:44.146668 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.146444    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b256cdd6-7969-421d-9639-3287e938b8c7-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6qvf2\" (UID: \"b256cdd6-7969-421d-9639-3287e938b8c7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2"
Nov 02 22:04:44.146668 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.146465    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b256cdd6-7969-421d-9639-3287e938b8c7-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6qvf2\" (UID: \"b256cdd6-7969-421d-9639-3287e938b8c7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2"
Nov 02 22:04:44.147246 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.147204    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b256cdd6-7969-421d-9639-3287e938b8c7-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6qvf2\" (UID: \"b256cdd6-7969-421d-9639-3287e938b8c7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2"
Nov 02 22:04:44.147524 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.147504    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/b256cdd6-7969-421d-9639-3287e938b8c7-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6qvf2\" (UID: \"b256cdd6-7969-421d-9639-3287e938b8c7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2"
Nov 02 22:04:44.148848 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.148824    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b256cdd6-7969-421d-9639-3287e938b8c7-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6qvf2\" (UID: \"b256cdd6-7969-421d-9639-3287e938b8c7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2"
Nov 02 22:04:44.159069 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.159050    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czz47\" (UniqueName: \"kubernetes.io/projected/b256cdd6-7969-421d-9639-3287e938b8c7-kube-api-access-czz47\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6qvf2\" (UID: \"b256cdd6-7969-421d-9639-3287e938b8c7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2"
Nov 02 22:04:44.264792 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.264701    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:44.324141 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.324108    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2"
Nov 02 22:04:44.613078 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:44.613054    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2"]
Nov 02 22:04:44.614812 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:04:44.614783    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb256cdd6_7969_421d_9639_3287e938b8c7.slice/crio-f025c2fe8234f0310f7a0deeb4736686c4d8cdd6fd9d4e8cad347a289c9b9008 WatchSource:0}: Error finding container f025c2fe8234f0310f7a0deeb4736686c4d8cdd6fd9d4e8cad347a289c9b9008: Status 404 returned error can't find the container with id f025c2fe8234f0310f7a0deeb4736686c4d8cdd6fd9d4e8cad347a289c9b9008
Nov 02 22:04:45.009140 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:45.009067    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2" event={"ID":"b256cdd6-7969-421d-9639-3287e938b8c7","Type":"ContainerStarted","Data":"f025c2fe8234f0310f7a0deeb4736686c4d8cdd6fd9d4e8cad347a289c9b9008"}
Nov 02 22:04:46.856409 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:46.856373    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:46.962235 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:46.961959    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:46.972234 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:46.965949    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-bdsrg"]
Nov 02 22:04:46.972234 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:46.971574    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-bdsrg"
Nov 02 22:04:46.977228 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:46.975584    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-bdsrg"]
Nov 02 22:04:46.982941 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:46.982902    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Nov 02 22:04:46.983060 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:46.983006    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck"]
Nov 02 22:04:46.988459 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:46.988089    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-mxwfq\""
Nov 02 22:04:46.994639 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:46.994618    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck"
Nov 02 22:04:47.009357 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.009289    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck"]
Nov 02 22:04:47.032413 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.032386    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-j9zmw"]
Nov 02 22:04:47.049024 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.048995    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-j9zmw"]
Nov 02 22:04:47.050710 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.050682    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-j9zmw"
Nov 02 22:04:47.052468 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.052442    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-tsv5s\""
Nov 02 22:04:47.052571 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.052542    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Nov 02 22:04:47.059066 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.058728    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-n2xfv"]
Nov 02 22:04:47.068971 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.068951    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-n2xfv"]
Nov 02 22:04:47.069324 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.069246    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-n2xfv"
Nov 02 22:04:47.074115 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.074077    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea4ab2c0-e647-46ac-a15f-4344863b82c8-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-7btck\" (UID: \"ea4ab2c0-e647-46ac-a15f-4344863b82c8\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck"
Nov 02 22:04:47.074392 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.074364    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chmpf\" (UniqueName: \"kubernetes.io/projected/ea4ab2c0-e647-46ac-a15f-4344863b82c8-kube-api-access-chmpf\") pod \"llmisvc-controller-manager-869d5dcc5d-7btck\" (UID: \"ea4ab2c0-e647-46ac-a15f-4344863b82c8\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck"
Nov 02 22:04:47.074515 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.074491    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aabf1bfc-ffbc-4de0-a8e6-b2e45ef0204d-cert\") pod \"kserve-controller-manager-776cc66d47-bdsrg\" (UID: \"aabf1bfc-ffbc-4de0-a8e6-b2e45ef0204d\") " pod="opendatahub/kserve-controller-manager-776cc66d47-bdsrg"
Nov 02 22:04:47.074606 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.074571    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zr8n\" (UniqueName: \"kubernetes.io/projected/aabf1bfc-ffbc-4de0-a8e6-b2e45ef0204d-kube-api-access-4zr8n\") pod \"kserve-controller-manager-776cc66d47-bdsrg\" (UID: \"aabf1bfc-ffbc-4de0-a8e6-b2e45ef0204d\") " pod="opendatahub/kserve-controller-manager-776cc66d47-bdsrg"
Nov 02 22:04:47.084180 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.083575    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Nov 02 22:04:47.084180 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.083647    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Nov 02 22:04:47.084180 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.083726    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-dvk5v\""
Nov 02 22:04:47.084180 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.083730    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-w2tq5\""
Nov 02 22:04:47.084180 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.083746    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Nov 02 22:04:47.084180 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.084091    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:47.175615 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.175535    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea4ab2c0-e647-46ac-a15f-4344863b82c8-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-7btck\" (UID: \"ea4ab2c0-e647-46ac-a15f-4344863b82c8\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck"
Nov 02 22:04:47.175615 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.175578    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p2bc\" (UniqueName: \"kubernetes.io/projected/7453965d-d179-4e30-b187-5e0abf2a56f9-kube-api-access-9p2bc\") pod \"odh-model-controller-769875db56-n2xfv\" (UID: \"7453965d-d179-4e30-b187-5e0abf2a56f9\") " pod="opendatahub/odh-model-controller-769875db56-n2xfv"
Nov 02 22:04:47.175803 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.175620    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chmpf\" (UniqueName: \"kubernetes.io/projected/ea4ab2c0-e647-46ac-a15f-4344863b82c8-kube-api-access-chmpf\") pod \"llmisvc-controller-manager-869d5dcc5d-7btck\" (UID: \"ea4ab2c0-e647-46ac-a15f-4344863b82c8\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck"
Nov 02 22:04:47.175803 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.175669    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aabf1bfc-ffbc-4de0-a8e6-b2e45ef0204d-cert\") pod \"kserve-controller-manager-776cc66d47-bdsrg\" (UID: \"aabf1bfc-ffbc-4de0-a8e6-b2e45ef0204d\") " pod="opendatahub/kserve-controller-manager-776cc66d47-bdsrg"
Nov 02 22:04:47.175803 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.175747    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d89c7\" (UniqueName: \"kubernetes.io/projected/f60fe2c2-81e5-4f1e-8ca1-60158acf9278-kube-api-access-d89c7\") pod \"model-serving-api-75bd89fdfc-j9zmw\" (UID: \"f60fe2c2-81e5-4f1e-8ca1-60158acf9278\") " pod="opendatahub/model-serving-api-75bd89fdfc-j9zmw"
Nov 02 22:04:47.175933 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.175831    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7453965d-d179-4e30-b187-5e0abf2a56f9-metrics-certs\") pod \"odh-model-controller-769875db56-n2xfv\" (UID: \"7453965d-d179-4e30-b187-5e0abf2a56f9\") " pod="opendatahub/odh-model-controller-769875db56-n2xfv"
Nov 02 22:04:47.175933 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.175866    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zr8n\" (UniqueName: \"kubernetes.io/projected/aabf1bfc-ffbc-4de0-a8e6-b2e45ef0204d-kube-api-access-4zr8n\") pod \"kserve-controller-manager-776cc66d47-bdsrg\" (UID: \"aabf1bfc-ffbc-4de0-a8e6-b2e45ef0204d\") " pod="opendatahub/kserve-controller-manager-776cc66d47-bdsrg"
Nov 02 22:04:47.176039 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.175948    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f60fe2c2-81e5-4f1e-8ca1-60158acf9278-tls-certs\") pod \"model-serving-api-75bd89fdfc-j9zmw\" (UID: \"f60fe2c2-81e5-4f1e-8ca1-60158acf9278\") " pod="opendatahub/model-serving-api-75bd89fdfc-j9zmw"
Nov 02 22:04:47.176039 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.176016    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7453965d-d179-4e30-b187-5e0abf2a56f9-cert\") pod \"odh-model-controller-769875db56-n2xfv\" (UID: \"7453965d-d179-4e30-b187-5e0abf2a56f9\") " pod="opendatahub/odh-model-controller-769875db56-n2xfv"
Nov 02 22:04:47.178250 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.178207    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea4ab2c0-e647-46ac-a15f-4344863b82c8-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-7btck\" (UID: \"ea4ab2c0-e647-46ac-a15f-4344863b82c8\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck"
Nov 02 22:04:47.178250 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.178207    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aabf1bfc-ffbc-4de0-a8e6-b2e45ef0204d-cert\") pod \"kserve-controller-manager-776cc66d47-bdsrg\" (UID: \"aabf1bfc-ffbc-4de0-a8e6-b2e45ef0204d\") " pod="opendatahub/kserve-controller-manager-776cc66d47-bdsrg"
Nov 02 22:04:47.184418 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.184339    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:47.184949 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.184925    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zr8n\" (UniqueName: \"kubernetes.io/projected/aabf1bfc-ffbc-4de0-a8e6-b2e45ef0204d-kube-api-access-4zr8n\") pod \"kserve-controller-manager-776cc66d47-bdsrg\" (UID: \"aabf1bfc-ffbc-4de0-a8e6-b2e45ef0204d\") " pod="opendatahub/kserve-controller-manager-776cc66d47-bdsrg"
Nov 02 22:04:47.185295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.185278    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chmpf\" (UniqueName: \"kubernetes.io/projected/ea4ab2c0-e647-46ac-a15f-4344863b82c8-kube-api-access-chmpf\") pod \"llmisvc-controller-manager-869d5dcc5d-7btck\" (UID: \"ea4ab2c0-e647-46ac-a15f-4344863b82c8\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck"
Nov 02 22:04:47.276959 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.276919    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d89c7\" (UniqueName: \"kubernetes.io/projected/f60fe2c2-81e5-4f1e-8ca1-60158acf9278-kube-api-access-d89c7\") pod \"model-serving-api-75bd89fdfc-j9zmw\" (UID: \"f60fe2c2-81e5-4f1e-8ca1-60158acf9278\") " pod="opendatahub/model-serving-api-75bd89fdfc-j9zmw"
Nov 02 22:04:47.277108 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.276976    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7453965d-d179-4e30-b187-5e0abf2a56f9-metrics-certs\") pod \"odh-model-controller-769875db56-n2xfv\" (UID: \"7453965d-d179-4e30-b187-5e0abf2a56f9\") " pod="opendatahub/odh-model-controller-769875db56-n2xfv"
Nov 02 22:04:47.277172 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.277150    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f60fe2c2-81e5-4f1e-8ca1-60158acf9278-tls-certs\") pod \"model-serving-api-75bd89fdfc-j9zmw\" (UID: \"f60fe2c2-81e5-4f1e-8ca1-60158acf9278\") " pod="opendatahub/model-serving-api-75bd89fdfc-j9zmw"
Nov 02 22:04:47.277270 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.277252    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7453965d-d179-4e30-b187-5e0abf2a56f9-cert\") pod \"odh-model-controller-769875db56-n2xfv\" (UID: \"7453965d-d179-4e30-b187-5e0abf2a56f9\") " pod="opendatahub/odh-model-controller-769875db56-n2xfv"
Nov 02 22:04:47.277336 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.277296    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p2bc\" (UniqueName: \"kubernetes.io/projected/7453965d-d179-4e30-b187-5e0abf2a56f9-kube-api-access-9p2bc\") pod \"odh-model-controller-769875db56-n2xfv\" (UID: \"7453965d-d179-4e30-b187-5e0abf2a56f9\") " pod="opendatahub/odh-model-controller-769875db56-n2xfv"
Nov 02 22:04:47.279575 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.279550    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7453965d-d179-4e30-b187-5e0abf2a56f9-metrics-certs\") pod \"odh-model-controller-769875db56-n2xfv\" (UID: \"7453965d-d179-4e30-b187-5e0abf2a56f9\") " pod="opendatahub/odh-model-controller-769875db56-n2xfv"
Nov 02 22:04:47.279763 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.279749    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7453965d-d179-4e30-b187-5e0abf2a56f9-cert\") pod \"odh-model-controller-769875db56-n2xfv\" (UID: \"7453965d-d179-4e30-b187-5e0abf2a56f9\") " pod="opendatahub/odh-model-controller-769875db56-n2xfv"
Nov 02 22:04:47.279808 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.279755    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f60fe2c2-81e5-4f1e-8ca1-60158acf9278-tls-certs\") pod \"model-serving-api-75bd89fdfc-j9zmw\" (UID: \"f60fe2c2-81e5-4f1e-8ca1-60158acf9278\") " pod="opendatahub/model-serving-api-75bd89fdfc-j9zmw"
Nov 02 22:04:47.284962 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.284940    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d89c7\" (UniqueName: \"kubernetes.io/projected/f60fe2c2-81e5-4f1e-8ca1-60158acf9278-kube-api-access-d89c7\") pod \"model-serving-api-75bd89fdfc-j9zmw\" (UID: \"f60fe2c2-81e5-4f1e-8ca1-60158acf9278\") " pod="opendatahub/model-serving-api-75bd89fdfc-j9zmw"
Nov 02 22:04:47.285118 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.285101    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p2bc\" (UniqueName: \"kubernetes.io/projected/7453965d-d179-4e30-b187-5e0abf2a56f9-kube-api-access-9p2bc\") pod \"odh-model-controller-769875db56-n2xfv\" (UID: \"7453965d-d179-4e30-b187-5e0abf2a56f9\") " pod="opendatahub/odh-model-controller-769875db56-n2xfv"
Nov 02 22:04:47.287095 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.287069    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:47.298880 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.298862    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-bdsrg"
Nov 02 22:04:47.348575 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.348545    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck"
Nov 02 22:04:47.371102 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.370906    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-j9zmw"
Nov 02 22:04:47.385009 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.384827    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-n2xfv"
Nov 02 22:04:47.387014 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.386989    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:47.593467 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.593434    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-bdsrg"]
Nov 02 22:04:47.599193 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:04:47.599168    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaabf1bfc_ffbc_4de0_a8e6_b2e45ef0204d.slice/crio-54c234c61fba5b4449f2e56b86f661c4bcef062d6bcb6149b77cca900ff537de WatchSource:0}: Error finding container 54c234c61fba5b4449f2e56b86f661c4bcef062d6bcb6149b77cca900ff537de: Status 404 returned error can't find the container with id 54c234c61fba5b4449f2e56b86f661c4bcef062d6bcb6149b77cca900ff537de
Nov 02 22:04:47.679309 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.679196    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck"]
Nov 02 22:04:47.683746 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:04:47.683711    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podea4ab2c0_e647_46ac_a15f_4344863b82c8.slice/crio-14fc32851877a39686ad8fa65511f90d51499d3d2b4289992ed29fe70a46ada3 WatchSource:0}: Error finding container 14fc32851877a39686ad8fa65511f90d51499d3d2b4289992ed29fe70a46ada3: Status 404 returned error can't find the container with id 14fc32851877a39686ad8fa65511f90d51499d3d2b4289992ed29fe70a46ada3
Nov 02 22:04:47.693454 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.692830    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-j9zmw"]
Nov 02 22:04:47.696898 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:04:47.696868    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60fe2c2_81e5_4f1e_8ca1_60158acf9278.slice/crio-1cb980d6d5577d20a32555cf99008c9b0eaf5969ebca6e788bb1b0426e2e98d2 WatchSource:0}: Error finding container 1cb980d6d5577d20a32555cf99008c9b0eaf5969ebca6e788bb1b0426e2e98d2: Status 404 returned error can't find the container with id 1cb980d6d5577d20a32555cf99008c9b0eaf5969ebca6e788bb1b0426e2e98d2
Nov 02 22:04:47.723180 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:47.723104    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-n2xfv"]
Nov 02 22:04:47.726485 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:04:47.726455    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7453965d_d179_4e30_b187_5e0abf2a56f9.slice/crio-1319a2fc1e718ed34b59cf9ff8dd9898c2cd6d617c2ad26cffee698372aaa187 WatchSource:0}: Error finding container 1319a2fc1e718ed34b59cf9ff8dd9898c2cd6d617c2ad26cffee698372aaa187: Status 404 returned error can't find the container with id 1319a2fc1e718ed34b59cf9ff8dd9898c2cd6d617c2ad26cffee698372aaa187
Nov 02 22:04:48.018539 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:48.018432    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:48.051712 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:48.051675    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-bdsrg" event={"ID":"aabf1bfc-ffbc-4de0-a8e6-b2e45ef0204d","Type":"ContainerStarted","Data":"54c234c61fba5b4449f2e56b86f661c4bcef062d6bcb6149b77cca900ff537de"}
Nov 02 22:04:48.055037 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:48.054970    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-j9zmw" event={"ID":"f60fe2c2-81e5-4f1e-8ca1-60158acf9278","Type":"ContainerStarted","Data":"1cb980d6d5577d20a32555cf99008c9b0eaf5969ebca6e788bb1b0426e2e98d2"}
Nov 02 22:04:48.057765 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:48.057739    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-n2xfv" event={"ID":"7453965d-d179-4e30-b187-5e0abf2a56f9","Type":"ContainerStarted","Data":"1319a2fc1e718ed34b59cf9ff8dd9898c2cd6d617c2ad26cffee698372aaa187"}
Nov 02 22:04:48.060326 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:48.060300    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck" event={"ID":"ea4ab2c0-e647-46ac-a15f-4344863b82c8","Type":"ContainerStarted","Data":"14fc32851877a39686ad8fa65511f90d51499d3d2b4289992ed29fe70a46ada3"}
Nov 02 22:04:48.116816 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:48.116783    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:48.217159 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:48.216984    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:48.286588 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:48.286452    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:52.097444 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:52.097411    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-j9zmw" event={"ID":"f60fe2c2-81e5-4f1e-8ca1-60158acf9278","Type":"ContainerStarted","Data":"b3dfab1ec3972cbf5726704578d8f890130cfd9e5045ff6a8b461aef8dc94c1d"}
Nov 02 22:04:52.098306 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:52.098284    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-j9zmw"
Nov 02 22:04:52.117835 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:52.117783    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-j9zmw" podStartSLOduration=2.204629744 podStartE2EDuration="6.117763949s" totalImagesPullingTime="3.913134205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:04:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:04:52.114336292 +0000 UTC m=+401.170670673" watchObservedRunningTime="2026-11-02 22:04:52.117763949 +0000 UTC m=+401.174098326"
Nov 02 22:04:52.964419 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:52.964388    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:04:53.108240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:53.107486    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck" event={"ID":"ea4ab2c0-e647-46ac-a15f-4344863b82c8","Type":"ContainerStarted","Data":"1c7a7d02919e2ab880643ed891997bea5c77c71cefa6d9093ff0a460bbe16579"}
Nov 02 22:04:53.108710 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:53.108431    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck"
Nov 02 22:04:53.113244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:53.111859    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-bdsrg" event={"ID":"aabf1bfc-ffbc-4de0-a8e6-b2e45ef0204d","Type":"ContainerStarted","Data":"8d44df768432bd6e091e8ab5829782daa051803b592d542dda3b4c9de97a6413"}
Nov 02 22:04:53.113244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:53.111905    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-bdsrg"
Nov 02 22:04:53.126253 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:53.126181    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck" podStartSLOduration=2.828316837 podStartE2EDuration="7.126165088s" totalImagesPullingTime="4.297848251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:04:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:04:53.12501558 +0000 UTC m=+402.181349962" watchObservedRunningTime="2026-11-02 22:04:53.126165088 +0000 UTC m=+402.182499470"
Nov 02 22:04:53.142230 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:53.142173    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-bdsrg" podStartSLOduration=2.389323216 podStartE2EDuration="7.142157396s" totalImagesPullingTime="4.75283418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:04:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:04:53.141906106 +0000 UTC m=+402.198240487" watchObservedRunningTime="2026-11-02 22:04:53.142157396 +0000 UTC m=+402.198491777"
Nov 02 22:04:54.005198 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:54.005172    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68bfb5556c-4kwpw"
Nov 02 22:04:54.005383 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:54.005306    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-579cf7c6d-bl2bc"
Nov 02 22:04:54.067117 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:54.067076    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-bl2bc"]
Nov 02 22:04:54.119602 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:54.119562    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-n2xfv" event={"ID":"7453965d-d179-4e30-b187-5e0abf2a56f9","Type":"ContainerStarted","Data":"3b8d5c738f195423f9f7b1b4ec0ff64e457e8546c779232b3a48921fbc3ff1d5"}
Nov 02 22:04:54.120093 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:54.119710    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-579cf7c6d-bl2bc" podUID="8e5b819b-b6db-4ad9-bd62-650f04f1c094" containerName="manager" containerID="cri-o://f19b144caaba449b65a356207a116692c6071b8bd30e8c31e8a801f80a9a8c83" gracePeriod=30
Nov 02 22:04:54.120093 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:54.119960    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-n2xfv"
Nov 02 22:04:54.136122 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:54.136061    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-n2xfv" podStartSLOduration=1.745639786 podStartE2EDuration="7.136047363s" totalImagesPullingTime="5.390407577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:04:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:04:54.134815405 +0000 UTC m=+403.191149835" watchObservedRunningTime="2026-11-02 22:04:54.136047363 +0000 UTC m=+403.192381766"
Nov 02 22:04:54.391563 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:54.391537    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-bl2bc"
Nov 02 22:04:54.456557 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:54.456508    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8e5b819b-b6db-4ad9-bd62-650f04f1c094-webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e5b819b-b6db-4ad9-bd62-650f04f1c094-webhook-cert\") pod \"8e5b819b-b6db-4ad9-bd62-650f04f1c094\" (UID: \"8e5b819b-b6db-4ad9-bd62-650f04f1c094\") "
Nov 02 22:04:54.456723 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:54.456621    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8e5b819b-b6db-4ad9-bd62-650f04f1c094-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e5b819b-b6db-4ad9-bd62-650f04f1c094-metrics-certs\") pod \"8e5b819b-b6db-4ad9-bd62-650f04f1c094\" (UID: \"8e5b819b-b6db-4ad9-bd62-650f04f1c094\") "
Nov 02 22:04:54.456776 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:54.456754    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e5b819b-b6db-4ad9-bd62-650f04f1c094-kube-api-access-xxl8f\" (UniqueName: \"kubernetes.io/projected/8e5b819b-b6db-4ad9-bd62-650f04f1c094-kube-api-access-xxl8f\") pod \"8e5b819b-b6db-4ad9-bd62-650f04f1c094\" (UID: \"8e5b819b-b6db-4ad9-bd62-650f04f1c094\") "
Nov 02 22:04:54.459275 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:54.459240    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e5b819b-b6db-4ad9-bd62-650f04f1c094-metrics-certs" pod "8e5b819b-b6db-4ad9-bd62-650f04f1c094" (UID: "8e5b819b-b6db-4ad9-bd62-650f04f1c094"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:04:54.459428 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:54.459293    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e5b819b-b6db-4ad9-bd62-650f04f1c094-kube-api-access-xxl8f" pod "8e5b819b-b6db-4ad9-bd62-650f04f1c094" (UID: "8e5b819b-b6db-4ad9-bd62-650f04f1c094"). InnerVolumeSpecName "kube-api-access-xxl8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:04:54.468658 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:54.468626    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e5b819b-b6db-4ad9-bd62-650f04f1c094-webhook-cert" pod "8e5b819b-b6db-4ad9-bd62-650f04f1c094" (UID: "8e5b819b-b6db-4ad9-bd62-650f04f1c094"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:04:54.558278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:54.558186    5076 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e5b819b-b6db-4ad9-bd62-650f04f1c094-webhook-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:04:54.558278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:54.558254    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e5b819b-b6db-4ad9-bd62-650f04f1c094-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:04:54.558278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:54.558272    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxl8f\" (UniqueName: \"kubernetes.io/projected/8e5b819b-b6db-4ad9-bd62-650f04f1c094-kube-api-access-xxl8f\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:04:55.127140 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:55.127103    5076 generic.go:356] "Generic (PLEG): container finished" podID="8e5b819b-b6db-4ad9-bd62-650f04f1c094" containerID="f19b144caaba449b65a356207a116692c6071b8bd30e8c31e8a801f80a9a8c83" exitCode=0
Nov 02 22:04:55.127637 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:55.127162    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-bl2bc"
Nov 02 22:04:55.127637 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:55.127192    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-bl2bc" event={"ID":"8e5b819b-b6db-4ad9-bd62-650f04f1c094","Type":"ContainerDied","Data":"f19b144caaba449b65a356207a116692c6071b8bd30e8c31e8a801f80a9a8c83"}
Nov 02 22:04:55.127637 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:55.127283    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-bl2bc" event={"ID":"8e5b819b-b6db-4ad9-bd62-650f04f1c094","Type":"ContainerDied","Data":"85ed80aee66000e89827fc66645fb14d69606838afdddb475ec023f9c1846c91"}
Nov 02 22:04:55.127637 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:55.127315    5076 scope.go:122] "RemoveContainer" containerID="f19b144caaba449b65a356207a116692c6071b8bd30e8c31e8a801f80a9a8c83"
Nov 02 22:04:55.138998 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:55.138978    5076 scope.go:122] "RemoveContainer" containerID="f19b144caaba449b65a356207a116692c6071b8bd30e8c31e8a801f80a9a8c83"
Nov 02 22:04:55.139344 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:04:55.139319    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f19b144caaba449b65a356207a116692c6071b8bd30e8c31e8a801f80a9a8c83\": container with ID starting with f19b144caaba449b65a356207a116692c6071b8bd30e8c31e8a801f80a9a8c83 not found: ID does not exist" containerID="f19b144caaba449b65a356207a116692c6071b8bd30e8c31e8a801f80a9a8c83"
Nov 02 22:04:55.139450 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:55.139357    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f19b144caaba449b65a356207a116692c6071b8bd30e8c31e8a801f80a9a8c83"} err="failed to get container status \"f19b144caaba449b65a356207a116692c6071b8bd30e8c31e8a801f80a9a8c83\": rpc error: code = NotFound desc = could not find container \"f19b144caaba449b65a356207a116692c6071b8bd30e8c31e8a801f80a9a8c83\": container with ID starting with f19b144caaba449b65a356207a116692c6071b8bd30e8c31e8a801f80a9a8c83 not found: ID does not exist"
Nov 02 22:04:55.144139 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:55.144118    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-bl2bc"]
Nov 02 22:04:55.148212 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:55.148187    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-bl2bc"]
Nov 02 22:04:57.055137 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:04:57.055099    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8e5b819b-b6db-4ad9-bd62-650f04f1c094" path="/var/lib/kubelet/pods/8e5b819b-b6db-4ad9-bd62-650f04f1c094/volumes"
Nov 02 22:04:59.887345 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:04:59.887268    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:05:00.158884 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:00.158815    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2" event={"ID":"b256cdd6-7969-421d-9639-3287e938b8c7","Type":"ContainerStarted","Data":"650e383de673d508cc6feae36580c08ea422dba488a02b9d69a7b457b53da760"}
Nov 02 22:05:00.159015 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:00.158946    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2"
Nov 02 22:05:00.177631 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:00.177581    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2" podStartSLOduration=1.775683087 podStartE2EDuration="17.177564431s" totalImagesPullingTime="15.401881344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:04:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:05:00.174153863 +0000 UTC m=+409.230488244" watchObservedRunningTime="2026-11-02 22:05:00.177564431 +0000 UTC m=+409.233898817"
Nov 02 22:05:04.124269 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:04.124236    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-j9zmw"
Nov 02 22:05:05.129933 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:05.129901    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-n2xfv"
Nov 02 22:05:11.170091 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:11.170060    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6qvf2"
Nov 02 22:05:12.175082 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:12.175043    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:05:12.277551 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:12.277506    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:05:13.488928 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:13.488891    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:05:13.590478 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:13.590426    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:05:13.689232 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:13.689188    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:05:13.789195 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:13.789110    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:05:24.011111 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.011072    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:05:24.125850 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.125818    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-bdsrg"
Nov 02 22:05:24.262006 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.261921    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:05:24.289364 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.289335    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6dd76875b5-tq7ks"]
Nov 02 22:05:24.289808 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.289790    5076 cpu_manager.go:414] "containerMap: removing container" podUID="8e5b819b-b6db-4ad9-bd62-650f04f1c094" containerName="manager"
Nov 02 22:05:24.289903 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.289809    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e5b819b-b6db-4ad9-bd62-650f04f1c094" containerName="manager"
Nov 02 22:05:24.289965 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.289907    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="8e5b819b-b6db-4ad9-bd62-650f04f1c094" containerName="manager"
Nov 02 22:05:24.319894 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.319869    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-tq7ks"]
Nov 02 22:05:24.320031 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.319956    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-tq7ks"
Nov 02 22:05:24.325361 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.325338    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-tq7ks"]
Nov 02 22:05:24.329353 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.329334    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Nov 02 22:05:24.344723 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:05:24.344694    5076 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2z9kk tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-2z9kk tls-cert]: context canceled" pod="kuadrant-system/authorino-6dd76875b5-tq7ks" podUID="f7b097f9-b09c-4343-8a9d-4abe43ac29ca"
Nov 02 22:05:24.457238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.351300    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-tf7rq"]
Nov 02 22:05:24.457238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.354678    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7b097f9-b09c-4343-8a9d-4abe43ac29ca-tls-cert\") pod \"authorino-6dd76875b5-tq7ks\" (UID: \"f7b097f9-b09c-4343-8a9d-4abe43ac29ca\") " pod="kuadrant-system/authorino-6dd76875b5-tq7ks"
Nov 02 22:05:24.457238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.354775    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z9kk\" (UniqueName: \"kubernetes.io/projected/f7b097f9-b09c-4343-8a9d-4abe43ac29ca-kube-api-access-2z9kk\") pod \"authorino-6dd76875b5-tq7ks\" (UID: \"f7b097f9-b09c-4343-8a9d-4abe43ac29ca\") " pod="kuadrant-system/authorino-6dd76875b5-tq7ks"
Nov 02 22:05:24.457238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.366841    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-tf7rq"]
Nov 02 22:05:24.457238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.366943    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-tf7rq"
Nov 02 22:05:24.457238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.455506    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z9kk\" (UniqueName: \"kubernetes.io/projected/f7b097f9-b09c-4343-8a9d-4abe43ac29ca-kube-api-access-2z9kk\") pod \"authorino-6dd76875b5-tq7ks\" (UID: \"f7b097f9-b09c-4343-8a9d-4abe43ac29ca\") " pod="kuadrant-system/authorino-6dd76875b5-tq7ks"
Nov 02 22:05:24.457238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.455550    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7b097f9-b09c-4343-8a9d-4abe43ac29ca-tls-cert\") pod \"authorino-6dd76875b5-tq7ks\" (UID: \"f7b097f9-b09c-4343-8a9d-4abe43ac29ca\") " pod="kuadrant-system/authorino-6dd76875b5-tq7ks"
Nov 02 22:05:24.457238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.455592    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5d0c0b7-d595-499e-98ad-7089445fd7cd-tls-cert\") pod \"authorino-6889cbd8c4-tf7rq\" (UID: \"d5d0c0b7-d595-499e-98ad-7089445fd7cd\") " pod="kuadrant-system/authorino-6889cbd8c4-tf7rq"
Nov 02 22:05:24.457238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.455627    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgjbd\" (UniqueName: \"kubernetes.io/projected/d5d0c0b7-d595-499e-98ad-7089445fd7cd-kube-api-access-vgjbd\") pod \"authorino-6889cbd8c4-tf7rq\" (UID: \"d5d0c0b7-d595-499e-98ad-7089445fd7cd\") " pod="kuadrant-system/authorino-6889cbd8c4-tf7rq"
Nov 02 22:05:24.458059 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.458037    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7b097f9-b09c-4343-8a9d-4abe43ac29ca-tls-cert\") pod \"authorino-6dd76875b5-tq7ks\" (UID: \"f7b097f9-b09c-4343-8a9d-4abe43ac29ca\") " pod="kuadrant-system/authorino-6dd76875b5-tq7ks"
Nov 02 22:05:24.463602 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.463575    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z9kk\" (UniqueName: \"kubernetes.io/projected/f7b097f9-b09c-4343-8a9d-4abe43ac29ca-kube-api-access-2z9kk\") pod \"authorino-6dd76875b5-tq7ks\" (UID: \"f7b097f9-b09c-4343-8a9d-4abe43ac29ca\") " pod="kuadrant-system/authorino-6dd76875b5-tq7ks"
Nov 02 22:05:24.557022 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.556955    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5d0c0b7-d595-499e-98ad-7089445fd7cd-tls-cert\") pod \"authorino-6889cbd8c4-tf7rq\" (UID: \"d5d0c0b7-d595-499e-98ad-7089445fd7cd\") " pod="kuadrant-system/authorino-6889cbd8c4-tf7rq"
Nov 02 22:05:24.557022 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.557017    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgjbd\" (UniqueName: \"kubernetes.io/projected/d5d0c0b7-d595-499e-98ad-7089445fd7cd-kube-api-access-vgjbd\") pod \"authorino-6889cbd8c4-tf7rq\" (UID: \"d5d0c0b7-d595-499e-98ad-7089445fd7cd\") " pod="kuadrant-system/authorino-6889cbd8c4-tf7rq"
Nov 02 22:05:24.559371 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.559353    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5d0c0b7-d595-499e-98ad-7089445fd7cd-tls-cert\") pod \"authorino-6889cbd8c4-tf7rq\" (UID: \"d5d0c0b7-d595-499e-98ad-7089445fd7cd\") " pod="kuadrant-system/authorino-6889cbd8c4-tf7rq"
Nov 02 22:05:24.564984 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.564958    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgjbd\" (UniqueName: \"kubernetes.io/projected/d5d0c0b7-d595-499e-98ad-7089445fd7cd-kube-api-access-vgjbd\") pod \"authorino-6889cbd8c4-tf7rq\" (UID: \"d5d0c0b7-d595-499e-98ad-7089445fd7cd\") " pod="kuadrant-system/authorino-6889cbd8c4-tf7rq"
Nov 02 22:05:24.664362 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.664323    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-tf7rq"]
Nov 02 22:05:24.664534 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.664523    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-tf7rq"
Nov 02 22:05:24.684771 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.684742    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-757dcb578-crgcc"]
Nov 02 22:05:24.703682 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.703645    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-757dcb578-crgcc"]
Nov 02 22:05:24.703814 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.703686    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-757dcb578-crgcc"
Nov 02 22:05:24.758829 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.758798    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9e2715f3-9c15-41d9-a1ef-7f4152655cb1-tls-cert\") pod \"authorino-757dcb578-crgcc\" (UID: \"9e2715f3-9c15-41d9-a1ef-7f4152655cb1\") " pod="kuadrant-system/authorino-757dcb578-crgcc"
Nov 02 22:05:24.758998 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.758863    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9x7k\" (UniqueName: \"kubernetes.io/projected/9e2715f3-9c15-41d9-a1ef-7f4152655cb1-kube-api-access-g9x7k\") pod \"authorino-757dcb578-crgcc\" (UID: \"9e2715f3-9c15-41d9-a1ef-7f4152655cb1\") " pod="kuadrant-system/authorino-757dcb578-crgcc"
Nov 02 22:05:24.860154 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.860120    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9e2715f3-9c15-41d9-a1ef-7f4152655cb1-tls-cert\") pod \"authorino-757dcb578-crgcc\" (UID: \"9e2715f3-9c15-41d9-a1ef-7f4152655cb1\") " pod="kuadrant-system/authorino-757dcb578-crgcc"
Nov 02 22:05:24.860342 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.860233    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9x7k\" (UniqueName: \"kubernetes.io/projected/9e2715f3-9c15-41d9-a1ef-7f4152655cb1-kube-api-access-g9x7k\") pod \"authorino-757dcb578-crgcc\" (UID: \"9e2715f3-9c15-41d9-a1ef-7f4152655cb1\") " pod="kuadrant-system/authorino-757dcb578-crgcc"
Nov 02 22:05:24.862560 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.862539    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9e2715f3-9c15-41d9-a1ef-7f4152655cb1-tls-cert\") pod \"authorino-757dcb578-crgcc\" (UID: \"9e2715f3-9c15-41d9-a1ef-7f4152655cb1\") " pod="kuadrant-system/authorino-757dcb578-crgcc"
Nov 02 22:05:24.867817 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.867796    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9x7k\" (UniqueName: \"kubernetes.io/projected/9e2715f3-9c15-41d9-a1ef-7f4152655cb1-kube-api-access-g9x7k\") pod \"authorino-757dcb578-crgcc\" (UID: \"9e2715f3-9c15-41d9-a1ef-7f4152655cb1\") " pod="kuadrant-system/authorino-757dcb578-crgcc"
Nov 02 22:05:24.949639 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:24.949614    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-tf7rq"]
Nov 02 22:05:24.951058 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:05:24.951032    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5d0c0b7_d595_499e_98ad_7089445fd7cd.slice/crio-e2a568cd9b0bd7672e0bb6796b383e48a4e0e9c6a3494693f92fedfd8d533076 WatchSource:0}: Error finding container e2a568cd9b0bd7672e0bb6796b383e48a4e0e9c6a3494693f92fedfd8d533076: Status 404 returned error can't find the container with id e2a568cd9b0bd7672e0bb6796b383e48a4e0e9c6a3494693f92fedfd8d533076
Nov 02 22:05:25.034060 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:25.034034    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-757dcb578-crgcc"
Nov 02 22:05:25.129670 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:25.129640    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck"
Nov 02 22:05:25.292037 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:25.292005    5076 generic.go:356] "Generic (PLEG): container finished" podID="c0d2ada9-88d6-40b1-96d3-ef5d72c48295" containerID="2f65293ec85e72813bfa00ba83a0301972fb0b97db992877d6d450983df39069" exitCode=0
Nov 02 22:05:25.292255 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:25.292081    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd" event={"ID":"c0d2ada9-88d6-40b1-96d3-ef5d72c48295","Type":"ContainerDied","Data":"2f65293ec85e72813bfa00ba83a0301972fb0b97db992877d6d450983df39069"}
Nov 02 22:05:25.292480 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:25.292462    5076 scope.go:122] "RemoveContainer" containerID="2f65293ec85e72813bfa00ba83a0301972fb0b97db992877d6d450983df39069"
Nov 02 22:05:25.293514 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:25.293494    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-tq7ks"
Nov 02 22:05:25.293606 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:25.293499    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-tf7rq" event={"ID":"d5d0c0b7-d595-499e-98ad-7089445fd7cd","Type":"ContainerStarted","Data":"e2a568cd9b0bd7672e0bb6796b383e48a4e0e9c6a3494693f92fedfd8d533076"}
Nov 02 22:05:25.293606 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:25.293570    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:05:25.293681 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:25.293633    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:05:25.293681 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:25.293664    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:05:25.325863 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:25.325842    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-tq7ks"
Nov 02 22:05:25.330652 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:25.330624    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-757dcb578-crgcc"]
Nov 02 22:05:25.364919 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:25.364891    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f7b097f9-b09c-4343-8a9d-4abe43ac29ca-tls-cert\" (UniqueName: \"kubernetes.io/secret/f7b097f9-b09c-4343-8a9d-4abe43ac29ca-tls-cert\") pod \"f7b097f9-b09c-4343-8a9d-4abe43ac29ca\" (UID: \"f7b097f9-b09c-4343-8a9d-4abe43ac29ca\") "
Nov 02 22:05:25.365113 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:25.364972    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f7b097f9-b09c-4343-8a9d-4abe43ac29ca-kube-api-access-2z9kk\" (UniqueName: \"kubernetes.io/projected/f7b097f9-b09c-4343-8a9d-4abe43ac29ca-kube-api-access-2z9kk\") pod \"f7b097f9-b09c-4343-8a9d-4abe43ac29ca\" (UID: \"f7b097f9-b09c-4343-8a9d-4abe43ac29ca\") "
Nov 02 22:05:25.367152 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:25.367127    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7b097f9-b09c-4343-8a9d-4abe43ac29ca-tls-cert" pod "f7b097f9-b09c-4343-8a9d-4abe43ac29ca" (UID: "f7b097f9-b09c-4343-8a9d-4abe43ac29ca"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:05:25.367276 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:25.367207    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b097f9-b09c-4343-8a9d-4abe43ac29ca-kube-api-access-2z9kk" pod "f7b097f9-b09c-4343-8a9d-4abe43ac29ca" (UID: "f7b097f9-b09c-4343-8a9d-4abe43ac29ca"). InnerVolumeSpecName "kube-api-access-2z9kk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:05:25.465862 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:25.465779    5076 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7b097f9-b09c-4343-8a9d-4abe43ac29ca-tls-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:05:25.465862 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:25.465807    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z9kk\" (UniqueName: \"kubernetes.io/projected/f7b097f9-b09c-4343-8a9d-4abe43ac29ca-kube-api-access-2z9kk\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:05:26.301597 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:26.301560    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd" event={"ID":"c0d2ada9-88d6-40b1-96d3-ef5d72c48295","Type":"ContainerStarted","Data":"64a226c06fb97f4e919bb60c3d91f9df835732a317da813ea99a30cda9d234af"}
Nov 02 22:05:26.302887 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:26.302865    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-tq7ks"
Nov 02 22:05:26.303031 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:26.302888    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-757dcb578-crgcc" event={"ID":"9e2715f3-9c15-41d9-a1ef-7f4152655cb1","Type":"ContainerStarted","Data":"3a41a2eb5eea70a5807ac7a2d5e0acf74790bf45ba9325d8374f4aeb7da402e7"}
Nov 02 22:05:26.345631 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:26.345569    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-tq7ks"]
Nov 02 22:05:26.349533 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:26.349509    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-tq7ks"]
Nov 02 22:05:27.062074 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.061969    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f7b097f9-b09c-4343-8a9d-4abe43ac29ca" path="/var/lib/kubelet/pods/f7b097f9-b09c-4343-8a9d-4abe43ac29ca/volumes"
Nov 02 22:05:27.140328 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.140292    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:05:27.144112 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.144078    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-wxsbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" start-of-body=
Nov 02 22:05:27.144288 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.144136    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd" podUID="c0d2ada9-88d6-40b1-96d3-ef5d72c48295" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused"
Nov 02 22:05:27.315369 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.314865    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-757dcb578-crgcc" event={"ID":"9e2715f3-9c15-41d9-a1ef-7f4152655cb1","Type":"ContainerStarted","Data":"ea67fbfc66ef51d9cd3c691dcaf3ea0cfba345e288c7aca0b5ec0b38973a7043"}
Nov 02 22:05:27.322390 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.322351    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-tf7rq" event={"ID":"d5d0c0b7-d595-499e-98ad-7089445fd7cd","Type":"ContainerStarted","Data":"443e40a3954f58cc55fd0b694131a9fda6c05b564f7f643875061d7ad70fcaa5"}
Nov 02 22:05:27.322652 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.322627    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6889cbd8c4-tf7rq" podUID="d5d0c0b7-d595-499e-98ad-7089445fd7cd" containerName="authorino" containerID="cri-o://443e40a3954f58cc55fd0b694131a9fda6c05b564f7f643875061d7ad70fcaa5" gracePeriod=30
Nov 02 22:05:27.364242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.364024    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-757dcb578-crgcc" podStartSLOduration=2.055584303 podStartE2EDuration="3.363991757s" totalImagesPullingTime="1.308407454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:05:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:05:27.333577581 +0000 UTC m=+436.389911961" watchObservedRunningTime="2026-11-02 22:05:27.363991757 +0000 UTC m=+436.420326149"
Nov 02 22:05:27.416934 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.416876    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6889cbd8c4-tf7rq" podStartSLOduration=1.767827575 podStartE2EDuration="3.416840405s" totalImagesPullingTime="1.64901283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:05:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:05:27.410740769 +0000 UTC m=+436.467075149" watchObservedRunningTime="2026-11-02 22:05:27.416840405 +0000 UTC m=+436.473174785"
Nov 02 22:05:27.418653 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.418622    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-jc8z9"]
Nov 02 22:05:27.418901 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.418873    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-jc8z9" podUID="1d4485e5-3432-4a5c-a279-a198a5ddcb1d" containerName="authorino" containerID="cri-o://a28f7eaef133df0aa139ed588fb13cb8360d5c6318017c8e9de24dfe52df95d4" gracePeriod=30
Nov 02 22:05:27.641233 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.641199    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-tf7rq"
Nov 02 22:05:27.713699 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.713350    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d5d0c0b7-d595-499e-98ad-7089445fd7cd-tls-cert\" (UniqueName: \"kubernetes.io/secret/d5d0c0b7-d595-499e-98ad-7089445fd7cd-tls-cert\") pod \"d5d0c0b7-d595-499e-98ad-7089445fd7cd\" (UID: \"d5d0c0b7-d595-499e-98ad-7089445fd7cd\") "
Nov 02 22:05:27.713699 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.713466    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d5d0c0b7-d595-499e-98ad-7089445fd7cd-kube-api-access-vgjbd\" (UniqueName: \"kubernetes.io/projected/d5d0c0b7-d595-499e-98ad-7089445fd7cd-kube-api-access-vgjbd\") pod \"d5d0c0b7-d595-499e-98ad-7089445fd7cd\" (UID: \"d5d0c0b7-d595-499e-98ad-7089445fd7cd\") "
Nov 02 22:05:27.720606 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.720562    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5d0c0b7-d595-499e-98ad-7089445fd7cd-kube-api-access-vgjbd" pod "d5d0c0b7-d595-499e-98ad-7089445fd7cd" (UID: "d5d0c0b7-d595-499e-98ad-7089445fd7cd"). InnerVolumeSpecName "kube-api-access-vgjbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:05:27.728750 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.728713    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5d0c0b7-d595-499e-98ad-7089445fd7cd-tls-cert" pod "d5d0c0b7-d595-499e-98ad-7089445fd7cd" (UID: "d5d0c0b7-d595-499e-98ad-7089445fd7cd"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:05:27.791243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.781821    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-jc8z9"
Nov 02 22:05:27.814755 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.814728    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1d4485e5-3432-4a5c-a279-a198a5ddcb1d-kube-api-access-w24zq\" (UniqueName: \"kubernetes.io/projected/1d4485e5-3432-4a5c-a279-a198a5ddcb1d-kube-api-access-w24zq\") pod \"1d4485e5-3432-4a5c-a279-a198a5ddcb1d\" (UID: \"1d4485e5-3432-4a5c-a279-a198a5ddcb1d\") "
Nov 02 22:05:27.815111 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.815096    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgjbd\" (UniqueName: \"kubernetes.io/projected/d5d0c0b7-d595-499e-98ad-7089445fd7cd-kube-api-access-vgjbd\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:05:27.815201 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.815192    5076 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5d0c0b7-d595-499e-98ad-7089445fd7cd-tls-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:05:27.816710 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.816686    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d4485e5-3432-4a5c-a279-a198a5ddcb1d-kube-api-access-w24zq" pod "1d4485e5-3432-4a5c-a279-a198a5ddcb1d" (UID: "1d4485e5-3432-4a5c-a279-a198a5ddcb1d"). InnerVolumeSpecName "kube-api-access-w24zq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:05:27.916496 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:27.916417    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w24zq\" (UniqueName: \"kubernetes.io/projected/1d4485e5-3432-4a5c-a279-a198a5ddcb1d-kube-api-access-w24zq\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:05:28.140768 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:28.140733    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-wxsbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" start-of-body=
Nov 02 22:05:28.140915 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:28.140789    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd" podUID="c0d2ada9-88d6-40b1-96d3-ef5d72c48295" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused"
Nov 02 22:05:28.329108 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:28.329021    5076 generic.go:356] "Generic (PLEG): container finished" podID="d5d0c0b7-d595-499e-98ad-7089445fd7cd" containerID="443e40a3954f58cc55fd0b694131a9fda6c05b564f7f643875061d7ad70fcaa5" exitCode=0
Nov 02 22:05:28.329108 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:28.329070    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-tf7rq"
Nov 02 22:05:28.329608 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:28.329113    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-tf7rq" event={"ID":"d5d0c0b7-d595-499e-98ad-7089445fd7cd","Type":"ContainerDied","Data":"443e40a3954f58cc55fd0b694131a9fda6c05b564f7f643875061d7ad70fcaa5"}
Nov 02 22:05:28.329608 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:28.329161    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-tf7rq" event={"ID":"d5d0c0b7-d595-499e-98ad-7089445fd7cd","Type":"ContainerDied","Data":"e2a568cd9b0bd7672e0bb6796b383e48a4e0e9c6a3494693f92fedfd8d533076"}
Nov 02 22:05:28.329608 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:28.329186    5076 scope.go:122] "RemoveContainer" containerID="443e40a3954f58cc55fd0b694131a9fda6c05b564f7f643875061d7ad70fcaa5"
Nov 02 22:05:28.330497 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:28.330476    5076 generic.go:356] "Generic (PLEG): container finished" podID="1d4485e5-3432-4a5c-a279-a198a5ddcb1d" containerID="a28f7eaef133df0aa139ed588fb13cb8360d5c6318017c8e9de24dfe52df95d4" exitCode=0
Nov 02 22:05:28.330596 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:28.330505    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-jc8z9" event={"ID":"1d4485e5-3432-4a5c-a279-a198a5ddcb1d","Type":"ContainerDied","Data":"a28f7eaef133df0aa139ed588fb13cb8360d5c6318017c8e9de24dfe52df95d4"}
Nov 02 22:05:28.330596 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:28.330534    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-jc8z9"
Nov 02 22:05:28.330678 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:28.330540    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-jc8z9" event={"ID":"1d4485e5-3432-4a5c-a279-a198a5ddcb1d","Type":"ContainerDied","Data":"ccf0398461bb72e4ade98109c1aebdad585da4b23ae228fad0e7e29de646fca0"}
Nov 02 22:05:28.337991 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:28.337973    5076 scope.go:122] "RemoveContainer" containerID="443e40a3954f58cc55fd0b694131a9fda6c05b564f7f643875061d7ad70fcaa5"
Nov 02 22:05:28.338285 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:05:28.338265    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"443e40a3954f58cc55fd0b694131a9fda6c05b564f7f643875061d7ad70fcaa5\": container with ID starting with 443e40a3954f58cc55fd0b694131a9fda6c05b564f7f643875061d7ad70fcaa5 not found: ID does not exist" containerID="443e40a3954f58cc55fd0b694131a9fda6c05b564f7f643875061d7ad70fcaa5"
Nov 02 22:05:28.338344 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:28.338294    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"443e40a3954f58cc55fd0b694131a9fda6c05b564f7f643875061d7ad70fcaa5"} err="failed to get container status \"443e40a3954f58cc55fd0b694131a9fda6c05b564f7f643875061d7ad70fcaa5\": rpc error: code = NotFound desc = could not find container \"443e40a3954f58cc55fd0b694131a9fda6c05b564f7f643875061d7ad70fcaa5\": container with ID starting with 443e40a3954f58cc55fd0b694131a9fda6c05b564f7f643875061d7ad70fcaa5 not found: ID does not exist"
Nov 02 22:05:28.338344 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:28.338311    5076 scope.go:122] "RemoveContainer" containerID="a28f7eaef133df0aa139ed588fb13cb8360d5c6318017c8e9de24dfe52df95d4"
Nov 02 22:05:28.346296 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:28.346281    5076 scope.go:122] "RemoveContainer" containerID="a28f7eaef133df0aa139ed588fb13cb8360d5c6318017c8e9de24dfe52df95d4"
Nov 02 22:05:28.346577 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:05:28.346557    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a28f7eaef133df0aa139ed588fb13cb8360d5c6318017c8e9de24dfe52df95d4\": container with ID starting with a28f7eaef133df0aa139ed588fb13cb8360d5c6318017c8e9de24dfe52df95d4 not found: ID does not exist" containerID="a28f7eaef133df0aa139ed588fb13cb8360d5c6318017c8e9de24dfe52df95d4"
Nov 02 22:05:28.346640 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:28.346583    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a28f7eaef133df0aa139ed588fb13cb8360d5c6318017c8e9de24dfe52df95d4"} err="failed to get container status \"a28f7eaef133df0aa139ed588fb13cb8360d5c6318017c8e9de24dfe52df95d4\": rpc error: code = NotFound desc = could not find container \"a28f7eaef133df0aa139ed588fb13cb8360d5c6318017c8e9de24dfe52df95d4\": container with ID starting with a28f7eaef133df0aa139ed588fb13cb8360d5c6318017c8e9de24dfe52df95d4 not found: ID does not exist"
Nov 02 22:05:28.354709 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:28.354687    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-jc8z9"]
Nov 02 22:05:28.357920 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:28.357897    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-jc8z9"]
Nov 02 22:05:28.387340 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:28.387279    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-tf7rq"]
Nov 02 22:05:28.392245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:28.391981    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-tf7rq"]
Nov 02 22:05:29.052734 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:29.052658    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1d4485e5-3432-4a5c-a279-a198a5ddcb1d" path="/var/lib/kubelet/pods/1d4485e5-3432-4a5c-a279-a198a5ddcb1d/volumes"
Nov 02 22:05:29.053053 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:29.053038    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d5d0c0b7-d595-499e-98ad-7089445fd7cd" path="/var/lib/kubelet/pods/d5d0c0b7-d595-499e-98ad-7089445fd7cd/volumes"
Nov 02 22:05:29.139783 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:29.139748    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-wxsbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" start-of-body=
Nov 02 22:05:29.139948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:29.139800    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd" podUID="c0d2ada9-88d6-40b1-96d3-ef5d72c48295" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused"
Nov 02 22:05:29.912752 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:05:29.912718    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:05:30.140148 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:30.140109    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-wxsbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" start-of-body=
Nov 02 22:05:30.140349 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:30.140183    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd" podUID="c0d2ada9-88d6-40b1-96d3-ef5d72c48295" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused"
Nov 02 22:05:31.140034 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:31.139992    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-wxsbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" start-of-body=
Nov 02 22:05:31.140465 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:31.140065    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd" podUID="c0d2ada9-88d6-40b1-96d3-ef5d72c48295" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused"
Nov 02 22:05:31.152869 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:31.152847    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:05:32.144447 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:32.144413    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:05:32.145408 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:32.145381    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd"
Nov 02 22:05:33.209275 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:33.209241    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:05:43.789751 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:43.789717    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:05:44.919743 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:44.919707    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:05:48.383855 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:48.383812    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-l22dn"]
Nov 02 22:05:48.384474 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:48.384452    5076 cpu_manager.go:414] "containerMap: removing container" podUID="1d4485e5-3432-4a5c-a279-a198a5ddcb1d" containerName="authorino"
Nov 02 22:05:48.384528 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:48.384477    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1d4485e5-3432-4a5c-a279-a198a5ddcb1d" containerName="authorino"
Nov 02 22:05:48.384528 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:48.384498    5076 cpu_manager.go:414] "containerMap: removing container" podUID="d5d0c0b7-d595-499e-98ad-7089445fd7cd" containerName="authorino"
Nov 02 22:05:48.384528 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:48.384504    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d5d0c0b7-d595-499e-98ad-7089445fd7cd" containerName="authorino"
Nov 02 22:05:48.384637 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:48.384576    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="1d4485e5-3432-4a5c-a279-a198a5ddcb1d" containerName="authorino"
Nov 02 22:05:48.384637 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:48.384586    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="d5d0c0b7-d595-499e-98ad-7089445fd7cd" containerName="authorino"
Nov 02 22:05:48.401362 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:48.401335    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-l22dn"]
Nov 02 22:05:48.401526 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:48.401453    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-l22dn"
Nov 02 22:05:48.494979 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:48.494948    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b1a4e54-df82-49c1-b146-eb1e1c4561ea-cert\") pod \"llmisvc-controller-manager-6466c554d8-l22dn\" (UID: \"6b1a4e54-df82-49c1-b146-eb1e1c4561ea\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-l22dn"
Nov 02 22:05:48.495134 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:48.494983    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89ww7\" (UniqueName: \"kubernetes.io/projected/6b1a4e54-df82-49c1-b146-eb1e1c4561ea-kube-api-access-89ww7\") pod \"llmisvc-controller-manager-6466c554d8-l22dn\" (UID: \"6b1a4e54-df82-49c1-b146-eb1e1c4561ea\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-l22dn"
Nov 02 22:05:48.596283 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:48.596252    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b1a4e54-df82-49c1-b146-eb1e1c4561ea-cert\") pod \"llmisvc-controller-manager-6466c554d8-l22dn\" (UID: \"6b1a4e54-df82-49c1-b146-eb1e1c4561ea\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-l22dn"
Nov 02 22:05:48.596437 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:48.596287    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89ww7\" (UniqueName: \"kubernetes.io/projected/6b1a4e54-df82-49c1-b146-eb1e1c4561ea-kube-api-access-89ww7\") pod \"llmisvc-controller-manager-6466c554d8-l22dn\" (UID: \"6b1a4e54-df82-49c1-b146-eb1e1c4561ea\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-l22dn"
Nov 02 22:05:48.599482 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:48.599451    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b1a4e54-df82-49c1-b146-eb1e1c4561ea-cert\") pod \"llmisvc-controller-manager-6466c554d8-l22dn\" (UID: \"6b1a4e54-df82-49c1-b146-eb1e1c4561ea\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-l22dn"
Nov 02 22:05:48.604369 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:48.604344    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89ww7\" (UniqueName: \"kubernetes.io/projected/6b1a4e54-df82-49c1-b146-eb1e1c4561ea-kube-api-access-89ww7\") pod \"llmisvc-controller-manager-6466c554d8-l22dn\" (UID: \"6b1a4e54-df82-49c1-b146-eb1e1c4561ea\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-l22dn"
Nov 02 22:05:48.714923 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:48.714846    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-l22dn"
Nov 02 22:05:48.986862 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:48.986820    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-l22dn"]
Nov 02 22:05:48.987253 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:05:48.987204    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1a4e54_df82_49c1_b146_eb1e1c4561ea.slice/crio-4731c5cfe87906aa053dae50ab0b0d762423278a6f46ae39006a73e325072a42 WatchSource:0}: Error finding container 4731c5cfe87906aa053dae50ab0b0d762423278a6f46ae39006a73e325072a42: Status 404 returned error can't find the container with id 4731c5cfe87906aa053dae50ab0b0d762423278a6f46ae39006a73e325072a42
Nov 02 22:05:49.455067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:49.455029    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-l22dn" event={"ID":"6b1a4e54-df82-49c1-b146-eb1e1c4561ea","Type":"ContainerStarted","Data":"4731c5cfe87906aa053dae50ab0b0d762423278a6f46ae39006a73e325072a42"}
Nov 02 22:05:50.462089 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:50.462055    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-l22dn" event={"ID":"6b1a4e54-df82-49c1-b146-eb1e1c4561ea","Type":"ContainerStarted","Data":"80620a4f74af40c4a51ff0e9420e027fa956ca6d4df6c37e33646dff7cd545a5"}
Nov 02 22:05:50.462493 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:50.462116    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-l22dn"
Nov 02 22:05:50.479560 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:05:50.479510    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-l22dn" podStartSLOduration=2.00666128 podStartE2EDuration="2.479497085s" totalImagesPullingTime="472.835805ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:05:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:05:50.477285498 +0000 UTC m=+459.533619879" watchObservedRunningTime="2026-11-02 22:05:50.479497085 +0000 UTC m=+459.535831465"
Nov 02 22:05:59.887314 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:05:59.887211    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:06:21.468880 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:21.468844    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-l22dn"
Nov 02 22:06:21.510904 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:21.510872    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck"]
Nov 02 22:06:21.511076 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:21.511059    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck" podUID="ea4ab2c0-e647-46ac-a15f-4344863b82c8" containerName="manager" containerID="cri-o://1c7a7d02919e2ab880643ed891997bea5c77c71cefa6d9093ff0a460bbe16579" gracePeriod=30
Nov 02 22:06:21.757209 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:21.757186    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck"
Nov 02 22:06:21.780832 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:21.780803    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ea4ab2c0-e647-46ac-a15f-4344863b82c8-cert\" (UniqueName: \"kubernetes.io/secret/ea4ab2c0-e647-46ac-a15f-4344863b82c8-cert\") pod \"ea4ab2c0-e647-46ac-a15f-4344863b82c8\" (UID: \"ea4ab2c0-e647-46ac-a15f-4344863b82c8\") "
Nov 02 22:06:21.780959 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:21.780857    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ea4ab2c0-e647-46ac-a15f-4344863b82c8-kube-api-access-chmpf\" (UniqueName: \"kubernetes.io/projected/ea4ab2c0-e647-46ac-a15f-4344863b82c8-kube-api-access-chmpf\") pod \"ea4ab2c0-e647-46ac-a15f-4344863b82c8\" (UID: \"ea4ab2c0-e647-46ac-a15f-4344863b82c8\") "
Nov 02 22:06:21.782888 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:21.782854    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea4ab2c0-e647-46ac-a15f-4344863b82c8-cert" pod "ea4ab2c0-e647-46ac-a15f-4344863b82c8" (UID: "ea4ab2c0-e647-46ac-a15f-4344863b82c8"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:06:21.782888 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:21.782882    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea4ab2c0-e647-46ac-a15f-4344863b82c8-kube-api-access-chmpf" pod "ea4ab2c0-e647-46ac-a15f-4344863b82c8" (UID: "ea4ab2c0-e647-46ac-a15f-4344863b82c8"). InnerVolumeSpecName "kube-api-access-chmpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:06:21.881564 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:21.881525    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chmpf\" (UniqueName: \"kubernetes.io/projected/ea4ab2c0-e647-46ac-a15f-4344863b82c8-kube-api-access-chmpf\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:06:21.881564 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:21.881558    5076 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea4ab2c0-e647-46ac-a15f-4344863b82c8-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:06:22.328789 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:22.328751    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:06:22.449811 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:22.449773    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:06:22.623141 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:22.623103    5076 generic.go:356] "Generic (PLEG): container finished" podID="ea4ab2c0-e647-46ac-a15f-4344863b82c8" containerID="1c7a7d02919e2ab880643ed891997bea5c77c71cefa6d9093ff0a460bbe16579" exitCode=0
Nov 02 22:06:22.623528 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:22.623235    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck"
Nov 02 22:06:22.623528 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:22.623247    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck" event={"ID":"ea4ab2c0-e647-46ac-a15f-4344863b82c8","Type":"ContainerDied","Data":"1c7a7d02919e2ab880643ed891997bea5c77c71cefa6d9093ff0a460bbe16579"}
Nov 02 22:06:22.623528 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:22.623325    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck" event={"ID":"ea4ab2c0-e647-46ac-a15f-4344863b82c8","Type":"ContainerDied","Data":"14fc32851877a39686ad8fa65511f90d51499d3d2b4289992ed29fe70a46ada3"}
Nov 02 22:06:22.623528 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:22.623351    5076 scope.go:122] "RemoveContainer" containerID="1c7a7d02919e2ab880643ed891997bea5c77c71cefa6d9093ff0a460bbe16579"
Nov 02 22:06:22.632939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:22.632921    5076 scope.go:122] "RemoveContainer" containerID="1c7a7d02919e2ab880643ed891997bea5c77c71cefa6d9093ff0a460bbe16579"
Nov 02 22:06:22.633179 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:06:22.633160    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c7a7d02919e2ab880643ed891997bea5c77c71cefa6d9093ff0a460bbe16579\": container with ID starting with 1c7a7d02919e2ab880643ed891997bea5c77c71cefa6d9093ff0a460bbe16579 not found: ID does not exist" containerID="1c7a7d02919e2ab880643ed891997bea5c77c71cefa6d9093ff0a460bbe16579"
Nov 02 22:06:22.633248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:22.633188    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c7a7d02919e2ab880643ed891997bea5c77c71cefa6d9093ff0a460bbe16579"} err="failed to get container status \"1c7a7d02919e2ab880643ed891997bea5c77c71cefa6d9093ff0a460bbe16579\": rpc error: code = NotFound desc = could not find container \"1c7a7d02919e2ab880643ed891997bea5c77c71cefa6d9093ff0a460bbe16579\": container with ID starting with 1c7a7d02919e2ab880643ed891997bea5c77c71cefa6d9093ff0a460bbe16579 not found: ID does not exist"
Nov 02 22:06:22.644762 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:22.644742    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck"]
Nov 02 22:06:22.648356 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:22.648335    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-7btck"]
Nov 02 22:06:23.052353 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:23.052276    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ea4ab2c0-e647-46ac-a15f-4344863b82c8" path="/var/lib/kubelet/pods/ea4ab2c0-e647-46ac-a15f-4344863b82c8/volumes"
Nov 02 22:06:29.887942 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:06:29.887904    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:06:33.262268 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:33.262207    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:06:42.046670 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:42.046624    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:06:44.348785 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:44.348748    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:06:45.007202 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:45.007166    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:06:46.754172 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:46.754133    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:06:47.868381 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:47.868326    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:06:48.882696 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:48.882658    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:06:50.744914 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:50.744755    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:06:51.868794 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:06:51.868751    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:06:59.887777 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:06:59.887736    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:07:05.540546 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:05.540499    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:07:10.887834 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:10.887803    5076 generic.go:356] "Generic (PLEG): container finished" podID="85552a19-8cc3-48b4-9a5d-a3a5885c3222" containerID="d298a6c2d917cd759c09c712884a651eb50847fae8ac9130c4e6b09cb3eb73c2" exitCode=1
Nov 02 22:07:10.888187 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:10.887863    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68bfb5556c-4kwpw" event={"ID":"85552a19-8cc3-48b4-9a5d-a3a5885c3222","Type":"ContainerDied","Data":"d298a6c2d917cd759c09c712884a651eb50847fae8ac9130c4e6b09cb3eb73c2"}
Nov 02 22:07:10.888187 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:10.888169    5076 scope.go:122] "RemoveContainer" containerID="d298a6c2d917cd759c09c712884a651eb50847fae8ac9130c4e6b09cb3eb73c2"
Nov 02 22:07:11.894685 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:11.894652    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68bfb5556c-4kwpw" event={"ID":"85552a19-8cc3-48b4-9a5d-a3a5885c3222","Type":"ContainerStarted","Data":"15dd09d969dcbe763099ff50ae83120382b8cf0e4f21e08a7a056ef5ce87d003"}
Nov 02 22:07:11.895181 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:11.894860    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68bfb5556c-4kwpw"
Nov 02 22:07:22.902327 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:22.902287    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68bfb5556c-4kwpw"
Nov 02 22:07:28.795968 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:28.795937    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4ff58769-mqmxp"]
Nov 02 22:07:28.796362 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:28.796337    5076 cpu_manager.go:414] "containerMap: removing container" podUID="ea4ab2c0-e647-46ac-a15f-4344863b82c8" containerName="manager"
Nov 02 22:07:28.796362 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:28.796349    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ea4ab2c0-e647-46ac-a15f-4344863b82c8" containerName="manager"
Nov 02 22:07:28.796481 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:28.796463    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="ea4ab2c0-e647-46ac-a15f-4344863b82c8" containerName="manager"
Nov 02 22:07:28.799150 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:28.799124    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4ff58769-mqmxp"
Nov 02 22:07:28.806669 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:28.806642    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4ff58769-mqmxp"]
Nov 02 22:07:28.890041 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:28.890001    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/303c9147-16d9-4b22-abb7-903102e1eeb2-tls-cert\") pod \"authorino-6d4ff58769-mqmxp\" (UID: \"303c9147-16d9-4b22-abb7-903102e1eeb2\") " pod="kuadrant-system/authorino-6d4ff58769-mqmxp"
Nov 02 22:07:28.890207 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:28.890061    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-946t8\" (UniqueName: \"kubernetes.io/projected/303c9147-16d9-4b22-abb7-903102e1eeb2-kube-api-access-946t8\") pod \"authorino-6d4ff58769-mqmxp\" (UID: \"303c9147-16d9-4b22-abb7-903102e1eeb2\") " pod="kuadrant-system/authorino-6d4ff58769-mqmxp"
Nov 02 22:07:28.991445 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:28.991414    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/303c9147-16d9-4b22-abb7-903102e1eeb2-tls-cert\") pod \"authorino-6d4ff58769-mqmxp\" (UID: \"303c9147-16d9-4b22-abb7-903102e1eeb2\") " pod="kuadrant-system/authorino-6d4ff58769-mqmxp"
Nov 02 22:07:28.991608 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:28.991455    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-946t8\" (UniqueName: \"kubernetes.io/projected/303c9147-16d9-4b22-abb7-903102e1eeb2-kube-api-access-946t8\") pod \"authorino-6d4ff58769-mqmxp\" (UID: \"303c9147-16d9-4b22-abb7-903102e1eeb2\") " pod="kuadrant-system/authorino-6d4ff58769-mqmxp"
Nov 02 22:07:28.993867 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:28.993840    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/303c9147-16d9-4b22-abb7-903102e1eeb2-tls-cert\") pod \"authorino-6d4ff58769-mqmxp\" (UID: \"303c9147-16d9-4b22-abb7-903102e1eeb2\") " pod="kuadrant-system/authorino-6d4ff58769-mqmxp"
Nov 02 22:07:28.998949 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:28.998924    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-946t8\" (UniqueName: \"kubernetes.io/projected/303c9147-16d9-4b22-abb7-903102e1eeb2-kube-api-access-946t8\") pod \"authorino-6d4ff58769-mqmxp\" (UID: \"303c9147-16d9-4b22-abb7-903102e1eeb2\") " pod="kuadrant-system/authorino-6d4ff58769-mqmxp"
Nov 02 22:07:29.112043 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:29.112022    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4ff58769-mqmxp"
Nov 02 22:07:29.386103 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:29.386071    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4ff58769-mqmxp"]
Nov 02 22:07:29.387104 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:07:29.387078    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod303c9147_16d9_4b22_abb7_903102e1eeb2.slice/crio-72dfa32f95af3370762dbd3b7b36d8f1558ed0bf772e026ac18a2dea6907b0e4 WatchSource:0}: Error finding container 72dfa32f95af3370762dbd3b7b36d8f1558ed0bf772e026ac18a2dea6907b0e4: Status 404 returned error can't find the container with id 72dfa32f95af3370762dbd3b7b36d8f1558ed0bf772e026ac18a2dea6907b0e4
Nov 02 22:07:29.891861 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:07:29.891822    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:07:29.988635 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:29.988594    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d4ff58769-mqmxp" event={"ID":"303c9147-16d9-4b22-abb7-903102e1eeb2","Type":"ContainerStarted","Data":"72dfa32f95af3370762dbd3b7b36d8f1558ed0bf772e026ac18a2dea6907b0e4"}
Nov 02 22:07:31.004181 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:31.004135    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d4ff58769-mqmxp" event={"ID":"303c9147-16d9-4b22-abb7-903102e1eeb2","Type":"ContainerStarted","Data":"f552a662fba61263a48ea05a4016d23044f27409670e989f89896694430e5a5a"}
Nov 02 22:07:31.023253 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:31.022271    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6d4ff58769-mqmxp" podStartSLOduration=1.883398636 podStartE2EDuration="3.022251878s" totalImagesPullingTime="1.138853242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:07:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:07:31.021632684 +0000 UTC m=+560.077967059" watchObservedRunningTime="2026-11-02 22:07:31.022251878 +0000 UTC m=+560.078586259"
Nov 02 22:07:31.075261 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:31.072744    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-757dcb578-crgcc"]
Nov 02 22:07:31.076483 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:31.076453    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-757dcb578-crgcc" podUID="9e2715f3-9c15-41d9-a1ef-7f4152655cb1" containerName="authorino" containerID="cri-o://ea67fbfc66ef51d9cd3c691dcaf3ea0cfba345e288c7aca0b5ec0b38973a7043" gracePeriod=30
Nov 02 22:07:31.380881 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:31.380853    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-757dcb578-crgcc"
Nov 02 22:07:31.521928 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:31.521825    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e2715f3-9c15-41d9-a1ef-7f4152655cb1-tls-cert\" (UniqueName: \"kubernetes.io/secret/9e2715f3-9c15-41d9-a1ef-7f4152655cb1-tls-cert\") pod \"9e2715f3-9c15-41d9-a1ef-7f4152655cb1\" (UID: \"9e2715f3-9c15-41d9-a1ef-7f4152655cb1\") "
Nov 02 22:07:31.522097 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:31.521968    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e2715f3-9c15-41d9-a1ef-7f4152655cb1-kube-api-access-g9x7k\" (UniqueName: \"kubernetes.io/projected/9e2715f3-9c15-41d9-a1ef-7f4152655cb1-kube-api-access-g9x7k\") pod \"9e2715f3-9c15-41d9-a1ef-7f4152655cb1\" (UID: \"9e2715f3-9c15-41d9-a1ef-7f4152655cb1\") "
Nov 02 22:07:31.528765 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:31.528320    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e2715f3-9c15-41d9-a1ef-7f4152655cb1-kube-api-access-g9x7k" pod "9e2715f3-9c15-41d9-a1ef-7f4152655cb1" (UID: "9e2715f3-9c15-41d9-a1ef-7f4152655cb1"). InnerVolumeSpecName "kube-api-access-g9x7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:07:31.547376 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:31.547341    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e2715f3-9c15-41d9-a1ef-7f4152655cb1-tls-cert" pod "9e2715f3-9c15-41d9-a1ef-7f4152655cb1" (UID: "9e2715f3-9c15-41d9-a1ef-7f4152655cb1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:07:31.608276 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:31.608241    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:07:31.625648 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:31.623762    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9x7k\" (UniqueName: \"kubernetes.io/projected/9e2715f3-9c15-41d9-a1ef-7f4152655cb1-kube-api-access-g9x7k\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:07:31.625648 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:31.623796    5076 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9e2715f3-9c15-41d9-a1ef-7f4152655cb1-tls-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:07:31.698011 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:31.697975    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:07:32.015251 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:32.014751    5076 generic.go:356] "Generic (PLEG): container finished" podID="9e2715f3-9c15-41d9-a1ef-7f4152655cb1" containerID="ea67fbfc66ef51d9cd3c691dcaf3ea0cfba345e288c7aca0b5ec0b38973a7043" exitCode=0
Nov 02 22:07:32.015718 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:32.015541    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-757dcb578-crgcc"
Nov 02 22:07:32.027240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:32.023353    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-757dcb578-crgcc" event={"ID":"9e2715f3-9c15-41d9-a1ef-7f4152655cb1","Type":"ContainerDied","Data":"ea67fbfc66ef51d9cd3c691dcaf3ea0cfba345e288c7aca0b5ec0b38973a7043"}
Nov 02 22:07:32.027240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:32.023626    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-757dcb578-crgcc" event={"ID":"9e2715f3-9c15-41d9-a1ef-7f4152655cb1","Type":"ContainerDied","Data":"3a41a2eb5eea70a5807ac7a2d5e0acf74790bf45ba9325d8374f4aeb7da402e7"}
Nov 02 22:07:32.027240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:32.023653    5076 scope.go:122] "RemoveContainer" containerID="ea67fbfc66ef51d9cd3c691dcaf3ea0cfba345e288c7aca0b5ec0b38973a7043"
Nov 02 22:07:32.049732 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:32.049705    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-757dcb578-crgcc"]
Nov 02 22:07:32.052075 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:32.052046    5076 scope.go:122] "RemoveContainer" containerID="ea67fbfc66ef51d9cd3c691dcaf3ea0cfba345e288c7aca0b5ec0b38973a7043"
Nov 02 22:07:32.052464 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:07:32.052443    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea67fbfc66ef51d9cd3c691dcaf3ea0cfba345e288c7aca0b5ec0b38973a7043\": container with ID starting with ea67fbfc66ef51d9cd3c691dcaf3ea0cfba345e288c7aca0b5ec0b38973a7043 not found: ID does not exist" containerID="ea67fbfc66ef51d9cd3c691dcaf3ea0cfba345e288c7aca0b5ec0b38973a7043"
Nov 02 22:07:32.052559 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:32.052476    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea67fbfc66ef51d9cd3c691dcaf3ea0cfba345e288c7aca0b5ec0b38973a7043"} err="failed to get container status \"ea67fbfc66ef51d9cd3c691dcaf3ea0cfba345e288c7aca0b5ec0b38973a7043\": rpc error: code = NotFound desc = could not find container \"ea67fbfc66ef51d9cd3c691dcaf3ea0cfba345e288c7aca0b5ec0b38973a7043\": container with ID starting with ea67fbfc66ef51d9cd3c691dcaf3ea0cfba345e288c7aca0b5ec0b38973a7043 not found: ID does not exist"
Nov 02 22:07:32.053064 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:32.053046    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-757dcb578-crgcc"]
Nov 02 22:07:33.052798 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:33.052761    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e2715f3-9c15-41d9-a1ef-7f4152655cb1" path="/var/lib/kubelet/pods/9e2715f3-9c15-41d9-a1ef-7f4152655cb1/volumes"
Nov 02 22:07:33.361382 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:33.361344    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:07:34.159706 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.159673    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"]
Nov 02 22:07:34.160260 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.160239    5076 cpu_manager.go:414] "containerMap: removing container" podUID="9e2715f3-9c15-41d9-a1ef-7f4152655cb1" containerName="authorino"
Nov 02 22:07:34.160334 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.160263    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e2715f3-9c15-41d9-a1ef-7f4152655cb1" containerName="authorino"
Nov 02 22:07:34.160556 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.160537    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e2715f3-9c15-41d9-a1ef-7f4152655cb1" containerName="authorino"
Nov 02 22:07:34.164977 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.164953    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.176538 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.176510    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"]
Nov 02 22:07:34.258400 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.258369    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d92ea2e2-e37c-4eff-a390-4af247ab43ef-istio-token\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.258584 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.258406    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d92ea2e2-e37c-4eff-a390-4af247ab43ef-istio-data\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.258584 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.258437    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d92ea2e2-e37c-4eff-a390-4af247ab43ef-workload-certs\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.258584 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.258524    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d92ea2e2-e37c-4eff-a390-4af247ab43ef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.258729 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.258613    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d92ea2e2-e37c-4eff-a390-4af247ab43ef-credential-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.258729 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.258711    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d92ea2e2-e37c-4eff-a390-4af247ab43ef-workload-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.258832 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.258758    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d92ea2e2-e37c-4eff-a390-4af247ab43ef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.258832 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.258797    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9l5c\" (UniqueName: \"kubernetes.io/projected/d92ea2e2-e37c-4eff-a390-4af247ab43ef-kube-api-access-s9l5c\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.258832 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.258825    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d92ea2e2-e37c-4eff-a390-4af247ab43ef-istio-envoy\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.359440 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.359402    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d92ea2e2-e37c-4eff-a390-4af247ab43ef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.359637 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.359455    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9l5c\" (UniqueName: \"kubernetes.io/projected/d92ea2e2-e37c-4eff-a390-4af247ab43ef-kube-api-access-s9l5c\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.359637 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.359486    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d92ea2e2-e37c-4eff-a390-4af247ab43ef-istio-envoy\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.359637 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.359541    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d92ea2e2-e37c-4eff-a390-4af247ab43ef-istio-token\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.359637 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.359574    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d92ea2e2-e37c-4eff-a390-4af247ab43ef-istio-data\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.359637 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.359614    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d92ea2e2-e37c-4eff-a390-4af247ab43ef-workload-certs\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.359637 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.359637    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d92ea2e2-e37c-4eff-a390-4af247ab43ef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.359971 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.359673    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d92ea2e2-e37c-4eff-a390-4af247ab43ef-credential-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.359971 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.359717    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d92ea2e2-e37c-4eff-a390-4af247ab43ef-workload-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.360089 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.360064    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d92ea2e2-e37c-4eff-a390-4af247ab43ef-istio-data\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.360232 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.360081    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d92ea2e2-e37c-4eff-a390-4af247ab43ef-workload-certs\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.360313 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.360242    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d92ea2e2-e37c-4eff-a390-4af247ab43ef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.360313 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.360291    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d92ea2e2-e37c-4eff-a390-4af247ab43ef-workload-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.360432 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.360334    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d92ea2e2-e37c-4eff-a390-4af247ab43ef-credential-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.361962 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.361939    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d92ea2e2-e37c-4eff-a390-4af247ab43ef-istio-envoy\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.362370 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.362346    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d92ea2e2-e37c-4eff-a390-4af247ab43ef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.367400 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.367371    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9l5c\" (UniqueName: \"kubernetes.io/projected/d92ea2e2-e37c-4eff-a390-4af247ab43ef-kube-api-access-s9l5c\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.367791 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.367773    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d92ea2e2-e37c-4eff-a390-4af247ab43ef-istio-token\") pod \"maas-default-gateway-openshift-default-696f47c6c-mfp5r\" (UID: \"d92ea2e2-e37c-4eff-a390-4af247ab43ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.483032 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.482938    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:34.761761 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.761734    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"]
Nov 02 22:07:34.763755 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:07:34.763719    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd92ea2e2_e37c_4eff_a390_4af247ab43ef.slice/crio-e03eba42cad9b7a60202ec62b11caeb497243d4f92f42fd626531672340d35f6 WatchSource:0}: Error finding container e03eba42cad9b7a60202ec62b11caeb497243d4f92f42fd626531672340d35f6: Status 404 returned error can't find the container with id e03eba42cad9b7a60202ec62b11caeb497243d4f92f42fd626531672340d35f6
Nov 02 22:07:34.766909 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.766869    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:07:34.767033 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.766955    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:07:34.767033 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:34.767024    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:07:35.035343 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:35.035257    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r" event={"ID":"d92ea2e2-e37c-4eff-a390-4af247ab43ef","Type":"ContainerStarted","Data":"1ea10caa6af2192b8ac656ced6013b680ce86897ce06fdee4393fe37f6bd83c0"}
Nov 02 22:07:35.035343 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:35.035319    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r" event={"ID":"d92ea2e2-e37c-4eff-a390-4af247ab43ef","Type":"ContainerStarted","Data":"e03eba42cad9b7a60202ec62b11caeb497243d4f92f42fd626531672340d35f6"}
Nov 02 22:07:35.059549 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:35.059502    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r" podStartSLOduration=1.059487629 podStartE2EDuration="1.059487629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:07:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:07:35.056264019 +0000 UTC m=+564.112598400" watchObservedRunningTime="2026-11-02 22:07:35.059487629 +0000 UTC m=+564.115822008"
Nov 02 22:07:35.490241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:35.488172    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:35.494252 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:35.492407    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-mfp5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Nov 02 22:07:35.494252 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:35.492506    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r" podUID="d92ea2e2-e37c-4eff-a390-4af247ab43ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Nov 02 22:07:36.212019 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:36.211977    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:07:36.301354 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:36.301316    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:07:36.484661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:36.484574    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-mfp5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Nov 02 22:07:36.484922 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:36.484890    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r" podUID="d92ea2e2-e37c-4eff-a390-4af247ab43ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Nov 02 22:07:37.490241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:37.489615    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-mfp5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Nov 02 22:07:37.490241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:37.489700    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r" podUID="d92ea2e2-e37c-4eff-a390-4af247ab43ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Nov 02 22:07:38.486642 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:38.486605    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-mfp5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Nov 02 22:07:38.486951 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:38.486917    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r" podUID="d92ea2e2-e37c-4eff-a390-4af247ab43ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Nov 02 22:07:39.489243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:39.488615    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-mfp5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Nov 02 22:07:39.489243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:39.488679    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r" podUID="d92ea2e2-e37c-4eff-a390-4af247ab43ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Nov 02 22:07:40.483694 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:40.483654    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-mfp5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Nov 02 22:07:40.483985 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:40.483953    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r" podUID="d92ea2e2-e37c-4eff-a390-4af247ab43ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Nov 02 22:07:41.483566 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:41.483530    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-mfp5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Nov 02 22:07:41.484062 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:41.483595    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r" podUID="d92ea2e2-e37c-4eff-a390-4af247ab43ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Nov 02 22:07:43.484145 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:43.484100    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-mfp5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:07:43.484597 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:43.484182    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r" podUID="d92ea2e2-e37c-4eff-a390-4af247ab43ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:07:44.525404 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:44.525364    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-mfp5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:07:44.525911 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:44.525448    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r" podUID="d92ea2e2-e37c-4eff-a390-4af247ab43ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:07:45.024707 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:45.024675    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:45.025278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:45.025257    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:45.026063 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:07:45.026044    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-mfp5r"
Nov 02 22:07:59.887750 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:07:59.887713    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:08:01.575261 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:01.575211    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:02.067992 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:02.067957    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:03.698407 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:03.698373    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:03.799177 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:03.799143    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:05.260339 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:05.260290    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:05.359342 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:05.359309    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:09.493343 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:09.493303    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:28.522114 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:28.522067    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:28.619258 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:28.619211    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:29.000881 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:29.000845    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:29.100855 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:29.100818    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:29.211739 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:29.211702    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:29.315560 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:29.315471    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:29.426289 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:29.426255    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:29.522032 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:29.521997    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:29.622324 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:29.622287    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:29.837209 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:29.837170    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:29.889313 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:08:29.889235    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:08:32.445040 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:32.445005    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:32.550880 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:32.550848    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:32.657849 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:32.657814    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:32.760324 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:32.759658    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:32.870084 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:32.870041    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:32.977643 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:32.977590    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:33.084085 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:33.083998    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:33.351123 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:33.351051    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:33.455341 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:33.455304    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:33.697657 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:33.697619    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:33.820332 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:33.820299    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:34.412591 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:34.412558    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:34.515684 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:34.515649    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:34.952987 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:34.952952    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:35.047342 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.047309    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:35.068000 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.067944    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"]
Nov 02 22:08:35.072364 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.072340    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"
Nov 02 22:08:35.082778 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.082749    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"]
Nov 02 22:08:35.128009 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.127976    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lt6n\" (UniqueName: \"kubernetes.io/projected/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-kube-api-access-7lt6n\") pod \"maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47\" (UID: \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"
Nov 02 22:08:35.128188 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.128128    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47\" (UID: \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"
Nov 02 22:08:35.128350 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.128320    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-metrics-certs\") pod \"maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47\" (UID: \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"
Nov 02 22:08:35.128468 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.128399    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-maas-api-tls\") pod \"maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47\" (UID: \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"
Nov 02 22:08:35.142184 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.142162    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w6-a1d78c-serving-cert\""
Nov 02 22:08:35.142184 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.142181    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tcmbk\""
Nov 02 22:08:35.142340 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.142243    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 02 22:08:35.146725 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.146698    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:35.229755 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.229657    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lt6n\" (UniqueName: \"kubernetes.io/projected/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-kube-api-access-7lt6n\") pod \"maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47\" (UID: \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"
Nov 02 22:08:35.229755 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.229728    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47\" (UID: \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"
Nov 02 22:08:35.229755 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.229753    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-metrics-certs\") pod \"maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47\" (UID: \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"
Nov 02 22:08:35.230024 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.229800    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-maas-api-tls\") pod \"maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47\" (UID: \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"
Nov 02 22:08:35.230024 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:08:35.229996    5076 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-serving-cert: secret "maas-api-e2e-worker-w6-a1d78c-serving-cert" not found
Nov 02 22:08:35.230108 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:08:35.230072    5076 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-maas-api-tls podName:3529fe1f-6b60-4755-8dcd-eb2349e8f1d3 nodeName:}" failed. No retries permitted until 2026-11-02 22:08:35.730050119 +0000 UTC m=+624.786384500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-maas-api-tls") pod "maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47" (UID: "3529fe1f-6b60-4755-8dcd-eb2349e8f1d3") : secret "maas-api-e2e-worker-w6-a1d78c-serving-cert" not found
Nov 02 22:08:35.230927 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.230897    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47\" (UID: \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"
Nov 02 22:08:35.232888 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.232862    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-metrics-certs\") pod \"maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47\" (UID: \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"
Nov 02 22:08:35.243022 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.242994    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:35.253135 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.253114    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lt6n\" (UniqueName: \"kubernetes.io/projected/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-kube-api-access-7lt6n\") pod \"maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47\" (UID: \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"
Nov 02 22:08:35.342361 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.342329    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:35.538601 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.538510    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:35.631959 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.631927    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:35.734952 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.734909    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-maas-api-tls\") pod \"maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47\" (UID: \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"
Nov 02 22:08:35.737459 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.737432    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-maas-api-tls\") pod \"maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47\" (UID: \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"
Nov 02 22:08:35.995936 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:35.995900    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"
Nov 02 22:08:36.099250 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:36.098908    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:36.198188 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:36.198156    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:36.271207 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:36.271181    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"]
Nov 02 22:08:36.272598 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:08:36.272574    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-89387c260b769c8f659eb432a65becdef698f4f2b3e26ae7633f7411c793817c WatchSource:0}: Error finding container 89387c260b769c8f659eb432a65becdef698f4f2b3e26ae7633f7411c793817c: Status 404 returned error can't find the container with id 89387c260b769c8f659eb432a65becdef698f4f2b3e26ae7633f7411c793817c
Nov 02 22:08:36.273923 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:36.273903    5076 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 22:08:36.301942 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:36.301912    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:36.365340 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:36.365306    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47" event={"ID":"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3","Type":"ContainerStarted","Data":"89387c260b769c8f659eb432a65becdef698f4f2b3e26ae7633f7411c793817c"}
Nov 02 22:08:36.411717 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:36.411684    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:36.699861 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:36.699820    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:36.800725 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:36.800682    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:37.071874 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:37.071795    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:37.457995 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:37.457959    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:37.547526 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:37.547477    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:37.851305 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:37.851211    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"]
Nov 02 22:08:37.870864 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:37.870827    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"]
Nov 02 22:08:37.871031 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:37.870990    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"
Nov 02 22:08:37.879536 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:37.879506    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-5f4a2f-serving-cert\""
Nov 02 22:08:37.896437 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:37.896397    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:37.959718 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:37.959670    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/101ad2fe-5a3f-4798-b598-e23e65e651f3-metrics-certs\") pod \"maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc\" (UID: \"101ad2fe-5a3f-4798-b598-e23e65e651f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"
Nov 02 22:08:37.959895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:37.959759    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcpwm\" (UniqueName: \"kubernetes.io/projected/101ad2fe-5a3f-4798-b598-e23e65e651f3-kube-api-access-dcpwm\") pod \"maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc\" (UID: \"101ad2fe-5a3f-4798-b598-e23e65e651f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"
Nov 02 22:08:37.959953 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:37.959931    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/101ad2fe-5a3f-4798-b598-e23e65e651f3-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc\" (UID: \"101ad2fe-5a3f-4798-b598-e23e65e651f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"
Nov 02 22:08:37.960029 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:37.960005    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/101ad2fe-5a3f-4798-b598-e23e65e651f3-maas-api-tls\") pod \"maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc\" (UID: \"101ad2fe-5a3f-4798-b598-e23e65e651f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"
Nov 02 22:08:38.002618 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.002571    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:38.060763 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.060719    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/101ad2fe-5a3f-4798-b598-e23e65e651f3-maas-api-tls\") pod \"maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc\" (UID: \"101ad2fe-5a3f-4798-b598-e23e65e651f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"
Nov 02 22:08:38.060950 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.060791    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/101ad2fe-5a3f-4798-b598-e23e65e651f3-metrics-certs\") pod \"maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc\" (UID: \"101ad2fe-5a3f-4798-b598-e23e65e651f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"
Nov 02 22:08:38.060950 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.060860    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcpwm\" (UniqueName: \"kubernetes.io/projected/101ad2fe-5a3f-4798-b598-e23e65e651f3-kube-api-access-dcpwm\") pod \"maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc\" (UID: \"101ad2fe-5a3f-4798-b598-e23e65e651f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"
Nov 02 22:08:38.060950 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.060905    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/101ad2fe-5a3f-4798-b598-e23e65e651f3-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc\" (UID: \"101ad2fe-5a3f-4798-b598-e23e65e651f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"
Nov 02 22:08:38.062002 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.061973    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/101ad2fe-5a3f-4798-b598-e23e65e651f3-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc\" (UID: \"101ad2fe-5a3f-4798-b598-e23e65e651f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"
Nov 02 22:08:38.063882 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.063858    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/101ad2fe-5a3f-4798-b598-e23e65e651f3-maas-api-tls\") pod \"maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc\" (UID: \"101ad2fe-5a3f-4798-b598-e23e65e651f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"
Nov 02 22:08:38.063989 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.063958    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/101ad2fe-5a3f-4798-b598-e23e65e651f3-metrics-certs\") pod \"maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc\" (UID: \"101ad2fe-5a3f-4798-b598-e23e65e651f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"
Nov 02 22:08:38.071517 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.071493    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcpwm\" (UniqueName: \"kubernetes.io/projected/101ad2fe-5a3f-4798-b598-e23e65e651f3-kube-api-access-dcpwm\") pod \"maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc\" (UID: \"101ad2fe-5a3f-4798-b598-e23e65e651f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"
Nov 02 22:08:38.095536 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.095503    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:38.195303 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.195276    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"
Nov 02 22:08:38.382667 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.382635    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47" event={"ID":"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3","Type":"ContainerStarted","Data":"237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf"}
Nov 02 22:08:38.382859 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.382841    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"
Nov 02 22:08:38.411484 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.411366    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47" podStartSLOduration=1.529296105 podStartE2EDuration="3.411345734s" totalImagesPullingTime="1.882049629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:08:38.407364253 +0000 UTC m=+627.463698635" watchObservedRunningTime="2026-11-02 22:08:38.411345734 +0000 UTC m=+627.467680116"
Nov 02 22:08:38.488185 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.488143    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"]
Nov 02 22:08:38.492301 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:08:38.492263    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod101ad2fe_5a3f_4798_b598_e23e65e651f3.slice/crio-4d5dec0e073b4a7a3e3f59b9e6b0b31496b0abb8858fe9eedf6d903106149c3d WatchSource:0}: Error finding container 4d5dec0e073b4a7a3e3f59b9e6b0b31496b0abb8858fe9eedf6d903106149c3d: Status 404 returned error can't find the container with id 4d5dec0e073b4a7a3e3f59b9e6b0b31496b0abb8858fe9eedf6d903106149c3d
Nov 02 22:08:38.834900 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.834822    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"]
Nov 02 22:08:38.839647 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.839616    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"
Nov 02 22:08:38.849961 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.847963    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-2532af-serving-cert\""
Nov 02 22:08:38.849961 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.847976    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"]
Nov 02 22:08:38.876333 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.876302    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c057d328-8578-49a1-bf23-07616e8ed3ff-metrics-certs\") pod \"maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5\" (UID: \"c057d328-8578-49a1-bf23-07616e8ed3ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"
Nov 02 22:08:38.876712 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.876344    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c057d328-8578-49a1-bf23-07616e8ed3ff-maas-api-tls\") pod \"maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5\" (UID: \"c057d328-8578-49a1-bf23-07616e8ed3ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"
Nov 02 22:08:38.876712 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.876486    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twvzm\" (UniqueName: \"kubernetes.io/projected/c057d328-8578-49a1-bf23-07616e8ed3ff-kube-api-access-twvzm\") pod \"maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5\" (UID: \"c057d328-8578-49a1-bf23-07616e8ed3ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"
Nov 02 22:08:38.876712 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.876576    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c057d328-8578-49a1-bf23-07616e8ed3ff-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5\" (UID: \"c057d328-8578-49a1-bf23-07616e8ed3ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"
Nov 02 22:08:38.879188 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.879162    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:38.978041 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.978003    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c057d328-8578-49a1-bf23-07616e8ed3ff-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5\" (UID: \"c057d328-8578-49a1-bf23-07616e8ed3ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"
Nov 02 22:08:38.978211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.978058    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c057d328-8578-49a1-bf23-07616e8ed3ff-metrics-certs\") pod \"maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5\" (UID: \"c057d328-8578-49a1-bf23-07616e8ed3ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"
Nov 02 22:08:38.978211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.978105    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c057d328-8578-49a1-bf23-07616e8ed3ff-maas-api-tls\") pod \"maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5\" (UID: \"c057d328-8578-49a1-bf23-07616e8ed3ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"
Nov 02 22:08:38.978211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.978171    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twvzm\" (UniqueName: \"kubernetes.io/projected/c057d328-8578-49a1-bf23-07616e8ed3ff-kube-api-access-twvzm\") pod \"maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5\" (UID: \"c057d328-8578-49a1-bf23-07616e8ed3ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"
Nov 02 22:08:38.978859 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.978830    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c057d328-8578-49a1-bf23-07616e8ed3ff-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5\" (UID: \"c057d328-8578-49a1-bf23-07616e8ed3ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"
Nov 02 22:08:38.979069 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.979041    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:38.980823 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.980804    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c057d328-8578-49a1-bf23-07616e8ed3ff-metrics-certs\") pod \"maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5\" (UID: \"c057d328-8578-49a1-bf23-07616e8ed3ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"
Nov 02 22:08:38.981130 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.981112    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c057d328-8578-49a1-bf23-07616e8ed3ff-maas-api-tls\") pod \"maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5\" (UID: \"c057d328-8578-49a1-bf23-07616e8ed3ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"
Nov 02 22:08:38.985601 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:38.985581    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twvzm\" (UniqueName: \"kubernetes.io/projected/c057d328-8578-49a1-bf23-07616e8ed3ff-kube-api-access-twvzm\") pod \"maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5\" (UID: \"c057d328-8578-49a1-bf23-07616e8ed3ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"
Nov 02 22:08:39.160420 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:39.160390    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"
Nov 02 22:08:39.390104 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:39.390069    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc" event={"ID":"101ad2fe-5a3f-4798-b598-e23e65e651f3","Type":"ContainerStarted","Data":"6f3b8f06314100b5025818a6e77c4b90a5cfb24094cc42a85054800a6d8abd12"}
Nov 02 22:08:39.390306 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:39.390278    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"
Nov 02 22:08:39.390412 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:39.390326    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc" event={"ID":"101ad2fe-5a3f-4798-b598-e23e65e651f3","Type":"ContainerStarted","Data":"4d5dec0e073b4a7a3e3f59b9e6b0b31496b0abb8858fe9eedf6d903106149c3d"}
Nov 02 22:08:39.408238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:39.408175    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc" podStartSLOduration=1.890263789 podStartE2EDuration="2.408163251s" totalImagesPullingTime="517.899462ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:08:39.406540659 +0000 UTC m=+628.462875040" watchObservedRunningTime="2026-11-02 22:08:39.408163251 +0000 UTC m=+628.464497675"
Nov 02 22:08:39.436955 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:39.436930    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"]
Nov 02 22:08:39.438691 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:08:39.438659    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc057d328_8578_49a1_bf23_07616e8ed3ff.slice/crio-5d94e36ec187ca3de2f99368866ca2355f2a56df6e94abe70db4b910be689bc6 WatchSource:0}: Error finding container 5d94e36ec187ca3de2f99368866ca2355f2a56df6e94abe70db4b910be689bc6: Status 404 returned error can't find the container with id 5d94e36ec187ca3de2f99368866ca2355f2a56df6e94abe70db4b910be689bc6
Nov 02 22:08:39.700369 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:39.700280    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:39.802145 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:39.802109    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:39.947183 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:39.947146    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:40.398024 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:40.397990    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5" event={"ID":"c057d328-8578-49a1-bf23-07616e8ed3ff","Type":"ContainerStarted","Data":"24240caafc958c9d3ce59979825c031d39961b78fcccb82c093a63abbc3c5290"}
Nov 02 22:08:40.398359 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:40.398046    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5" event={"ID":"c057d328-8578-49a1-bf23-07616e8ed3ff","Type":"ContainerStarted","Data":"5d94e36ec187ca3de2f99368866ca2355f2a56df6e94abe70db4b910be689bc6"}
Nov 02 22:08:40.398359 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:40.398080    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"
Nov 02 22:08:40.416429 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:40.416384    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5" podStartSLOduration=2.004059979 podStartE2EDuration="2.416371517s" totalImagesPullingTime="412.311538ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:08:40.413275494 +0000 UTC m=+629.469609873" watchObservedRunningTime="2026-11-02 22:08:40.416371517 +0000 UTC m=+629.472705891"
Nov 02 22:08:40.487864 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:40.487831    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:41.283231 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:41.283181    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:41.382832 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:41.382796    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:42.022606 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.022575    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"]
Nov 02 22:08:42.032510 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.031684    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"
Nov 02 22:08:42.038561 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.038535    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"]
Nov 02 22:08:42.041636 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.041616    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-c302b6-serving-cert\""
Nov 02 22:08:42.071066 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.071032    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:42.108437 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.108413    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec87244f-5ca4-4986-b922-a02136cb4164-metrics-certs\") pod \"maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn\" (UID: \"ec87244f-5ca4-4986-b922-a02136cb4164\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"
Nov 02 22:08:42.108568 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.108442    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6mgr\" (UniqueName: \"kubernetes.io/projected/ec87244f-5ca4-4986-b922-a02136cb4164-kube-api-access-w6mgr\") pod \"maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn\" (UID: \"ec87244f-5ca4-4986-b922-a02136cb4164\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"
Nov 02 22:08:42.108568 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.108468    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec87244f-5ca4-4986-b922-a02136cb4164-maas-api-tls\") pod \"maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn\" (UID: \"ec87244f-5ca4-4986-b922-a02136cb4164\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"
Nov 02 22:08:42.108698 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.108672    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec87244f-5ca4-4986-b922-a02136cb4164-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn\" (UID: \"ec87244f-5ca4-4986-b922-a02136cb4164\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"
Nov 02 22:08:42.171689 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.171652    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:42.209895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.209865    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec87244f-5ca4-4986-b922-a02136cb4164-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn\" (UID: \"ec87244f-5ca4-4986-b922-a02136cb4164\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"
Nov 02 22:08:42.210048 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.209932    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec87244f-5ca4-4986-b922-a02136cb4164-metrics-certs\") pod \"maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn\" (UID: \"ec87244f-5ca4-4986-b922-a02136cb4164\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"
Nov 02 22:08:42.210048 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.209956    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6mgr\" (UniqueName: \"kubernetes.io/projected/ec87244f-5ca4-4986-b922-a02136cb4164-kube-api-access-w6mgr\") pod \"maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn\" (UID: \"ec87244f-5ca4-4986-b922-a02136cb4164\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"
Nov 02 22:08:42.210048 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.209985    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec87244f-5ca4-4986-b922-a02136cb4164-maas-api-tls\") pod \"maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn\" (UID: \"ec87244f-5ca4-4986-b922-a02136cb4164\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"
Nov 02 22:08:42.210633 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.210613    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec87244f-5ca4-4986-b922-a02136cb4164-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn\" (UID: \"ec87244f-5ca4-4986-b922-a02136cb4164\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"
Nov 02 22:08:42.212535 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.212506    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec87244f-5ca4-4986-b922-a02136cb4164-metrics-certs\") pod \"maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn\" (UID: \"ec87244f-5ca4-4986-b922-a02136cb4164\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"
Nov 02 22:08:42.212628 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.212516    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec87244f-5ca4-4986-b922-a02136cb4164-maas-api-tls\") pod \"maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn\" (UID: \"ec87244f-5ca4-4986-b922-a02136cb4164\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"
Nov 02 22:08:42.217347 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.217324    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6mgr\" (UniqueName: \"kubernetes.io/projected/ec87244f-5ca4-4986-b922-a02136cb4164-kube-api-access-w6mgr\") pod \"maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn\" (UID: \"ec87244f-5ca4-4986-b922-a02136cb4164\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"
Nov 02 22:08:42.270947 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.270920    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:42.353611 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.353576    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"
Nov 02 22:08:42.638895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.638872    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"]
Nov 02 22:08:42.640418 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:08:42.640384    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec87244f_5ca4_4986_b922_a02136cb4164.slice/crio-d5c57e631d23dc8e2a8cc8c86d7631325ffaa72b4250191026761b0e75d7d422 WatchSource:0}: Error finding container d5c57e631d23dc8e2a8cc8c86d7631325ffaa72b4250191026761b0e75d7d422: Status 404 returned error can't find the container with id d5c57e631d23dc8e2a8cc8c86d7631325ffaa72b4250191026761b0e75d7d422
Nov 02 22:08:42.785007 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:42.784971    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:43.428666 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:43.428621    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn" event={"ID":"ec87244f-5ca4-4986-b922-a02136cb4164","Type":"ContainerStarted","Data":"e2825babe41f8ae3eb0cfd17fd73fa89e1a42b0d92e05ebc37e6879f7cb7d325"}
Nov 02 22:08:43.429108 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:43.428700    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn" event={"ID":"ec87244f-5ca4-4986-b922-a02136cb4164","Type":"ContainerStarted","Data":"d5c57e631d23dc8e2a8cc8c86d7631325ffaa72b4250191026761b0e75d7d422"}
Nov 02 22:08:43.429108 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:43.428732    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"
Nov 02 22:08:43.447285 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:43.447207    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn" podStartSLOduration=1.051250982 podStartE2EDuration="1.447190648s" totalImagesPullingTime="395.939666ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:08:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:08:43.445882453 +0000 UTC m=+632.502216844" watchObservedRunningTime="2026-11-02 22:08:43.447190648 +0000 UTC m=+632.503525032"
Nov 02 22:08:43.596444 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:43.596407    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:44.284281 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:44.284246    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:44.395887 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:44.395859    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"
Nov 02 22:08:44.899607 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:44.899574    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:45.403606 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:45.403575    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"
Nov 02 22:08:45.576966 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:45.576933    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:46.193996 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:46.193966    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:46.412537 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:46.412514    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"
Nov 02 22:08:46.932345 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:46.932310    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:47.243512 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:47.243409    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:47.730337 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:47.730296    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:47.847554 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:47.847521    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:47.948319 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:47.948284    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:48.048967 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:48.048871    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:48.883325 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:48.883275    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:48.987969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:48.987915    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:49.442488 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:49.442461    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"
Nov 02 22:08:49.925021 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:49.924984    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:50.502341 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:50.502299    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:51.540764 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:51.540736    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:52.369367 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:52.369328    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:52.465170 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:52.465136    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:52.567596 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:52.567551    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:52.848442 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:52.848343    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:53.129274 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:53.128646    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:53.228262 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:53.228212    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:53.329362 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:53.329329    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:53.477825 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:53.477696    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:53.588846 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:53.588811    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:53.692207 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:53.692167    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:54.170176 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.170127    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:54.629827 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.629799    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"]
Nov 02 22:08:54.634351 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.634325    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:54.643817 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.643786    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"]
Nov 02 22:08:54.643968 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.643912    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-719012\"/\"kube-root-ca.crt\""
Nov 02 22:08:54.645254 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.645228    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-719012\"/\"openshift-service-ca.crt\""
Nov 02 22:08:54.657192 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.652336    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-719012\"/\"simulator-w3-719012-kserve-self-signed-certs\""
Nov 02 22:08:54.657192 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.652837    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-719012\"/\"default-dockercfg-q9cxc\""
Nov 02 22:08:54.682810 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.682775    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:54.750705 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.750670    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-home\") pod \"simulator-w3-719012-kserve-f4cbcd86d-rxt7d\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") " pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:54.750888 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.750722    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-model-cache\") pod \"simulator-w3-719012-kserve-f4cbcd86d-rxt7d\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") " pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:54.750944 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.750903    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/820969fa-17ed-4e6c-8628-05def8372fdc-tls-certs\") pod \"simulator-w3-719012-kserve-f4cbcd86d-rxt7d\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") " pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:54.751088 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.751060    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-tmp-dir\") pod \"simulator-w3-719012-kserve-f4cbcd86d-rxt7d\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") " pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:54.751174 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.751108    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvhxg\" (UniqueName: \"kubernetes.io/projected/820969fa-17ed-4e6c-8628-05def8372fdc-kube-api-access-tvhxg\") pod \"simulator-w3-719012-kserve-f4cbcd86d-rxt7d\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") " pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:54.751174 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.751136    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-dshm\") pod \"simulator-w3-719012-kserve-f4cbcd86d-rxt7d\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") " pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:54.852182 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.852138    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-dshm\") pod \"simulator-w3-719012-kserve-f4cbcd86d-rxt7d\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") " pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:54.852424 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.852235    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-home\") pod \"simulator-w3-719012-kserve-f4cbcd86d-rxt7d\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") " pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:54.852424 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.852282    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-model-cache\") pod \"simulator-w3-719012-kserve-f4cbcd86d-rxt7d\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") " pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:54.852424 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.852321    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/820969fa-17ed-4e6c-8628-05def8372fdc-tls-certs\") pod \"simulator-w3-719012-kserve-f4cbcd86d-rxt7d\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") " pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:54.852586 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.852446    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-tmp-dir\") pod \"simulator-w3-719012-kserve-f4cbcd86d-rxt7d\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") " pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:54.852586 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.852490    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvhxg\" (UniqueName: \"kubernetes.io/projected/820969fa-17ed-4e6c-8628-05def8372fdc-kube-api-access-tvhxg\") pod \"simulator-w3-719012-kserve-f4cbcd86d-rxt7d\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") " pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:54.852829 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.852779    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-home\") pod \"simulator-w3-719012-kserve-f4cbcd86d-rxt7d\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") " pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:54.853122 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.853096    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-tmp-dir\") pod \"simulator-w3-719012-kserve-f4cbcd86d-rxt7d\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") " pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:54.853398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.853366    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-model-cache\") pod \"simulator-w3-719012-kserve-f4cbcd86d-rxt7d\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") " pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:54.855780 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.855745    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-dshm\") pod \"simulator-w3-719012-kserve-f4cbcd86d-rxt7d\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") " pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:54.857750 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.857725    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/820969fa-17ed-4e6c-8628-05def8372fdc-tls-certs\") pod \"simulator-w3-719012-kserve-f4cbcd86d-rxt7d\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") " pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:54.866495 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.866468    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvhxg\" (UniqueName: \"kubernetes.io/projected/820969fa-17ed-4e6c-8628-05def8372fdc-kube-api-access-tvhxg\") pod \"simulator-w3-719012-kserve-f4cbcd86d-rxt7d\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") " pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:54.954150 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.954073    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:54.977667 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:54.977630    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:55.240158 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:55.240133    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"]
Nov 02 22:08:55.241509 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:08:55.241485    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod820969fa_17ed_4e6c_8628_05def8372fdc.slice/crio-622ac4631eb8f47d494634e52b9cf9126ff1cf148bfe98f9e00b5fff538433f4 WatchSource:0}: Error finding container 622ac4631eb8f47d494634e52b9cf9126ff1cf148bfe98f9e00b5fff538433f4: Status 404 returned error can't find the container with id 622ac4631eb8f47d494634e52b9cf9126ff1cf148bfe98f9e00b5fff538433f4
Nov 02 22:08:55.505161 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:55.505070    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" event={"ID":"820969fa-17ed-4e6c-8628-05def8372fdc","Type":"ContainerStarted","Data":"622ac4631eb8f47d494634e52b9cf9126ff1cf148bfe98f9e00b5fff538433f4"}
Nov 02 22:08:55.741884 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:55.741846    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:56.687780 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:56.687739    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:57.279808 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:57.279764    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:57.482998 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:57.482954    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:57.517878 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:57.517842    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" event={"ID":"820969fa-17ed-4e6c-8628-05def8372fdc","Type":"ContainerStarted","Data":"d0c5855e4b16a60e8a718447f1e447d6ad74ab4917ec568a639af56b505dbcad"}
Nov 02 22:08:57.536483 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:57.536386    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podStartSLOduration=2.257860173 podStartE2EDuration="3.536370216s" totalImagesPullingTime="1.278510043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:08:57.534182192 +0000 UTC m=+646.590516572" watchObservedRunningTime="2026-11-02 22:08:57.536370216 +0000 UTC m=+646.592704641"
Nov 02 22:08:57.954601 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:57.954570    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:08:58.080847 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:58.080811    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:58.181978 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:58.181944    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:58.342926 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:58.342835    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:58.583438 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:58.583399    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:58.686433 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:58.686399    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:58.795052 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:58.795016    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:58.886068 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:58.886010    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:59.335131 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:59.335094    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:59.528271 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:08:59.528197    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:08:59.888241 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:08:59.888192    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:09:00.091501 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:00.091470    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:00.773595 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:00.773554    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:01.140084 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:01.140040    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:01.638905 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:01.638874    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:02.271575 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:02.271542    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:02.991497 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:02.991464    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:03.641075 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:03.641043    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:04.270169 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:04.270132    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:04.882948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:04.882911    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:04.954726 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:04.954693    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:09:04.967678 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:04.967648    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:09:05.573103 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:05.573048    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:05.577916 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:05.577894    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:09:05.770028 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:05.769990    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"]
Nov 02 22:09:05.775409 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:05.775370    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:05.783124 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:05.783099    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"]
Nov 02 22:09:05.787581 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:05.787556    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-361a44\"/\"openshift-service-ca.crt\""
Nov 02 22:09:05.787841 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:05.787824    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-361a44\"/\"kube-root-ca.crt\""
Nov 02 22:09:05.787985 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:05.787963    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-361a44\"/\"default-dockercfg-hxfz5\""
Nov 02 22:09:05.788124 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:05.788107    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-361a44\"/\"simulator-w5-361a44-kserve-self-signed-certs\""
Nov 02 22:09:05.826478 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:05.826361    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:05.963849 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:05.963727    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-dshm\") pod \"simulator-w5-361a44-kserve-74c7bf5fb9-4dng5\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") " pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:05.964441 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:05.963877    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-home\") pod \"simulator-w5-361a44-kserve-74c7bf5fb9-4dng5\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") " pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:05.964441 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:05.963921    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxdpr\" (UniqueName: \"kubernetes.io/projected/92accb71-73cc-48ce-ae62-14aa8e1742a9-kube-api-access-vxdpr\") pod \"simulator-w5-361a44-kserve-74c7bf5fb9-4dng5\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") " pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:05.964441 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:05.963970    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-tmp-dir\") pod \"simulator-w5-361a44-kserve-74c7bf5fb9-4dng5\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") " pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:05.964441 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:05.964027    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-model-cache\") pod \"simulator-w5-361a44-kserve-74c7bf5fb9-4dng5\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") " pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:05.964441 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:05.964082    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92accb71-73cc-48ce-ae62-14aa8e1742a9-tls-certs\") pod \"simulator-w5-361a44-kserve-74c7bf5fb9-4dng5\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") " pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:06.065207 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:06.065170    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-tmp-dir\") pod \"simulator-w5-361a44-kserve-74c7bf5fb9-4dng5\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") " pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:06.065404 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:06.065239    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-model-cache\") pod \"simulator-w5-361a44-kserve-74c7bf5fb9-4dng5\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") " pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:06.065404 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:06.065275    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92accb71-73cc-48ce-ae62-14aa8e1742a9-tls-certs\") pod \"simulator-w5-361a44-kserve-74c7bf5fb9-4dng5\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") " pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:06.065404 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:06.065312    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-dshm\") pod \"simulator-w5-361a44-kserve-74c7bf5fb9-4dng5\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") " pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:06.065680 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:06.065652    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-tmp-dir\") pod \"simulator-w5-361a44-kserve-74c7bf5fb9-4dng5\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") " pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:06.065763 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:06.065704    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-model-cache\") pod \"simulator-w5-361a44-kserve-74c7bf5fb9-4dng5\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") " pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:06.065872 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:06.065838    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-home\") pod \"simulator-w5-361a44-kserve-74c7bf5fb9-4dng5\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") " pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:06.066003 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:06.065911    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxdpr\" (UniqueName: \"kubernetes.io/projected/92accb71-73cc-48ce-ae62-14aa8e1742a9-kube-api-access-vxdpr\") pod \"simulator-w5-361a44-kserve-74c7bf5fb9-4dng5\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") " pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:06.066003 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:06.065991    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-home\") pod \"simulator-w5-361a44-kserve-74c7bf5fb9-4dng5\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") " pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:06.067664 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:06.067632    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-dshm\") pod \"simulator-w5-361a44-kserve-74c7bf5fb9-4dng5\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") " pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:06.068492 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:06.068468    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92accb71-73cc-48ce-ae62-14aa8e1742a9-tls-certs\") pod \"simulator-w5-361a44-kserve-74c7bf5fb9-4dng5\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") " pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:06.074384 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:06.074364    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxdpr\" (UniqueName: \"kubernetes.io/projected/92accb71-73cc-48ce-ae62-14aa8e1742a9-kube-api-access-vxdpr\") pod \"simulator-w5-361a44-kserve-74c7bf5fb9-4dng5\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") " pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:06.116338 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:06.116300    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:06.423898 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:06.423871    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"]
Nov 02 22:09:06.426863 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:09:06.426815    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92accb71_73cc_48ce_ae62_14aa8e1742a9.slice/crio-9d601f2e4f4fc4f91f1efe1e35c23ad831d78f4384348c315c235ba4be4fd2db WatchSource:0}: Error finding container 9d601f2e4f4fc4f91f1efe1e35c23ad831d78f4384348c315c235ba4be4fd2db: Status 404 returned error can't find the container with id 9d601f2e4f4fc4f91f1efe1e35c23ad831d78f4384348c315c235ba4be4fd2db
Nov 02 22:09:06.473038 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:06.472970    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:06.572610 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:06.572571    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" event={"ID":"92accb71-73cc-48ce-ae62-14aa8e1742a9","Type":"ContainerStarted","Data":"28530220c11d71d979739e9563495db0bddb83faf6c58df75674018f792c8222"}
Nov 02 22:09:06.572610 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:06.572625    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" event={"ID":"92accb71-73cc-48ce-ae62-14aa8e1742a9","Type":"ContainerStarted","Data":"9d601f2e4f4fc4f91f1efe1e35c23ad831d78f4384348c315c235ba4be4fd2db"}
Nov 02 22:09:06.594242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:06.592320    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podStartSLOduration=1.5922994689999999 podStartE2EDuration="1.592299469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:09:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:09:06.58940648 +0000 UTC m=+655.645740864" watchObservedRunningTime="2026-11-02 22:09:06.592299469 +0000 UTC m=+655.648633848"
Nov 02 22:09:07.116702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:07.116663    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:07.279331 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:07.279212    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:07.671995 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:07.671957    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:08.079375 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:08.079288    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:08.779732 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:08.779686    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:09.586790 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:09.586758    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:09.967383 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:09.967346    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:10.382862 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:10.382834    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:11.078458 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:11.078405    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:12.115738 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:12.115697    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:12.756211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:12.756164    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:13.564802 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:13.564761    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:14.284958 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:14.284921    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:15.073273 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:15.073243    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:15.730361 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:15.730316    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:16.116490 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:16.116461    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:16.129078 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:16.129055    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:16.363272 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:16.363240    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:16.652349 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:16.652322    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:09:16.976682 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:16.976590    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:17.767776 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:17.767733    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:17.928559 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:17.927295    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"]
Nov 02 22:09:17.933689 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:17.933667    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:17.945732 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:17.945701    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-a1d78c\"/\"default-dockercfg-sz7zh\""
Nov 02 22:09:17.945856 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:17.945770    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-a1d78c\"/\"kube-root-ca.crt\""
Nov 02 22:09:17.945856 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:17.945847    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-a1d78c\"/\"openshift-service-ca.crt\""
Nov 02 22:09:17.945970 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:17.945956    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-a1d78c\"/\"premium-w6-a1d78c-kserve-self-signed-certs\""
Nov 02 22:09:17.947843 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:17.947818    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"]
Nov 02 22:09:17.973904 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:17.973878    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:17.977942 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:17.977911    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-dshm\") pod \"premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") " pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:17.978075 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:17.978045    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-tmp-dir\") pod \"premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") " pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:17.978125 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:17.978109    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-model-cache\") pod \"premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") " pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:17.978175 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:17.978142    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54724ed9-1d96-4698-8e4c-f42d83f04b80-tls-certs\") pod \"premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") " pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:17.978275 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:17.978256    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-home\") pod \"premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") " pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:17.978345 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:17.978307    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2q9c\" (UniqueName: \"kubernetes.io/projected/54724ed9-1d96-4698-8e4c-f42d83f04b80-kube-api-access-f2q9c\") pod \"premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") " pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:18.078954 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:18.078870    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2q9c\" (UniqueName: \"kubernetes.io/projected/54724ed9-1d96-4698-8e4c-f42d83f04b80-kube-api-access-f2q9c\") pod \"premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") " pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:18.079137 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:18.078974    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-dshm\") pod \"premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") " pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:18.079137 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:18.079061    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-tmp-dir\") pod \"premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") " pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:18.079137 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:18.079105    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-model-cache\") pod \"premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") " pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:18.079137 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:18.079132    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54724ed9-1d96-4698-8e4c-f42d83f04b80-tls-certs\") pod \"premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") " pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:18.079406 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:18.079161    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-home\") pod \"premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") " pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:18.079683 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:18.079658    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-home\") pod \"premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") " pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:18.079999 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:18.079975    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-model-cache\") pod \"premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") " pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:18.080322 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:18.080270    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-tmp-dir\") pod \"premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") " pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:18.083765 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:18.083739    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54724ed9-1d96-4698-8e4c-f42d83f04b80-tls-certs\") pod \"premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") " pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:18.088315 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:18.087853    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2q9c\" (UniqueName: \"kubernetes.io/projected/54724ed9-1d96-4698-8e4c-f42d83f04b80-kube-api-access-f2q9c\") pod \"premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") " pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:18.089849 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:18.089827    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-dshm\") pod \"premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") " pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:18.260614 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:18.260581    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:18.498537 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:18.498498    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:18.533332 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:18.533311    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"]
Nov 02 22:09:18.535152 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:09:18.535124    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54724ed9_1d96_4698_8e4c_f42d83f04b80.slice/crio-68bfdf8062ab24a1eff28f2a3ef0f1289152f7ccc48d4e0f99d7a9f63657c427 WatchSource:0}: Error finding container 68bfdf8062ab24a1eff28f2a3ef0f1289152f7ccc48d4e0f99d7a9f63657c427: Status 404 returned error can't find the container with id 68bfdf8062ab24a1eff28f2a3ef0f1289152f7ccc48d4e0f99d7a9f63657c427
Nov 02 22:09:18.654838 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:18.654800    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" event={"ID":"54724ed9-1d96-4698-8e4c-f42d83f04b80","Type":"ContainerStarted","Data":"1c6cfe69ccb788a0723f8b3dd83b2a24068625cfa16fac608558e8180ea1a5d4"}
Nov 02 22:09:18.654997 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:18.654845    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" event={"ID":"54724ed9-1d96-4698-8e4c-f42d83f04b80","Type":"ContainerStarted","Data":"68bfdf8062ab24a1eff28f2a3ef0f1289152f7ccc48d4e0f99d7a9f63657c427"}
Nov 02 22:09:18.669525 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:18.669475    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podStartSLOduration=1.669461063 podStartE2EDuration="1.669461063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:09:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:09:18.668471461 +0000 UTC m=+667.724805841" watchObservedRunningTime="2026-11-02 22:09:18.669461063 +0000 UTC m=+667.725795442"
Nov 02 22:09:19.107169 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:19.107128    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:19.260960 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:19.260929    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:19.786134 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:19.786102    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:20.491717 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:20.491673    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:21.210930 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:21.210889    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:21.975461 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:21.975403    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:22.582987 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:22.582958    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:22.969962 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:22.969926    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:23.281606 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:23.281519    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:23.921929 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:23.921890    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:24.046059 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:24.046009    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:24.679288 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:24.679253    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:25.339584 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:25.339537    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:26.088993 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:26.088956    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:26.775684 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:26.775643    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:27.375795 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:27.375758    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:27.971341 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:27.971301    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:28.261577 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:28.261495    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:28.274595 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:28.274565    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:28.692830 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:28.692791    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:28.740797 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:28.740337    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:09:29.473345 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:29.473303    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:29.887886 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:09:29.887841    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:09:30.086589 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:30.086553    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:30.689649 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:30.689609    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:31.122098 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.122064    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"]
Nov 02 22:09:31.126635 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.126609    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:31.130208 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.130188    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-2532af\"/\"kube-root-ca.crt\""
Nov 02 22:09:31.132763 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.132740    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-2532af\"/\"openshift-service-ca.crt\""
Nov 02 22:09:31.134379 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.134346    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-2532af\"/\"default-dockercfg-wgtlm\""
Nov 02 22:09:31.134484 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.134417    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-2532af\"/\"premium-w2-2532af-kserve-self-signed-certs\""
Nov 02 22:09:31.143560 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.143529    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"]
Nov 02 22:09:31.169051 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.169019    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:31.225386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.225355    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-model-cache\") pod \"premium-w2-2532af-kserve-55ffd9578f-drqv4\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") " pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:31.225567 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.225392    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8prpf\" (UniqueName: \"kubernetes.io/projected/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-kube-api-access-8prpf\") pod \"premium-w2-2532af-kserve-55ffd9578f-drqv4\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") " pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:31.225567 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.225486    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-tmp-dir\") pod \"premium-w2-2532af-kserve-55ffd9578f-drqv4\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") " pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:31.225695 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.225613    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-home\") pod \"premium-w2-2532af-kserve-55ffd9578f-drqv4\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") " pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:31.225695 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.225660    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-dshm\") pod \"premium-w2-2532af-kserve-55ffd9578f-drqv4\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") " pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:31.225808 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.225696    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-tls-certs\") pod \"premium-w2-2532af-kserve-55ffd9578f-drqv4\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") " pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:31.326406 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.326366    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-model-cache\") pod \"premium-w2-2532af-kserve-55ffd9578f-drqv4\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") " pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:31.326595 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.326419    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8prpf\" (UniqueName: \"kubernetes.io/projected/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-kube-api-access-8prpf\") pod \"premium-w2-2532af-kserve-55ffd9578f-drqv4\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") " pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:31.326595 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.326467    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-tmp-dir\") pod \"premium-w2-2532af-kserve-55ffd9578f-drqv4\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") " pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:31.326595 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.326532    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-home\") pod \"premium-w2-2532af-kserve-55ffd9578f-drqv4\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") " pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:31.326595 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.326554    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-dshm\") pod \"premium-w2-2532af-kserve-55ffd9578f-drqv4\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") " pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:31.326595 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.326575    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-tls-certs\") pod \"premium-w2-2532af-kserve-55ffd9578f-drqv4\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") " pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:31.326877 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.326751    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-model-cache\") pod \"premium-w2-2532af-kserve-55ffd9578f-drqv4\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") " pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:31.327162 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.327138    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-tmp-dir\") pod \"premium-w2-2532af-kserve-55ffd9578f-drqv4\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") " pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:31.327366 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.327345    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-home\") pod \"premium-w2-2532af-kserve-55ffd9578f-drqv4\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") " pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:31.329668 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.329643    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-tls-certs\") pod \"premium-w2-2532af-kserve-55ffd9578f-drqv4\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") " pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:31.331140 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.331115    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-dshm\") pod \"premium-w2-2532af-kserve-55ffd9578f-drqv4\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") " pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:31.335400 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.335375    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8prpf\" (UniqueName: \"kubernetes.io/projected/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-kube-api-access-8prpf\") pod \"premium-w2-2532af-kserve-55ffd9578f-drqv4\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") " pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:31.443277 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.443193    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:31.476712 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.474301    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:31.724646 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.724613    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"]
Nov 02 22:09:31.726287 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:09:31.726207    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4dc91fc4_af6f_4f19_87e5_1a2d4db152ca.slice/crio-a92404ea8ba4f89495c85a65e36f57ba259be26c934e53497e6b099915393083 WatchSource:0}: Error finding container a92404ea8ba4f89495c85a65e36f57ba259be26c934e53497e6b099915393083: Status 404 returned error can't find the container with id a92404ea8ba4f89495c85a65e36f57ba259be26c934e53497e6b099915393083
Nov 02 22:09:31.743020 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:31.742997    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" event={"ID":"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca","Type":"ContainerStarted","Data":"a92404ea8ba4f89495c85a65e36f57ba259be26c934e53497e6b099915393083"}
Nov 02 22:09:32.133464 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:32.133427    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:32.752362 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:32.752327    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" event={"ID":"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca","Type":"ContainerStarted","Data":"e2469626a51ea0933eaa5a11cd0f5e9598662c8870cd1847daa47194378f8acf"}
Nov 02 22:09:32.772985 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:32.772940    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podStartSLOduration=1.772927784 podStartE2EDuration="1.772927784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:09:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:09:32.770790284 +0000 UTC m=+681.827124676" watchObservedRunningTime="2026-11-02 22:09:32.772927784 +0000 UTC m=+681.829262163"
Nov 02 22:09:32.779753 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:32.779719    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:33.037950 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:33.037866    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:33.379090 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:33.379031    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:33.443408 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:33.443363    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:33.567151 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:33.567118    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:34.271519 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:34.271478    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:34.984814 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:34.984781    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:35.773260 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:35.770120    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:36.598724 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:36.598689    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:37.209461 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:37.209425    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:37.485709 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:37.485621    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:37.908790 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:37.908749    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:38.674116 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:38.674078    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:39.275415 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:39.275331    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:39.874896 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:39.874860    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:40.037427 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.037399    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"]
Nov 02 22:09:40.042521 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.042495    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:40.048517 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.048491    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-c302b6\"/\"kube-root-ca.crt\""
Nov 02 22:09:40.048676 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.048561    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-c302b6\"/\"openshift-service-ca.crt\""
Nov 02 22:09:40.048897 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.048878    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-c302b6\"/\"default-dockercfg-p55xm\""
Nov 02 22:09:40.049026 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.048946    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-c302b6\"/\"premium-w4-c302b6-kserve-self-signed-certs\""
Nov 02 22:09:40.052133 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.052110    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"]
Nov 02 22:09:40.064208 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.064175    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:40.115455 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.115423    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-dshm\") pod \"premium-w4-c302b6-kserve-85844f6d4b-vrsh7\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") " pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:40.115592 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.115485    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-tmp-dir\") pod \"premium-w4-c302b6-kserve-85844f6d4b-vrsh7\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") " pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:40.115592 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.115539    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6fmr\" (UniqueName: \"kubernetes.io/projected/d608bfbf-7412-42a9-9fb7-52c2309ab511-kube-api-access-v6fmr\") pod \"premium-w4-c302b6-kserve-85844f6d4b-vrsh7\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") " pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:40.115705 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.115685    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-model-cache\") pod \"premium-w4-c302b6-kserve-85844f6d4b-vrsh7\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") " pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:40.115742 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.115732    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d608bfbf-7412-42a9-9fb7-52c2309ab511-tls-certs\") pod \"premium-w4-c302b6-kserve-85844f6d4b-vrsh7\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") " pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:40.115908 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.115888    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-home\") pod \"premium-w4-c302b6-kserve-85844f6d4b-vrsh7\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") " pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:40.217461 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.217383    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-tmp-dir\") pod \"premium-w4-c302b6-kserve-85844f6d4b-vrsh7\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") " pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:40.217461 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.217421    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6fmr\" (UniqueName: \"kubernetes.io/projected/d608bfbf-7412-42a9-9fb7-52c2309ab511-kube-api-access-v6fmr\") pod \"premium-w4-c302b6-kserve-85844f6d4b-vrsh7\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") " pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:40.217703 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.217466    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-model-cache\") pod \"premium-w4-c302b6-kserve-85844f6d4b-vrsh7\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") " pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:40.217703 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.217501    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d608bfbf-7412-42a9-9fb7-52c2309ab511-tls-certs\") pod \"premium-w4-c302b6-kserve-85844f6d4b-vrsh7\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") " pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:40.217703 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.217601    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-home\") pod \"premium-w4-c302b6-kserve-85844f6d4b-vrsh7\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") " pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:40.217703 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.217669    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-dshm\") pod \"premium-w4-c302b6-kserve-85844f6d4b-vrsh7\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") " pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:40.217997 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.217970    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-model-cache\") pod \"premium-w4-c302b6-kserve-85844f6d4b-vrsh7\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") " pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:40.218053 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.218012    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-home\") pod \"premium-w4-c302b6-kserve-85844f6d4b-vrsh7\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") " pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:40.218166 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.218148    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-tmp-dir\") pod \"premium-w4-c302b6-kserve-85844f6d4b-vrsh7\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") " pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:40.220113 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.220077    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-dshm\") pod \"premium-w4-c302b6-kserve-85844f6d4b-vrsh7\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") " pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:40.220327 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.220306    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d608bfbf-7412-42a9-9fb7-52c2309ab511-tls-certs\") pod \"premium-w4-c302b6-kserve-85844f6d4b-vrsh7\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") " pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:40.225011 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.224990    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6fmr\" (UniqueName: \"kubernetes.io/projected/d608bfbf-7412-42a9-9fb7-52c2309ab511-kube-api-access-v6fmr\") pod \"premium-w4-c302b6-kserve-85844f6d4b-vrsh7\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") " pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:40.357473 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.357437    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:40.574912 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.574806    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:40.646370 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.644259    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"]
Nov 02 22:09:40.809301 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.809264    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" event={"ID":"d608bfbf-7412-42a9-9fb7-52c2309ab511","Type":"ContainerStarted","Data":"b621b77a101a713cc1cb45c1fa63f23bc8a412151097bc57163c55bb518f6bb3"}
Nov 02 22:09:40.809301 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.809306    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" event={"ID":"d608bfbf-7412-42a9-9fb7-52c2309ab511","Type":"ContainerStarted","Data":"b905c6e089baebee73677f730231afb66542ad3f61035ed9966e80a277ab7450"}
Nov 02 22:09:40.828672 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:40.828578    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podStartSLOduration=0.828565659 podStartE2EDuration="828.565659ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:09:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:09:40.826591844 +0000 UTC m=+689.882926225" watchObservedRunningTime="2026-11-02 22:09:40.828565659 +0000 UTC m=+689.884900039"
Nov 02 22:09:41.358159 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:41.358130    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:41.381422 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:41.381384    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:41.444160 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:41.444128    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:41.457195 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:41.457173    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:41.828503 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:41.828422    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:09:42.370866 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:42.370829    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:42.974647 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:42.974611    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:43.692296 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:43.692260    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:44.278054 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:44.278015    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:44.967892 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:44.967857    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:45.677783 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:45.677744    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:46.317374 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:46.317339    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:47.291535 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:47.291500    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:48.093881 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:48.093847    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:48.989638 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:48.989604    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:49.859034 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:49.858985    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:50.357809 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:50.357779    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:50.372348 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:50.372317    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:50.483347 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:50.483305    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:50.884112 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:50.884073    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:09:51.196605 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:51.196507    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:51.904724 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:51.904688    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:52.562237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:52.562169    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:53.579274 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:53.579239    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:54.178976 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:54.178937    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:54.777577 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:54.777546    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:55.368584 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:55.368542    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:55.580615 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:55.580582    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:55.973571 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:55.973532    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:56.579674 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:56.579626    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:57.173387 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:57.173351    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:57.771003 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:57.770962    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:58.368544 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:58.368504    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:58.979289 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:58.979243    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:59.157529 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.157499    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"]
Nov 02 22:09:59.161035 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.161004    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.164643 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.164622    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-5f4a2f-openshift-default-dockercfg-d97zb\""
Nov 02 22:09:59.172753 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.172725    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"]
Nov 02 22:09:59.214734 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.214701    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-token\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.214890 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.214767    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-workload-certs\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.214890 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.214837    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq64t\" (UniqueName: \"kubernetes.io/projected/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-kube-api-access-pq64t\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.214987 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.214910    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-credential-socket\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.214987 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.214963    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-podinfo\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.215094 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.214995    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-workload-socket\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.215094 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.215084    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-data\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.215199 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.215113    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istiod-ca-cert\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.215199 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.215149    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-envoy\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.255124 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.255061    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"]
Nov 02 22:09:59.258727 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.258705    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.268475 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.268453    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-719012-openshift-default-dockercfg-glgls\""
Nov 02 22:09:59.270775 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.270755    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"]
Nov 02 22:09:59.316263 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.316210    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f964213a-023a-415b-b5f7-012677864849-istiod-ca-cert\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.316388 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.316272    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-token\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.316388 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.316340    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-istio-envoy\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.316388 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.316365    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-istio-data\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.316497 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.316392    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-workload-socket\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.316543 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.316523    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f964213a-023a-415b-b5f7-012677864849-istio-podinfo\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.316578 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.316553    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-workload-certs\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.316613 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.316579    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-workload-certs\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.316647 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.316619    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq64t\" (UniqueName: \"kubernetes.io/projected/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-kube-api-access-pq64t\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.316680 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.316649    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-credential-socket\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.316714 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.316691    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-credential-socket\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.316754 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.316711    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-podinfo\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.316754 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.316737    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-workload-socket\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.316854 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.316768    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4m74\" (UniqueName: \"kubernetes.io/projected/f964213a-023a-415b-b5f7-012677864849-kube-api-access-h4m74\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.316935 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.316912    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-workload-certs\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.317006 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.316989    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-data\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.317068 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.317005    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-credential-socket\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.317068 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.317020    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istiod-ca-cert\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.317068 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.317051    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f964213a-023a-415b-b5f7-012677864849-istio-token\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.317251 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.317102    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-envoy\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.317251 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.317129    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-workload-socket\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.317349 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.317254    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-data\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.317682 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.317664    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istiod-ca-cert\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.319084 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.319062    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-envoy\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.319263 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.319244    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-podinfo\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.323444 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.323422    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-token\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.323933 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.323912    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq64t\" (UniqueName: \"kubernetes.io/projected/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-kube-api-access-pq64t\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.418680 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.418653    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f964213a-023a-415b-b5f7-012677864849-istiod-ca-cert\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.419067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.418688    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-istio-envoy\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.419067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.418703    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-istio-data\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.419067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.418827    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-workload-socket\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.419067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.418898    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f964213a-023a-415b-b5f7-012677864849-istio-podinfo\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.419067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.418934    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-workload-certs\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.419067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.418985    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-credential-socket\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.419067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.419054    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4m74\" (UniqueName: \"kubernetes.io/projected/f964213a-023a-415b-b5f7-012677864849-kube-api-access-h4m74\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.419518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.419120    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f964213a-023a-415b-b5f7-012677864849-istio-token\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.419518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.419156    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-istio-data\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.419518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.419424    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-workload-certs\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.419518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.419438    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-credential-socket\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.419518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.419457    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f964213a-023a-415b-b5f7-012677864849-istiod-ca-cert\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.419518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.419471    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-workload-socket\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.420771 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.420751    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-istio-envoy\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.421127 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.421111    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f964213a-023a-415b-b5f7-012677864849-istio-podinfo\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.429054 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.429034    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4m74\" (UniqueName: \"kubernetes.io/projected/f964213a-023a-415b-b5f7-012677864849-kube-api-access-h4m74\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.429329 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.429309    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f964213a-023a-415b-b5f7-012677864849-istio-token\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.477143 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.477116    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:09:59.573166 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.572879    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:09:59.682440 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.682402    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:09:59.765454 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.765424    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"]
Nov 02 22:09:59.767820 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:09:59.767794    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f0bc277_c9d9_4d7f_b8f6_272aafaed134.slice/crio-17996470ecc82e3f0859f11ec589c41bbe4fd114011453e31ff263ac72b89081 WatchSource:0}: Error finding container 17996470ecc82e3f0859f11ec589c41bbe4fd114011453e31ff263ac72b89081: Status 404 returned error can't find the container with id 17996470ecc82e3f0859f11ec589c41bbe4fd114011453e31ff263ac72b89081
Nov 02 22:09:59.770288 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.770201    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:09:59.770376 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.770326    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:09:59.770376 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.770358    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:09:59.865514 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.865477    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"]
Nov 02 22:09:59.869317 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:09:59.869279    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf964213a_023a_415b_b5f7_012677864849.slice/crio-c0d80bb4b9e08761f45bab25e304b04fc060182eb0c487326c0c1dfc03a1e67b WatchSource:0}: Error finding container c0d80bb4b9e08761f45bab25e304b04fc060182eb0c487326c0c1dfc03a1e67b: Status 404 returned error can't find the container with id c0d80bb4b9e08761f45bab25e304b04fc060182eb0c487326c0c1dfc03a1e67b
Nov 02 22:09:59.873020 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.872983    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:09:59.873257 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.873211    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:09:59.873377 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.873285    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:09:59.899585 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:09:59.899455    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:09:59.930750 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.930714    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw" event={"ID":"f964213a-023a-415b-b5f7-012677864849","Type":"ContainerStarted","Data":"c0d80bb4b9e08761f45bab25e304b04fc060182eb0c487326c0c1dfc03a1e67b"}
Nov 02 22:09:59.932588 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.932550    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj" event={"ID":"0f0bc277-c9d9-4d7f-b8f6-272aafaed134","Type":"ContainerStarted","Data":"868362832e7229b788ca263588fe9484e003ae8d945f290d05806c49fd9d21cc"}
Nov 02 22:09:59.932709 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.932614    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj" event={"ID":"0f0bc277-c9d9-4d7f-b8f6-272aafaed134","Type":"ContainerStarted","Data":"17996470ecc82e3f0859f11ec589c41bbe4fd114011453e31ff263ac72b89081"}
Nov 02 22:09:59.956269 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:09:59.955923    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj" podStartSLOduration=0.9559048 podStartE2EDuration="955.9048ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:09:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:09:59.954691151 +0000 UTC m=+709.011025531" watchObservedRunningTime="2026-11-02 22:09:59.9559048 +0000 UTC m=+709.012239182"
Nov 02 22:10:00.481245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:00.479584    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:10:00.494969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:00.494357    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Nov 02 22:10:00.494969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:00.494422    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj" podUID="0f0bc277-c9d9-4d7f-b8f6-272aafaed134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Nov 02 22:10:00.608254 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:00.600347    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:00.942191 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:00.942151    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw" event={"ID":"f964213a-023a-415b-b5f7-012677864849","Type":"ContainerStarted","Data":"b6129150c5242f5d559e61d58cbd79233df0c8294bf79d6616315b2bc4e8ebda"}
Nov 02 22:10:00.967374 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:00.967315    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw" podStartSLOduration=1.967296749 podStartE2EDuration="1.967296749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:09:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:10:00.965557363 +0000 UTC m=+710.021891743" watchObservedRunningTime="2026-11-02 22:10:00.967296749 +0000 UTC m=+710.023631131"
Nov 02 22:10:01.490242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:01.479544    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Nov 02 22:10:01.490242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:01.479610    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj" podUID="0f0bc277-c9d9-4d7f-b8f6-272aafaed134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Nov 02 22:10:01.553176 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:01.553141    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:01.583243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:01.576301    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:10:01.583243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:01.580347    5076 patch_prober.go:29] interesting pod/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Nov 02 22:10:01.583243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:01.580418    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw" podUID="f964213a-023a-415b-b5f7-012677864849" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Nov 02 22:10:02.487241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:02.481625    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Nov 02 22:10:02.487241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:02.481689    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj" podUID="0f0bc277-c9d9-4d7f-b8f6-272aafaed134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Nov 02 22:10:02.518249 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:02.517320    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:02.578243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:02.575664    5076 patch_prober.go:29] interesting pod/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Nov 02 22:10:02.578243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:02.575723    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw" podUID="f964213a-023a-415b-b5f7-012677864849" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Nov 02 22:10:03.479628 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:03.479589    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Nov 02 22:10:03.479923 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:03.479886    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj" podUID="0f0bc277-c9d9-4d7f-b8f6-272aafaed134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Nov 02 22:10:03.574155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:03.574118    5076 patch_prober.go:29] interesting pod/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Nov 02 22:10:03.574853 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:03.574815    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw" podUID="f964213a-023a-415b-b5f7-012677864849" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Nov 02 22:10:03.710748 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:03.710710    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:04.479770 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:04.479734    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Nov 02 22:10:04.480206 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:04.480157    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj" podUID="0f0bc277-c9d9-4d7f-b8f6-272aafaed134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Nov 02 22:10:04.575628 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:04.575590    5076 patch_prober.go:29] interesting pod/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Nov 02 22:10:04.576204 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:04.576172    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw" podUID="f964213a-023a-415b-b5f7-012677864849" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Nov 02 22:10:04.690242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:04.689662    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:05.484245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:05.477644    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Nov 02 22:10:05.484245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:05.477712    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj" podUID="0f0bc277-c9d9-4d7f-b8f6-272aafaed134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Nov 02 22:10:05.577356 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:05.577320    5076 patch_prober.go:29] interesting pod/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Nov 02 22:10:05.577931 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:05.577901    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw" podUID="f964213a-023a-415b-b5f7-012677864849" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Nov 02 22:10:05.598240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:05.592558    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:06.291013 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:06.290970    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:06.837484 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:06.837442    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:10:06.838031 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:06.838002    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:10:06.838802 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:06.838782    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:10:06.879179 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:06.879151    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:10:06.879872 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:06.879850    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:10:06.883778 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:06.883757    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:10:07.007447 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:07.007409    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:07.683510 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:07.683475    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:08.285227 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:08.285193    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:08.813684 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:08.813647    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:09.011672 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:09.011631    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:09.586142 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:09.586105    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:10.187540 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:10.187508    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:10.807765 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:10.807732    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:11.390062 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:11.390019    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:12.096491 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:12.096455    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:12.769067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:12.769031    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:13.690210 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:13.690153    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:14.313149 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.313109    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:14.367771 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.367735    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"]
Nov 02 22:10:14.373288 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.373261    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.380244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.380151    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"]
Nov 02 22:10:14.388655 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.388618    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-361a44-openshift-default-dockercfg-6lxp8\""
Nov 02 22:10:14.434385 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.434346    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-podinfo\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.434614 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.434416    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swhhb\" (UniqueName: \"kubernetes.io/projected/0d8408b1-b83c-4a50-a207-714eca0f1b7b-kube-api-access-swhhb\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.434614 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.434523    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-workload-certs\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.434614 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.434552    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istiod-ca-cert\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.434614 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.434602    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-data\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.434856 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.434634    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-token\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.434856 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.434681    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-workload-socket\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.434856 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.434717    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-credential-socket\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.434856 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.434760    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-envoy\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.535890 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.535853    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swhhb\" (UniqueName: \"kubernetes.io/projected/0d8408b1-b83c-4a50-a207-714eca0f1b7b-kube-api-access-swhhb\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.536099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.535937    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-workload-certs\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.536099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.535960    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istiod-ca-cert\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.536099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.535988    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-data\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.536099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.536015    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-token\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.536099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.536060    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-workload-socket\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.536099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.536098    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-credential-socket\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.536472 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.536139    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-envoy\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.536472 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.536179    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-podinfo\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.536472 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.536447    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-workload-certs\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.536945 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.536920    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istiod-ca-cert\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.537102 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.537081    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-data\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.537102 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.537087    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-workload-socket\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.537312 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.537207    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-credential-socket\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.538711 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.538686    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-envoy\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.538801 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.538776    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-podinfo\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.543617 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.543593    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-token\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.543748 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.543733    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swhhb\" (UniqueName: \"kubernetes.io/projected/0d8408b1-b83c-4a50-a207-714eca0f1b7b-kube-api-access-swhhb\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.695246 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.695194    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:14.988975 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.988943    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"]
Nov 02 22:10:14.989644 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:10:14.989602    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d8408b1_b83c_4a50_a207_714eca0f1b7b.slice/crio-dd61a7d99b53e12e6730a2542dab8a3cd58f9fe703c0fab9e490ecb6b4a7cccb WatchSource:0}: Error finding container dd61a7d99b53e12e6730a2542dab8a3cd58f9fe703c0fab9e490ecb6b4a7cccb: Status 404 returned error can't find the container with id dd61a7d99b53e12e6730a2542dab8a3cd58f9fe703c0fab9e490ecb6b4a7cccb
Nov 02 22:10:14.992716 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.992679    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:10:14.992831 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.992757    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:10:14.992831 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:14.992805    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:10:15.063850 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:15.063820    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg" event={"ID":"0d8408b1-b83c-4a50-a207-714eca0f1b7b","Type":"ContainerStarted","Data":"dd61a7d99b53e12e6730a2542dab8a3cd58f9fe703c0fab9e490ecb6b4a7cccb"}
Nov 02 22:10:15.158409 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:15.158369    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:15.898279 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:15.898001    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:16.102435 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:16.102389    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg" event={"ID":"0d8408b1-b83c-4a50-a207-714eca0f1b7b","Type":"ContainerStarted","Data":"0a5c4a78fd962a199f88b6b7225e04318fac0516ca307cbcdb9b02d2ac83c4e2"}
Nov 02 22:10:16.125485 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:16.125428    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg" podStartSLOduration=2.125409656 podStartE2EDuration="2.125409656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:10:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:10:16.122402948 +0000 UTC m=+725.178737330" watchObservedRunningTime="2026-11-02 22:10:16.125409656 +0000 UTC m=+725.181744038"
Nov 02 22:10:16.699242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:16.698120    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:16.699242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:16.698302    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Nov 02 22:10:16.699242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:16.698353    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg" podUID="0d8408b1-b83c-4a50-a207-714eca0f1b7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Nov 02 22:10:16.715291 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:16.715261    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:17.696242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:17.695609    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Nov 02 22:10:17.696242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:17.695676    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg" podUID="0d8408b1-b83c-4a50-a207-714eca0f1b7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Nov 02 22:10:17.903241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:17.902255    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:18.709029 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:18.708156    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Nov 02 22:10:18.709029 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:18.708229    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg" podUID="0d8408b1-b83c-4a50-a207-714eca0f1b7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Nov 02 22:10:18.711178 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:18.710923    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:19.602674 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:19.602626    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:19.695686 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:19.695652    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Nov 02 22:10:19.696002 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:19.695959    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg" podUID="0d8408b1-b83c-4a50-a207-714eca0f1b7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Nov 02 22:10:20.413318 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:20.413276    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:20.695844 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:20.695761    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Nov 02 22:10:20.695844 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:20.695826    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg" podUID="0d8408b1-b83c-4a50-a207-714eca0f1b7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Nov 02 22:10:21.274580 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:21.274530    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:21.981036 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:21.981003    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:21.981974 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:21.981952    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:21.983201 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:21.983173    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:10:22.093007 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:22.092974    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:22.769594 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:22.769563    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:23.383310 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:23.383277    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:23.983161 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:23.983115    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:24.678663 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:24.678627    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:25.382371 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:25.382336    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:26.040393 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:26.040351    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:26.777685 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:26.777636    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:27.447816 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:27.447761    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:28.237540 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:28.237505    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:29.031741 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:29.031705    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:29.950366 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:29.950327    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:29.966481 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:10:29.966436    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:10:30.785863 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:30.785827    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:31.835912 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:31.835854    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:32.508865 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:32.508781    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:33.273593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:33.273557    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:33.447882 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:33.447846    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:33.940968 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:33.940936    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:34.594494 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:34.594460    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:35.397747 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:35.397711    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:35.990834 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:35.990794    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:36.691956 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:36.691922    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:37.778320 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:37.778275    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:38.498774 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:38.498721    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:39.287674 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:39.287462    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:39.888873 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:39.888841    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:40.529324 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:40.529292    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:41.194803 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:41.194766    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:41.443944 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:41.443889    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:41.993487 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:41.993452    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:42.734656 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:42.734616    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:43.410637 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:43.410599    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:44.251463 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:44.251424    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:44.992107 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:44.992069    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:46.333921 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:46.333880    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:46.480906 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:46.480873    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:47.084742 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:47.084701    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:47.771704 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:47.771669    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:48.376878 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:48.376835    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:48.980995 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:48.980953    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:49.483199 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:49.483165    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:49.750321 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:49.750199    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:50.397998 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:50.397955    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:51.113935 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:51.113888    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:52.120755 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:52.120722    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:52.797531 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:52.797498    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:53.503323 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:53.503284    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:54.186177 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:54.186140    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:54.896672 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:54.896633    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:55.647238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:55.646668    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:55.745432 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:55.745389    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:56.348722 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:56.348687    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:56.713033 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:56.712995    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:57.102327 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:57.102275    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:57.879696 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:57.879660    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:58.534342 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:58.534285    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:58.637730 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:58.637690    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:58.738233 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:58.738189    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:59.248162 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.248127    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"]
Nov 02 22:10:59.252145 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.252119    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.265134 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.265109    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"]
Nov 02 22:10:59.285824 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.285782    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e04cfe4-512d-43a4-816f-35e123b876a4-istiod-ca-cert\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.285954 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.285881    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-token\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.285954 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.285910    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdktf\" (UniqueName: \"kubernetes.io/projected/4e04cfe4-512d-43a4-816f-35e123b876a4-kube-api-access-xdktf\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.286078 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.285964    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-podinfo\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.286078 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.285986    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-workload-certs\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.286078 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.286052    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-workload-socket\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.286273 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.286083    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-credential-socket\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.286273 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.286100    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-envoy\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.286273 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.286130    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-data\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.386983 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.386946    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e04cfe4-512d-43a4-816f-35e123b876a4-istiod-ca-cert\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.387133 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.387031    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-token\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.387133 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.387064    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdktf\" (UniqueName: \"kubernetes.io/projected/4e04cfe4-512d-43a4-816f-35e123b876a4-kube-api-access-xdktf\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.387133 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.387114    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-podinfo\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.387354 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.387150    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-workload-certs\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.387354 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.387187    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-workload-socket\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.387354 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.387247    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-credential-socket\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.387354 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.387275    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-envoy\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.387354 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.387328    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-data\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.387707 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.387672    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-workload-socket\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.387830 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.387722    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e04cfe4-512d-43a4-816f-35e123b876a4-istiod-ca-cert\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.387830 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.387750    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-workload-certs\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.387993 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.387969    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-credential-socket\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.388067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.388035    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-data\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.389669 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.389648    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-envoy\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.389838 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.389813    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-podinfo\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.396025 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.395997    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-token\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.397360 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.397339    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdktf\" (UniqueName: \"kubernetes.io/projected/4e04cfe4-512d-43a4-816f-35e123b876a4-kube-api-access-xdktf\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.428446 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.428422    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"]
Nov 02 22:10:59.433417 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.433397    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.441985 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.441959    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"]
Nov 02 22:10:59.488121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.488076    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-credential-socket\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.488313 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.488255    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5e06138-82b8-492e-bd2c-e7098ace48cd-istiod-ca-cert\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.488313 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.488306    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-podinfo\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.488466 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.488424    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-workload-socket\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.488518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.488466    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8gx7\" (UniqueName: \"kubernetes.io/projected/d5e06138-82b8-492e-bd2c-e7098ace48cd-kube-api-access-x8gx7\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.488569 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.488546    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-envoy\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.488620 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.488596    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-workload-certs\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.488682 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.488664    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-data\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.488771 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.488751    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-token\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.489394 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.489376    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"]
Nov 02 22:10:59.493103 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.493081    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.504888 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.504854    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"]
Nov 02 22:10:59.540569 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.540547    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-a1d78c-openshift-default-dockercfg-dr8jk\""
Nov 02 22:10:59.571113 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.571089    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:10:59.588091 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.588062    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:10:59.590287 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.590259    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-credential-socket\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.590442 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.590325    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-envoy\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.590877 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.590835    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-token\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.590984 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.590894    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-podinfo\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.590984 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.590945    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-credential-socket\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.591103 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.591020    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df7tn\" (UniqueName: \"kubernetes.io/projected/cfdf90d5-cf69-43d7-9109-8920f600f3b2-kube-api-access-df7tn\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.591103 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.591065    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5e06138-82b8-492e-bd2c-e7098ace48cd-istiod-ca-cert\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.591103 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.591091    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istiod-ca-cert\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.591298 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.591121    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-workload-socket\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.591298 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.591157    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-podinfo\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.591298 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.591184    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-workload-certs\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.591298 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.591267    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-workload-socket\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.591298 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.591292    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-data\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.591558 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.591332    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-token\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.591558 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.591371    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8gx7\" (UniqueName: \"kubernetes.io/projected/d5e06138-82b8-492e-bd2c-e7098ace48cd-kube-api-access-x8gx7\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.591558 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.591406    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-envoy\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.591558 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.591433    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-workload-certs\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.591558 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.591468    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-data\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.591873 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.591854    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-data\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.592358 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.592335    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-credential-socket\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.593091 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.593053    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5e06138-82b8-492e-bd2c-e7098ace48cd-istiod-ca-cert\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.593091 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.593058    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-workload-socket\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.593632 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.593605    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-workload-certs\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.595773 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.595751    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-envoy\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.595951 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.595934    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-podinfo\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.602501 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.602474    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-token\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.602680 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.602665    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8gx7\" (UniqueName: \"kubernetes.io/projected/d5e06138-82b8-492e-bd2c-e7098ace48cd-kube-api-access-x8gx7\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8skpl\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.681970 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.681936    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"]
Nov 02 22:10:59.687467 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.687442    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.692695 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.692671    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df7tn\" (UniqueName: \"kubernetes.io/projected/cfdf90d5-cf69-43d7-9109-8920f600f3b2-kube-api-access-df7tn\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.692824 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.692706    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-workload-socket\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.692824 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.692743    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-credential-socket\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.692956 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.692887    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istiod-ca-cert\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.692956 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.692921    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-workload-socket\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.693028 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.692958    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-workload-certs\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.693028 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.692997    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-workload-certs\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.693098 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.693055    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhh6s\" (UniqueName: \"kubernetes.io/projected/529b113f-33b4-437c-80e2-6ce54f2ad4be-kube-api-access-nhh6s\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.693139 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.693103    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-data\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.693182 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.693164    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-data\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.693259 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.693197    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/529b113f-33b4-437c-80e2-6ce54f2ad4be-istiod-ca-cert\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.693328 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.693311    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-token\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.693398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.693376    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-workload-socket\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.693398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.693388    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-credential-socket\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.693489 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.693425    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-workload-certs\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.693489 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.693435    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-envoy\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.693613 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.693597    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-data\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.693705 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.693683    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istiod-ca-cert\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.694537 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.693767    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-token\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.694537 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.693811    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-envoy\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.694537 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.693931    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-podinfo\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.694537 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.693986    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-podinfo\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.694537 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.694464    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-credential-socket\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.696091 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.695432    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-c302b6-openshift-default-dockercfg-wc6gv\""
Nov 02 22:10:59.699077 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.699053    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"]
Nov 02 22:10:59.701117 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.701069    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-envoy\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.702195 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.702139    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-podinfo\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.703593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.703575    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-token\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.711896 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.711872    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df7tn\" (UniqueName: \"kubernetes.io/projected/cfdf90d5-cf69-43d7-9109-8920f600f3b2-kube-api-access-df7tn\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.751329 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.751270    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:10:59.794766 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.794734    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-envoy\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.794915 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.794777    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-token\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.794915 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.794829    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-podinfo\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.794915 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.794870    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-workload-socket\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.794915 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.794908    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-credential-socket\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.795140 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.794938    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-workload-certs\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.795140 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.794970    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhh6s\" (UniqueName: \"kubernetes.io/projected/529b113f-33b4-437c-80e2-6ce54f2ad4be-kube-api-access-nhh6s\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.795140 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.794999    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-data\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.795140 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.795050    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/529b113f-33b4-437c-80e2-6ce54f2ad4be-istiod-ca-cert\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.795386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.795352    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-credential-socket\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.795386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.795375    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-workload-socket\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.795556 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.795533    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-workload-certs\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.795632 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.795605    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-data\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.795832 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.795762    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/529b113f-33b4-437c-80e2-6ce54f2ad4be-istiod-ca-cert\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.797396 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.797377    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-podinfo\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.797489 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.797473    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-envoy\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.806019 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.805995    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-token\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.806695 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.806676    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhh6s\" (UniqueName: \"kubernetes.io/projected/529b113f-33b4-437c-80e2-6ce54f2ad4be-kube-api-access-nhh6s\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:10:59.809594 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.809568    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:10:59.860055 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.860010    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"]
Nov 02 22:10:59.865863 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:10:59.865812    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e04cfe4_512d_43a4_816f_35e123b876a4.slice/crio-a791d6517f7d299e52ec5caf9b54d20ab146e01a76065de7a23246d4be025d0d WatchSource:0}: Error finding container a791d6517f7d299e52ec5caf9b54d20ab146e01a76065de7a23246d4be025d0d: Status 404 returned error can't find the container with id a791d6517f7d299e52ec5caf9b54d20ab146e01a76065de7a23246d4be025d0d
Nov 02 22:10:59.870108 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.868918    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:10:59.870108 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.869008    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:10:59.870108 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:10:59.869046    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:10:59.911533 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:10:59.911498    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:11:00.006576 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.006495    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:11:00.034892 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.034861    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"]
Nov 02 22:11:00.035586 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:11:00.035555    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e06138_82b8_492e_bd2c_e7098ace48cd.slice/crio-4e2133aaf1da8dc38dff062441ba75685e3abd173bee3d02e4eb684e528db09c WatchSource:0}: Error finding container 4e2133aaf1da8dc38dff062441ba75685e3abd173bee3d02e4eb684e528db09c: Status 404 returned error can't find the container with id 4e2133aaf1da8dc38dff062441ba75685e3abd173bee3d02e4eb684e528db09c
Nov 02 22:11:00.038266 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.038198    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:00.038369 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.038308    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:00.038369 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.038358    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:00.125174 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.125142    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"]
Nov 02 22:11:00.138243 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:11:00.134667    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfdf90d5_cf69_43d7_9109_8920f600f3b2.slice/crio-22af357cc9fc11e16439eea413c96ee3de763e2249ca75774f54033bbfa928d5 WatchSource:0}: Error finding container 22af357cc9fc11e16439eea413c96ee3de763e2249ca75774f54033bbfa928d5: Status 404 returned error can't find the container with id 22af357cc9fc11e16439eea413c96ee3de763e2249ca75774f54033bbfa928d5
Nov 02 22:11:00.138243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.137830    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:00.138243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.137919    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:00.138243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.137965    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:00.303795 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:11:00.303758    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod529b113f_33b4_437c_80e2_6ce54f2ad4be.slice/crio-27f0520dfb584b68048e978f9a531af07993ea39ab0060219a0c88171fddb21c WatchSource:0}: Error finding container 27f0520dfb584b68048e978f9a531af07993ea39ab0060219a0c88171fddb21c: Status 404 returned error can't find the container with id 27f0520dfb584b68048e978f9a531af07993ea39ab0060219a0c88171fddb21c
Nov 02 22:11:00.306700 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.306480    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:00.306700 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.306568    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:00.306700 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.306609    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:00.308930 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.308898    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"]
Nov 02 22:11:00.375158 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.375082    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:00.413788 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.412842    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl" event={"ID":"d5e06138-82b8-492e-bd2c-e7098ace48cd","Type":"ContainerStarted","Data":"7c188d9dcbd1ed5370fc15b9a8d15a574abe1a466ba77bee57551caf792c1a28"}
Nov 02 22:11:00.413788 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.412906    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl" event={"ID":"d5e06138-82b8-492e-bd2c-e7098ace48cd","Type":"ContainerStarted","Data":"4e2133aaf1da8dc38dff062441ba75685e3abd173bee3d02e4eb684e528db09c"}
Nov 02 22:11:00.418100 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.416556    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm" event={"ID":"4e04cfe4-512d-43a4-816f-35e123b876a4","Type":"ContainerStarted","Data":"ca321db335e47d049ae3f7708b9254bec5767d976b163b41d253f24b5288f6ad"}
Nov 02 22:11:00.418100 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.416613    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm" event={"ID":"4e04cfe4-512d-43a4-816f-35e123b876a4","Type":"ContainerStarted","Data":"a791d6517f7d299e52ec5caf9b54d20ab146e01a76065de7a23246d4be025d0d"}
Nov 02 22:11:00.422074 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.421487    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4" event={"ID":"529b113f-33b4-437c-80e2-6ce54f2ad4be","Type":"ContainerStarted","Data":"c3dd5c5866105e4831098b9a5e4294ecdfed2d515d9edd906ac86557eee82fdc"}
Nov 02 22:11:00.422074 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.421538    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4" event={"ID":"529b113f-33b4-437c-80e2-6ce54f2ad4be","Type":"ContainerStarted","Data":"27f0520dfb584b68048e978f9a531af07993ea39ab0060219a0c88171fddb21c"}
Nov 02 22:11:00.425089 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.424564    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc" event={"ID":"cfdf90d5-cf69-43d7-9109-8920f600f3b2","Type":"ContainerStarted","Data":"5ac690a076113da0aeda5aee099798f32201935556ee81c08ace55a457f312b2"}
Nov 02 22:11:00.425089 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.424612    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc" event={"ID":"cfdf90d5-cf69-43d7-9109-8920f600f3b2","Type":"ContainerStarted","Data":"22af357cc9fc11e16439eea413c96ee3de763e2249ca75774f54033bbfa928d5"}
Nov 02 22:11:00.463165 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.463097    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl" podStartSLOduration=1.463074295 podStartE2EDuration="1.463074295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:10:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:11:00.436358361 +0000 UTC m=+769.492692743" watchObservedRunningTime="2026-11-02 22:11:00.463074295 +0000 UTC m=+769.519408678"
Nov 02 22:11:00.516325 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.516265    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc" podStartSLOduration=1.5162464390000001 podStartE2EDuration="1.516246439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:10:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:11:00.514905492 +0000 UTC m=+769.571239883" watchObservedRunningTime="2026-11-02 22:11:00.516246439 +0000 UTC m=+769.572580821"
Nov 02 22:11:00.569180 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.569064    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm" podStartSLOduration=1.56904149 podStartE2EDuration="1.56904149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:10:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:11:00.480845529 +0000 UTC m=+769.537179923" watchObservedRunningTime="2026-11-02 22:11:00.56904149 +0000 UTC m=+769.625375872"
Nov 02 22:11:00.575237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.572830    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:11:00.575237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.573001    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Nov 02 22:11:00.575237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.573053    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm" podUID="4e04cfe4-512d-43a4-816f-35e123b876a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Nov 02 22:11:00.580256 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.579034    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4" podStartSLOduration=1.57901527 podStartE2EDuration="1.57901527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:10:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:11:00.553444902 +0000 UTC m=+769.609779283" watchObservedRunningTime="2026-11-02 22:11:00.57901527 +0000 UTC m=+769.635349650"
Nov 02 22:11:00.752320 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.752285    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:11:00.812272 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:00.812233    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:11:01.036240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:01.011324    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:11:01.046278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:01.039818    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Nov 02 22:11:01.090034 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:01.079649    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4" podUID="529b113f-33b4-437c-80e2-6ce54f2ad4be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Nov 02 22:11:01.575652 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:01.575612    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Nov 02 22:11:01.576297 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:01.576263    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm" podUID="4e04cfe4-512d-43a4-816f-35e123b876a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Nov 02 22:11:01.710243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:01.707970    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:01.754044 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:01.754006    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Nov 02 22:11:01.754310 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:01.754282    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl" podUID="d5e06138-82b8-492e-bd2c-e7098ace48cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Nov 02 22:11:01.815462 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:01.815425    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Nov 02 22:11:01.815716 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:01.815685    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc" podUID="cfdf90d5-cf69-43d7-9109-8920f600f3b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Nov 02 22:11:02.017145 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:02.016662    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Nov 02 22:11:02.017145 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:02.016727    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4" podUID="529b113f-33b4-437c-80e2-6ce54f2ad4be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Nov 02 22:11:02.577288 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:02.577030    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Nov 02 22:11:02.577288 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:02.577084    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm" podUID="4e04cfe4-512d-43a4-816f-35e123b876a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Nov 02 22:11:02.764245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:02.760611    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Nov 02 22:11:02.764245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:02.760680    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl" podUID="d5e06138-82b8-492e-bd2c-e7098ace48cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Nov 02 22:11:02.811254 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:02.810606    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Nov 02 22:11:02.811254 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:02.810665    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc" podUID="cfdf90d5-cf69-43d7-9109-8920f600f3b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Nov 02 22:11:03.007623 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:03.007586    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Nov 02 22:11:03.007914 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:03.007888    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4" podUID="529b113f-33b4-437c-80e2-6ce54f2ad4be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Nov 02 22:11:03.046774 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:03.046742    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:03.223148 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:03.223114    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:03.613121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:03.612632    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Nov 02 22:11:03.613121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:03.612728    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm" podUID="4e04cfe4-512d-43a4-816f-35e123b876a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Nov 02 22:11:03.764246 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:03.764195    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Nov 02 22:11:03.764511 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:03.764484    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl" podUID="d5e06138-82b8-492e-bd2c-e7098ace48cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Nov 02 22:11:03.812114 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:03.811631    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Nov 02 22:11:03.812114 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:03.811698    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc" podUID="cfdf90d5-cf69-43d7-9109-8920f600f3b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Nov 02 22:11:04.018352 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.011607    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Nov 02 22:11:04.018352 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.011667    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4" podUID="529b113f-33b4-437c-80e2-6ce54f2ad4be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Nov 02 22:11:04.426192 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.426143    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"]
Nov 02 22:11:04.442488 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.442456    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.474242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.467279    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"]
Nov 02 22:11:04.679467 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.588086    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Nov 02 22:11:04.679467 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.588170    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm" podUID="4e04cfe4-512d-43a4-816f-35e123b876a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Nov 02 22:11:04.765244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.764037    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Nov 02 22:11:04.765244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.764129    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl" podUID="d5e06138-82b8-492e-bd2c-e7098ace48cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Nov 02 22:11:04.789868 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.789827    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-envoy\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.790169 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.790145    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-podinfo\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.802450 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.802403    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-credential-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.802614 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.802465    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-workload-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.802614 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.802533    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8wcc\" (UniqueName: \"kubernetes.io/projected/15d4c979-5871-42fa-9cb4-10ca87638d95-kube-api-access-w8wcc\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.802734 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.802665    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-workload-certs\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.802734 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.802704    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-data\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.802852 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.802735    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-token\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.802852 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.802792    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15d4c979-5871-42fa-9cb4-10ca87638d95-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.879079 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.879043    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Nov 02 22:11:04.923016 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.922790    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-workload-certs\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.923337 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.923311    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-data\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.923955 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.923933    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-token\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.924139 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.924115    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-workload-certs\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.924349 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.923179    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc" podUID="cfdf90d5-cf69-43d7-9109-8920f600f3b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Nov 02 22:11:04.924624 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.923853    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-data\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.924762 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.924195    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15d4c979-5871-42fa-9cb4-10ca87638d95-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.932293 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.929090    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-envoy\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.932293 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.929148    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-podinfo\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.932293 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.929204    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-credential-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.932293 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.929247    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-workload-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.932293 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.929301    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8wcc\" (UniqueName: \"kubernetes.io/projected/15d4c979-5871-42fa-9cb4-10ca87638d95-kube-api-access-w8wcc\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.932293 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.924750    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:04.933272 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.933251    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-credential-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.933421 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.928989    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15d4c979-5871-42fa-9cb4-10ca87638d95-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.934333 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.934312    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-workload-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.941757 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.941733    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-podinfo\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.958586 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.958559    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-envoy\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.977002 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.976969    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-token\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:04.984244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:04.984000    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8wcc\" (UniqueName: \"kubernetes.io/projected/15d4c979-5871-42fa-9cb4-10ca87638d95-kube-api-access-w8wcc\") pod \"maas-default-gateway-openshift-default-696f47c6c-rg7sh\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:05.010105 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:05.009619    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Nov 02 22:11:05.010105 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:05.009700    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4" podUID="529b113f-33b4-437c-80e2-6ce54f2ad4be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Nov 02 22:11:05.107544 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:05.107513    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:05.473743 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:05.473669    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:05.620253 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:05.589190    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"]
Nov 02 22:11:05.646243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:05.630035    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Nov 02 22:11:05.646243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:05.630091    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm" podUID="4e04cfe4-512d-43a4-816f-35e123b876a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Nov 02 22:11:05.647162 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:05.647093    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:05.717269 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:05.692300    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:05.717269 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:05.692396    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:05.717269 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:05.692439    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:05.825739 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:05.797478    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Nov 02 22:11:05.825739 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:05.797532    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl" podUID="d5e06138-82b8-492e-bd2c-e7098ace48cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Nov 02 22:11:05.913529 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:05.910091    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Nov 02 22:11:05.913529 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:05.910152    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc" podUID="cfdf90d5-cf69-43d7-9109-8920f600f3b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Nov 02 22:11:05.936017 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:05.935972    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh" event={"ID":"15d4c979-5871-42fa-9cb4-10ca87638d95","Type":"ContainerStarted","Data":"7f17098bff9c81ee546039099111f88c3d9170fde838050597abcb211ca71d8e"}
Nov 02 22:11:06.007564 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:06.007527    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Nov 02 22:11:06.007818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:06.007794    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4" podUID="529b113f-33b4-437c-80e2-6ce54f2ad4be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Nov 02 22:11:06.572645 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:06.572553    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Nov 02 22:11:06.572896 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:06.572868    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm" podUID="4e04cfe4-512d-43a4-816f-35e123b876a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Nov 02 22:11:06.754650 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:06.754612    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Nov 02 22:11:06.755237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:06.755185    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl" podUID="d5e06138-82b8-492e-bd2c-e7098ace48cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Nov 02 22:11:06.811943 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:06.811908    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Nov 02 22:11:06.812196 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:06.812164    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc" podUID="cfdf90d5-cf69-43d7-9109-8920f600f3b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Nov 02 22:11:07.122244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:07.102637    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Nov 02 22:11:07.122244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:07.102699    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4" podUID="529b113f-33b4-437c-80e2-6ce54f2ad4be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Nov 02 22:11:07.434292 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:07.434024    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:07.464924 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:07.464887    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh" event={"ID":"15d4c979-5871-42fa-9cb4-10ca87638d95","Type":"ContainerStarted","Data":"c743957a965b0db6914723007a4e08e93789f55199ccaef175b4ed68af22a35b"}
Nov 02 22:11:07.537278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:07.536206    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh" podStartSLOduration=3.536181176 podStartE2EDuration="3.536181176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:11:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:11:07.500710742 +0000 UTC m=+776.557045125" watchObservedRunningTime="2026-11-02 22:11:07.536181176 +0000 UTC m=+776.592515561"
Nov 02 22:11:07.572970 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:07.572928    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Nov 02 22:11:07.573270 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:07.573239    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm" podUID="4e04cfe4-512d-43a4-816f-35e123b876a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Nov 02 22:11:07.752793 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:07.752695    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Nov 02 22:11:07.753079 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:07.753032    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl" podUID="d5e06138-82b8-492e-bd2c-e7098ace48cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Nov 02 22:11:07.822263 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:07.817728    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Nov 02 22:11:07.822263 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:07.817785    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc" podUID="cfdf90d5-cf69-43d7-9109-8920f600f3b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Nov 02 22:11:08.020293 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:08.019617    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Nov 02 22:11:08.020293 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:08.019678    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4" podUID="529b113f-33b4-437c-80e2-6ce54f2ad4be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Nov 02 22:11:08.113240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:08.108414    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:08.113240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:08.110552    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-rg7sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Nov 02 22:11:08.113240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:08.110602    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh" podUID="15d4c979-5871-42fa-9cb4-10ca87638d95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Nov 02 22:11:08.763273 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:08.762593    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Nov 02 22:11:08.763273 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:08.762653    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl" podUID="d5e06138-82b8-492e-bd2c-e7098ace48cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Nov 02 22:11:08.810680 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:08.810644    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Nov 02 22:11:08.810945 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:08.810915    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc" podUID="cfdf90d5-cf69-43d7-9109-8920f600f3b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Nov 02 22:11:08.978439 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:08.978266    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:09.011775 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:09.011703    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Nov 02 22:11:09.012042 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:09.011979    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4" podUID="529b113f-33b4-437c-80e2-6ce54f2ad4be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Nov 02 22:11:09.111255 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:09.108594    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-rg7sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Nov 02 22:11:09.111255 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:09.108656    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh" podUID="15d4c979-5871-42fa-9cb4-10ca87638d95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Nov 02 22:11:09.584306 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:09.581313    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:11:09.584306 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:09.581383    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm" podUID="4e04cfe4-512d-43a4-816f-35e123b876a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:09.782188 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:09.782138    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Nov 02 22:11:09.841301 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:09.828310    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl" podUID="d5e06138-82b8-492e-bd2c-e7098ace48cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Nov 02 22:11:10.108694 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:10.108657    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-rg7sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Nov 02 22:11:10.109305 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:10.109269    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh" podUID="15d4c979-5871-42fa-9cb4-10ca87638d95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Nov 02 22:11:10.565304 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:10.564300    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:10.626581 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:10.626542    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:11:10.626887 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:10.626843    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm" podUID="4e04cfe4-512d-43a4-816f-35e123b876a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:10.864417 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:10.864366    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:11:10.864727 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:10.864679    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc" podUID="cfdf90d5-cf69-43d7-9109-8920f600f3b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:10.879020 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:10.878314    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:11.088511 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:11.088474    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:11:11.088825 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:11.088778    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4" podUID="529b113f-33b4-437c-80e2-6ce54f2ad4be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:11.109871 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:11.109836    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-rg7sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Nov 02 22:11:11.110436 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:11.110405    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh" podUID="15d4c979-5871-42fa-9cb4-10ca87638d95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Nov 02 22:11:11.391251 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:11.378971    5076 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/health\": context deadline exceeded"
Nov 02 22:11:11.663142 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:11.661661    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:11.663142 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:11.662074    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:11:11.701865 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:11.701750    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:11:11.701865 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:11.701817    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm" podUID="4e04cfe4-512d-43a4-816f-35e123b876a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:11.801245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:11.794293    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:11:11.801245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:11.794357    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl" podUID="d5e06138-82b8-492e-bd2c-e7098ace48cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:11.824883 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:11.824837    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:11.869032 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:11.868998    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:11:11.887799 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:11.887764    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:11:11.888082 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:11.888049    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc" podUID="cfdf90d5-cf69-43d7-9109-8920f600f3b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:11.889175 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:11.889147    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:11.890403 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:11.890383    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:11:12.000943 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:12.000854    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:12.116484 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:12.116450    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-rg7sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Nov 02 22:11:12.117024 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:12.116990    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh" podUID="15d4c979-5871-42fa-9cb4-10ca87638d95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Nov 02 22:11:12.133640 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:12.133607    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:11:12.133867 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:12.133842    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4" podUID="529b113f-33b4-437c-80e2-6ce54f2ad4be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:12.510004 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:12.509970    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:11:12.528765 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:12.527542    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:11:12.528765 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:12.527601    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:11:12.528765 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:12.528599    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:11:12.546734 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:12.545568    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:11:12.546734 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:12.545777    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:11:12.841338 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:12.832302    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:12.841338 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:12.833009    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:11:12.843277 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:12.843252    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:11:12.843524 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:12.843499    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl" podUID="d5e06138-82b8-492e-bd2c-e7098ace48cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:12.941374 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:12.907076    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:12.956239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:12.942637    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:11:12.956239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:12.942691    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc" podUID="cfdf90d5-cf69-43d7-9109-8920f600f3b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:12.957233 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:12.957188    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:11:13.110296 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:13.108628    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-rg7sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Nov 02 22:11:13.110296 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:13.108691    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh" podUID="15d4c979-5871-42fa-9cb4-10ca87638d95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Nov 02 22:11:13.159149 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:13.159120    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:11:13.165973 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:13.165952    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:11:13.168011 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:13.167989    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:11:13.206920 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:13.206891    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:11:13.207244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:13.207195    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:11:13.208177 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:13.208158    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:11:13.215650 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:13.215465    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:11:13.401837 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:13.401712    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:14.108865 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.108827    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-rg7sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Nov 02 22:11:14.109048 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.108894    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh" podUID="15d4c979-5871-42fa-9cb4-10ca87638d95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Nov 02 22:11:14.183244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.181283    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"]
Nov 02 22:11:14.189240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.187155    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.200249 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.196356    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-2532af-openshift-default-dockercfg-9p29v\""
Nov 02 22:11:14.204673 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.203365    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"]
Nov 02 22:11:14.237099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.237068    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:14.323091 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.323055    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-envoy\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.323432 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.323406    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-workload-certs\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.323552 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.323538    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-podinfo\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.323653 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.323640    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d16ff19e-c9b6-4157-91fb-d4d605a78839-istiod-ca-cert\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.323761 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.323749    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-data\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.323872 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.323858    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-credential-socket\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.324060 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.324046    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-workload-socket\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.324193 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.324179    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvz4c\" (UniqueName: \"kubernetes.io/projected/d16ff19e-c9b6-4157-91fb-d4d605a78839-kube-api-access-fvz4c\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.324627 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.324596    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-token\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.425506 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.425421    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-token\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.425682 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.425525    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-envoy\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.425682 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.425571    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-workload-certs\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.425682 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.425594    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-podinfo\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.425682 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.425621    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d16ff19e-c9b6-4157-91fb-d4d605a78839-istiod-ca-cert\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.425682 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.425658    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-data\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.425949 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.425704    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-credential-socket\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.425949 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.425766    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-workload-socket\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.425949 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.425812    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvz4c\" (UniqueName: \"kubernetes.io/projected/d16ff19e-c9b6-4157-91fb-d4d605a78839-kube-api-access-fvz4c\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.426096 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.426011    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-workload-certs\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.426096 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.426024    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-data\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.426338 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.426315    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-credential-socket\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.426401 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.426334    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-workload-socket\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.426448 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.426403    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d16ff19e-c9b6-4157-91fb-d4d605a78839-istiod-ca-cert\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.428490 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.428462    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-envoy\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.429923 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.429896    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-podinfo\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.435083 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.435057    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-token\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.436413 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.436387    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvz4c\" (UniqueName: \"kubernetes.io/projected/d16ff19e-c9b6-4157-91fb-d4d605a78839-kube-api-access-fvz4c\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-szwxv\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.513287 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.513239    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:14.573358 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.573324    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"]
Nov 02 22:11:14.579443 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.579421    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.593456 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.592140    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-310bb3-openshift-default-dockercfg-qrwjr\""
Nov 02 22:11:14.603735 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.601930    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"]
Nov 02 22:11:14.731498 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.731405    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-workload-certs\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.731498 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.731458    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-istio-envoy\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.731729 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.731574    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-credential-socket\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.731729 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.731605    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7531eb01-20ab-44cb-866a-8eb290c94383-istio-podinfo\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.731835 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.731749    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c77bp\" (UniqueName: \"kubernetes.io/projected/7531eb01-20ab-44cb-866a-8eb290c94383-kube-api-access-c77bp\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.731835 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.731805    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-workload-socket\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.731936 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.731838    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-istio-data\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.731999 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.731982    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7531eb01-20ab-44cb-866a-8eb290c94383-istio-token\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.732054 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.732012    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7531eb01-20ab-44cb-866a-8eb290c94383-istiod-ca-cert\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.832943 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.832902    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7531eb01-20ab-44cb-866a-8eb290c94383-istio-token\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.832943 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.832945    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7531eb01-20ab-44cb-866a-8eb290c94383-istiod-ca-cert\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.833187 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.833008    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-workload-certs\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.833187 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.833034    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-istio-envoy\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.833187 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.833075    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-credential-socket\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.833187 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.833098    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7531eb01-20ab-44cb-866a-8eb290c94383-istio-podinfo\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.833500 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.833186    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c77bp\" (UniqueName: \"kubernetes.io/projected/7531eb01-20ab-44cb-866a-8eb290c94383-kube-api-access-c77bp\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.833500 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.833240    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-workload-socket\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.833500 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.833270    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-istio-data\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.833708 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.833686    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-credential-socket\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.833947 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.833927    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-workload-socket\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.834186 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.833695    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-istio-data\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.834604 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.834582    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-workload-certs\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.834699 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.834599    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7531eb01-20ab-44cb-866a-8eb290c94383-istiod-ca-cert\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.841295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.839398    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7531eb01-20ab-44cb-866a-8eb290c94383-istio-podinfo\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.842252 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.841795    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"]
Nov 02 22:11:14.842507 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.842446    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-istio-envoy\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.843506 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:11:14.843483    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd16ff19e_c9b6_4157_91fb_d4d605a78839.slice/crio-94c530538868a7dcd6a9fee133c2fbe7907ed2b05e82fe7858e4536258619969 WatchSource:0}: Error finding container 94c530538868a7dcd6a9fee133c2fbe7907ed2b05e82fe7858e4536258619969: Status 404 returned error can't find the container with id 94c530538868a7dcd6a9fee133c2fbe7907ed2b05e82fe7858e4536258619969
Nov 02 22:11:14.847256 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.847184    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:14.847356 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.847302    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:14.847356 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.847347    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:14.849703 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.848655    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c77bp\" (UniqueName: \"kubernetes.io/projected/7531eb01-20ab-44cb-866a-8eb290c94383-kube-api-access-c77bp\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.866673 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.860608    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7531eb01-20ab-44cb-866a-8eb290c94383-istio-token\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.901316 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.901199    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:14.934405 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.934377    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:14.967252 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.967114    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv" event={"ID":"d16ff19e-c9b6-4157-91fb-d4d605a78839","Type":"ContainerStarted","Data":"f5b5435ab187289381095e6591c2890b8ba05991d863ca5b5dbd81115451bdc9"}
Nov 02 22:11:14.967252 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:14.967172    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv" event={"ID":"d16ff19e-c9b6-4157-91fb-d4d605a78839","Type":"ContainerStarted","Data":"94c530538868a7dcd6a9fee133c2fbe7907ed2b05e82fe7858e4536258619969"}
Nov 02 22:11:15.008876 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:15.005080    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv" podStartSLOduration=1.005061961 podStartE2EDuration="1.005061961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:11:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:11:14.989627774 +0000 UTC m=+784.045962155" watchObservedRunningTime="2026-11-02 22:11:15.005061961 +0000 UTC m=+784.061396343"
Nov 02 22:11:15.127241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:15.126861    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-rg7sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Nov 02 22:11:15.127241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:15.126931    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh" podUID="15d4c979-5871-42fa-9cb4-10ca87638d95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Nov 02 22:11:15.298604 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:15.298492    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:15.405192 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:15.405160    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"]
Nov 02 22:11:15.405564 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:11:15.405525    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7531eb01_20ab_44cb_866a_8eb290c94383.slice/crio-50339d156d914da6767bcd1a23da58c03106ec3ad100808e92887165a54086f2 WatchSource:0}: Error finding container 50339d156d914da6767bcd1a23da58c03106ec3ad100808e92887165a54086f2: Status 404 returned error can't find the container with id 50339d156d914da6767bcd1a23da58c03106ec3ad100808e92887165a54086f2
Nov 02 22:11:15.408367 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:15.408326    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:15.408452 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:15.408414    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:15.408497 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:15.408459    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:15.514642 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:15.514615    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:15.516070 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:15.516044    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Nov 02 22:11:15.516192 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:15.516092    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv" podUID="d16ff19e-c9b6-4157-91fb-d4d605a78839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Nov 02 22:11:16.002599 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:16.002432    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws" event={"ID":"7531eb01-20ab-44cb-866a-8eb290c94383","Type":"ContainerStarted","Data":"c2639d4ca8b0aab79f118f81cfb793cb9820ca05cecb37a730c0b936f0e527dc"}
Nov 02 22:11:16.002599 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:16.002518    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws" event={"ID":"7531eb01-20ab-44cb-866a-8eb290c94383","Type":"ContainerStarted","Data":"50339d156d914da6767bcd1a23da58c03106ec3ad100808e92887165a54086f2"}
Nov 02 22:11:16.112677 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:16.112641    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-rg7sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Nov 02 22:11:16.112930 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:16.112904    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh" podUID="15d4c979-5871-42fa-9cb4-10ca87638d95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Nov 02 22:11:16.390241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:16.386655    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:16.524285 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:16.519417    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Nov 02 22:11:16.524285 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:16.519478    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv" podUID="d16ff19e-c9b6-4157-91fb-d4d605a78839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Nov 02 22:11:16.943270 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:16.939282    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:16.943270 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:16.942573    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Nov 02 22:11:16.943270 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:16.942640    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws" podUID="7531eb01-20ab-44cb-866a-8eb290c94383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Nov 02 22:11:17.380260 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:17.377818    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:17.519240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:17.518686    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Nov 02 22:11:17.519240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:17.518750    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv" podUID="d16ff19e-c9b6-4157-91fb-d4d605a78839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Nov 02 22:11:17.940775 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:17.939329    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Nov 02 22:11:17.940775 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:17.939395    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws" podUID="7531eb01-20ab-44cb-866a-8eb290c94383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Nov 02 22:11:18.142278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:18.135335    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-rg7sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:11:18.142278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:18.135419    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh" podUID="15d4c979-5871-42fa-9cb4-10ca87638d95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:18.258418 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:18.258329    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:18.258873 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:18.258845    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:18.259890 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:18.259857    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:11:18.290237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:18.281556    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws" podStartSLOduration=4.281536209 podStartE2EDuration="4.281536209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:11:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:11:16.032947319 +0000 UTC m=+785.089281699" watchObservedRunningTime="2026-11-02 22:11:18.281536209 +0000 UTC m=+787.337870590"
Nov 02 22:11:18.425324 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:18.422927    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:18.518029 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:18.516607    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Nov 02 22:11:18.518029 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:18.516670    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv" podUID="d16ff19e-c9b6-4157-91fb-d4d605a78839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Nov 02 22:11:18.935088 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:18.935051    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Nov 02 22:11:18.935505 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:18.935099    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws" podUID="7531eb01-20ab-44cb-866a-8eb290c94383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Nov 02 22:11:19.219992 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:19.219908    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:19.519317 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:19.515579    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Nov 02 22:11:19.519317 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:19.515642    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv" podUID="d16ff19e-c9b6-4157-91fb-d4d605a78839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Nov 02 22:11:19.935981 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:19.935948    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Nov 02 22:11:19.936473 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:19.936006    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws" podUID="7531eb01-20ab-44cb-866a-8eb290c94383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Nov 02 22:11:20.212296 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:20.208787    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:20.518299 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:20.514609    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Nov 02 22:11:20.518299 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:20.514675    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv" podUID="d16ff19e-c9b6-4157-91fb-d4d605a78839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Nov 02 22:11:20.935505 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:20.935468    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Nov 02 22:11:20.935810 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:20.935761    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws" podUID="7531eb01-20ab-44cb-866a-8eb290c94383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Nov 02 22:11:21.200024 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:21.199932    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:21.514665 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:21.514577    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Nov 02 22:11:21.514665 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:21.514638    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv" podUID="d16ff19e-c9b6-4157-91fb-d4d605a78839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Nov 02 22:11:21.886185 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:21.886147    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:21.935212 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:21.935175    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Nov 02 22:11:21.935420 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:21.935272    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws" podUID="7531eb01-20ab-44cb-866a-8eb290c94383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Nov 02 22:11:22.518386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:22.518103    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:22.519058 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:22.518906    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:22.519575 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:22.519554    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:11:22.578787 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:22.578694    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:22.941907 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:22.941872    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:22.942785 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:22.942723    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:22.943702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:22.943683    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:11:22.968339 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:22.968247    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:23.481641 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:23.481594    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:24.134878 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:24.134842    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:24.493637 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:24.493556    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:24.892581 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:24.892544    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:25.492799 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.492753    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:25.626038 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.626000    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"]
Nov 02 22:11:25.648504 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.648469    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:25.653131 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.653100    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"]
Nov 02 22:11:25.667683 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.667660    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-719012\"/\"distinct-2-w3-719012-kserve-self-signed-certs\""
Nov 02 22:11:25.678824 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.678796    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:25.697982 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.697936    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhkwq\" (UniqueName: \"kubernetes.io/projected/6b055e70-1c04-48f7-a96e-68ac94b0b283-kube-api-access-hhkwq\") pod \"distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") " pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:25.698149 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.698062    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-tmp-dir\") pod \"distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") " pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:25.698149 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.698138    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-dshm\") pod \"distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") " pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:25.698306 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.698272    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-home\") pod \"distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") " pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:25.698392 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.698373    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-model-cache\") pod \"distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") " pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:25.698458 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.698419    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b055e70-1c04-48f7-a96e-68ac94b0b283-tls-certs\") pod \"distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") " pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:25.805290 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.799949    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhkwq\" (UniqueName: \"kubernetes.io/projected/6b055e70-1c04-48f7-a96e-68ac94b0b283-kube-api-access-hhkwq\") pod \"distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") " pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:25.805290 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.800021    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-tmp-dir\") pod \"distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") " pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:25.805290 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.800092    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-dshm\") pod \"distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") " pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:25.805290 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.800143    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-home\") pod \"distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") " pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:25.805290 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.800238    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-model-cache\") pod \"distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") " pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:25.805290 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.800292    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b055e70-1c04-48f7-a96e-68ac94b0b283-tls-certs\") pod \"distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") " pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:25.805290 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.801171    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-tmp-dir\") pod \"distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") " pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:25.805290 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.801237    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-home\") pod \"distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") " pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:25.805290 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.801459    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-model-cache\") pod \"distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") " pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:25.809238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.808002    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-dshm\") pod \"distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") " pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:25.821293 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.820845    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b055e70-1c04-48f7-a96e-68ac94b0b283-tls-certs\") pod \"distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") " pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:25.828236 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.821475    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhkwq\" (UniqueName: \"kubernetes.io/projected/6b055e70-1c04-48f7-a96e-68ac94b0b283-kube-api-access-hhkwq\") pod \"distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") " pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:25.972243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:25.971854    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:26.269259 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:26.264792    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"]
Nov 02 22:11:26.269259 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:11:26.265528    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b055e70_1c04_48f7_a96e_68ac94b0b283.slice/crio-794b3bcf61d0747695ea61b74b1344c05332d4b83345c94d87f4b97c3640e746 WatchSource:0}: Error finding container 794b3bcf61d0747695ea61b74b1344c05332d4b83345c94d87f4b97c3640e746: Status 404 returned error can't find the container with id 794b3bcf61d0747695ea61b74b1344c05332d4b83345c94d87f4b97c3640e746
Nov 02 22:11:26.385710 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:26.385674    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:27.126265 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:27.122018    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" event={"ID":"6b055e70-1c04-48f7-a96e-68ac94b0b283","Type":"ContainerStarted","Data":"58f9c23fb9d4c2ff125d2dd72d5c97766c1e690489e1ce8cd8dc63d8b60d7400"}
Nov 02 22:11:27.126265 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:27.122076    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" event={"ID":"6b055e70-1c04-48f7-a96e-68ac94b0b283","Type":"ContainerStarted","Data":"794b3bcf61d0747695ea61b74b1344c05332d4b83345c94d87f4b97c3640e746"}
Nov 02 22:11:27.980241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:27.974310    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:28.180272 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:28.178655    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:28.453244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:28.449238    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:28.599724 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:28.599340    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:11:28.599724 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:28.599422    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4" podUID="529b113f-33b4-437c-80e2-6ce54f2ad4be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:28.645437 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:28.644437    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:28.742291 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:28.741211    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:28.922861 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:28.922811    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:28.945076 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:28.944515    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:29.210240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.210146    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podStartSLOduration=4.210120238 podStartE2EDuration="4.210120238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:11:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:11:27.157858528 +0000 UTC m=+796.214192935" watchObservedRunningTime="2026-11-02 22:11:29.210120238 +0000 UTC m=+798.266454629"
Nov 02 22:11:29.216264 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.213389    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"]
Nov 02 22:11:29.251243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.247995    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"]
Nov 02 22:11:29.251243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.248122    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.330907 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.328635    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-workload-socket\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.330907 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.328790    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-envoy\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.330907 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.328898    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-token\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.330907 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.329033    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c282ee8-f3d0-4043-b798-cebd43900b30-istiod-ca-cert\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.330907 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.329080    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzdth\" (UniqueName: \"kubernetes.io/projected/8c282ee8-f3d0-4043-b798-cebd43900b30-kube-api-access-tzdth\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.330907 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.329131    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-workload-certs\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.330907 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.329156    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-podinfo\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.330907 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.329187    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-credential-socket\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.330907 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.329302    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-data\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.430334 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.430293    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c282ee8-f3d0-4043-b798-cebd43900b30-istiod-ca-cert\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.430334 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.430328    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzdth\" (UniqueName: \"kubernetes.io/projected/8c282ee8-f3d0-4043-b798-cebd43900b30-kube-api-access-tzdth\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.430610 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.430355    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-workload-certs\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.430610 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.430467    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-podinfo\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.430610 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.430503    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-credential-socket\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.430610 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.430579    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-data\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.430817 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.430620    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-workload-socket\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.430817 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.430680    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-envoy\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.430817 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.430783    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-token\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.431087 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.431060    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-workload-certs\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.431161 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.431123    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c282ee8-f3d0-4043-b798-cebd43900b30-istiod-ca-cert\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.431306 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.431278    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-data\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.431417 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.431310    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-credential-socket\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.431417 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.431356    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-workload-socket\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.433183 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.433162    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-envoy\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.433828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.433806    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-podinfo\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.438156 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.438128    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzdth\" (UniqueName: \"kubernetes.io/projected/8c282ee8-f3d0-4043-b798-cebd43900b30-kube-api-access-tzdth\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.438531 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.438512    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-token\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.581655 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.581571    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:29.600478 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.600442    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:29.887564 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.887534    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"]
Nov 02 22:11:29.889749 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:11:29.889703    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c282ee8_f3d0_4043_b798_cebd43900b30.slice/crio-ae6c3b6acc8ce8e0fb72e2d74e66835e38606945a47d62af79a6d59f03c4b075 WatchSource:0}: Error finding container ae6c3b6acc8ce8e0fb72e2d74e66835e38606945a47d62af79a6d59f03c4b075: Status 404 returned error can't find the container with id ae6c3b6acc8ce8e0fb72e2d74e66835e38606945a47d62af79a6d59f03c4b075
Nov 02 22:11:29.893931 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.893887    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:29.894034 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.893982    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:29.894034 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:29.894028    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:29.906752 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:11:29.906714    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:11:30.201884 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:30.201800    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb" event={"ID":"8c282ee8-f3d0-4043-b798-cebd43900b30","Type":"ContainerStarted","Data":"fc3ae2b5fc6c5f1cde936a8b0d14aa5498bf245b2e1912b64077f6f1d2d76f4f"}
Nov 02 22:11:30.202096 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:30.202072    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb" event={"ID":"8c282ee8-f3d0-4043-b798-cebd43900b30","Type":"ContainerStarted","Data":"ae6c3b6acc8ce8e0fb72e2d74e66835e38606945a47d62af79a6d59f03c4b075"}
Nov 02 22:11:30.221105 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:30.221048    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb" podStartSLOduration=1.221030803 podStartE2EDuration="1.221030803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:11:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:11:30.219567812 +0000 UTC m=+799.275902204" watchObservedRunningTime="2026-11-02 22:11:30.221030803 +0000 UTC m=+799.277365184"
Nov 02 22:11:30.303680 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:30.303642    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:30.589951 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:30.589856    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:30.593702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:30.593342    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Nov 02 22:11:30.593702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:30.593401    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb" podUID="8c282ee8-f3d0-4043-b798-cebd43900b30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Nov 02 22:11:31.108404 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:31.108321    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:31.582519 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:31.582433    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Nov 02 22:11:31.583498 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:31.583465    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb" podUID="8c282ee8-f3d0-4043-b798-cebd43900b30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Nov 02 22:11:31.896459 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:31.896418    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:32.592242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:32.591607    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Nov 02 22:11:32.592242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:32.591671    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb" podUID="8c282ee8-f3d0-4043-b798-cebd43900b30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Nov 02 22:11:32.690244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:32.688271    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:33.490242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:33.489890    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:33.595243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:33.590323    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:33.595243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:33.590870    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Nov 02 22:11:33.595243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:33.590919    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb" podUID="8c282ee8-f3d0-4043-b798-cebd43900b30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Nov 02 22:11:34.202753 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:34.202718    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:34.584765 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:34.584677    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Nov 02 22:11:34.585018 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:34.584988    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb" podUID="8c282ee8-f3d0-4043-b798-cebd43900b30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Nov 02 22:11:34.995685 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:34.995610    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:35.591245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:35.588512    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Nov 02 22:11:35.591245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:35.588570    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb" podUID="8c282ee8-f3d0-4043-b798-cebd43900b30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Nov 02 22:11:35.795248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:35.793011    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:35.972935 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:35.972891    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:35.987113 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:35.987074    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:36.271942 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:36.271854    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:11:36.486702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:36.486659    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:36.582876 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:36.582765    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Nov 02 22:11:36.582876 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:36.582827    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb" podUID="8c282ee8-f3d0-4043-b798-cebd43900b30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Nov 02 22:11:37.198804 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:37.198769    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:37.587468 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:37.587388    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:37.587928 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:37.587908    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:37.588651 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:37.588624    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:11:38.251239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:38.251185    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:39.406962 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:39.406928    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:40.178809 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:40.178768    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:40.800710 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:40.800671    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:41.476889 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:41.476849    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:42.388128 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:42.388072    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:42.791728 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:42.791656    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:43.185942 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:43.185908    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:43.786889 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:43.786845    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:44.309124 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.309085    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"]
Nov 02 22:11:44.314622 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.314599    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.328232 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.328195    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"]
Nov 02 22:11:44.381504 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.381468    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"]
Nov 02 22:11:44.386455 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.386387    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.398704 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.398679    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"]
Nov 02 22:11:44.409251 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.409209    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-workload-socket\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.409389 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.409298    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istiod-ca-cert\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.409441 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.409411    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-envoy\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.409441 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.409432    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjhnp\" (UniqueName: \"kubernetes.io/projected/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-kube-api-access-jjhnp\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.409536 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.409470    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-credential-socket\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.409624 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.409612    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-token\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.409673 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.409640    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-data\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.409768 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.409745    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-podinfo\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.409899 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.409881    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-workload-certs\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.479812 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.479771    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"]
Nov 02 22:11:44.485485 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.485457    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.505048 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.505005    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"]
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.511267    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-envoy\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.511337    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjhnp\" (UniqueName: \"kubernetes.io/projected/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-kube-api-access-jjhnp\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.511420    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-credential-socket\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.511456    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-workload-socket\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.511511    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-envoy\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.511593    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-data\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.511644    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-token\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.511669    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-workload-certs\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.511723    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xch59\" (UniqueName: \"kubernetes.io/projected/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-kube-api-access-xch59\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.511751    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-data\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.511797    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-podinfo\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.511849    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-token\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.511895    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-podinfo\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.511991    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-workload-certs\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.512590    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-credential-socket\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.512636    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-credential-socket\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.512656    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-workload-certs\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.512744    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-workload-socket\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.512774    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istiod-ca-cert\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.512807    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istiod-ca-cert\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.512961    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-data\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.513294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.513065    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-workload-socket\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.514630 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.513602    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istiod-ca-cert\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.516171 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.516145    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-podinfo\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.516906 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.516886    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-envoy\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.526372 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.526352    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjhnp\" (UniqueName: \"kubernetes.io/projected/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-kube-api-access-jjhnp\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.526518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.526416    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-token\") pod \"e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") " pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.586270 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.586173    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:44.613732 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.613702    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-credential-socket\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.613732 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.613739    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-workload-certs\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.613991 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.613763    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-data\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.613991 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.613946    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istiod-ca-cert\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.614101 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.614053    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-podinfo\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.614164 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.614127    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-workload-socket\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.614164 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.614132    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-credential-socket\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.614164 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.614159    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-envoy\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.614341 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.614248    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-data\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.614341 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.614293    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-workload-certs\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.614341 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.614328    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xch59\" (UniqueName: \"kubernetes.io/projected/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-kube-api-access-xch59\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.614491 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.614358    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-envoy\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.614491 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.614415    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-token\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.614491 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.614436    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-workload-socket\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.614491 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.614443    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-podinfo\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.614491 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.614474    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-token\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.614753 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.614515    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-workload-socket\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.614753 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.614534    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvwh2\" (UniqueName: \"kubernetes.io/projected/8221cfb2-2c27-4949-9b2d-1f48aef1c671-kube-api-access-xvwh2\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.614753 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.614569    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-credential-socket\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.614753 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.614592    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istiod-ca-cert\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.614969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.614800    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-data\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.614969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.614831    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istiod-ca-cert\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.615156 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.615138    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-workload-certs\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.617010 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.616984    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-podinfo\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.617110 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.617091    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-envoy\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.622597 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.622578    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-token\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.622929 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.622909    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xch59\" (UniqueName: \"kubernetes.io/projected/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-kube-api-access-xch59\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.633757 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.633738    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:44.705908 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.705866    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:44.716922 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.716890    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-workload-certs\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.717052 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.716928    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-data\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.717117 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.717049    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-podinfo\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.717175 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.717149    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-envoy\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.717275 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.717209    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-token\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.717275 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.717256    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-workload-socket\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.717392 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.717278    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvwh2\" (UniqueName: \"kubernetes.io/projected/8221cfb2-2c27-4949-9b2d-1f48aef1c671-kube-api-access-xvwh2\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.717392 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.717323    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-credential-socket\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.717392 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.717334    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-workload-certs\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.717392 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.717349    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istiod-ca-cert\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.718857 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.717943    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istiod-ca-cert\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.718857 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.717943    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-data\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.718857 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.718206    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-workload-socket\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.718857 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.718675    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-credential-socket\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.721079 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.721054    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-podinfo\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.725807 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.724452    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-envoy\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.730787 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.730741    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvwh2\" (UniqueName: \"kubernetes.io/projected/8221cfb2-2c27-4949-9b2d-1f48aef1c671-kube-api-access-xvwh2\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.743653 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.743605    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-token\") pod \"e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") " pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.816054 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.815788    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:44.949246 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.949206    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"]
Nov 02 22:11:44.950937 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:11:44.950910    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4b4d0f_bfd1_48f0_ab40_0c3304cb01aa.slice/crio-7a837837b4402e3b782e687e3409c0b3492fe178bdce7d7d64e670512b3f50d0 WatchSource:0}: Error finding container 7a837837b4402e3b782e687e3409c0b3492fe178bdce7d7d64e670512b3f50d0: Status 404 returned error can't find the container with id 7a837837b4402e3b782e687e3409c0b3492fe178bdce7d7d64e670512b3f50d0
Nov 02 22:11:44.953994 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.953947    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:44.954115 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.954039    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:44.954115 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:44.954075    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:45.026803 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.026649    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"]
Nov 02 22:11:45.029287 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:11:45.029205    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4a7334_30f4_4b93_ac4d_edfda88cf5d6.slice/crio-a31056000dc9032892b1d959966e1824763fa671fa4617cecf02e8f7f185cd86 WatchSource:0}: Error finding container a31056000dc9032892b1d959966e1824763fa671fa4617cecf02e8f7f185cd86: Status 404 returned error can't find the container with id a31056000dc9032892b1d959966e1824763fa671fa4617cecf02e8f7f185cd86
Nov 02 22:11:45.032291 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.032251    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:45.032493 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.032459    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:45.032493 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.032526    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:45.063643 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.063611    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:45.116303 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.115319    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"]
Nov 02 22:11:45.119599 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:11:45.119574    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8221cfb2_2c27_4949_9b2d_1f48aef1c671.slice/crio-43b45826cfece5fff1be565b374cb74ca0e0f031b4e272a6f43a9032f3c415e1 WatchSource:0}: Error finding container 43b45826cfece5fff1be565b374cb74ca0e0f031b4e272a6f43a9032f3c415e1: Status 404 returned error can't find the container with id 43b45826cfece5fff1be565b374cb74ca0e0f031b4e272a6f43a9032f3c415e1
Nov 02 22:11:45.123835 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.123792    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:45.123934 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.123899    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:45.124000 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.123972    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:11:45.384606 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.381388    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9" event={"ID":"8221cfb2-2c27-4949-9b2d-1f48aef1c671","Type":"ContainerStarted","Data":"0babf08727b81862915bfc4639a7e03c61f5b56057982cb9e94d8e087396e93a"}
Nov 02 22:11:45.384606 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.381448    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9" event={"ID":"8221cfb2-2c27-4949-9b2d-1f48aef1c671","Type":"ContainerStarted","Data":"43b45826cfece5fff1be565b374cb74ca0e0f031b4e272a6f43a9032f3c415e1"}
Nov 02 22:11:45.409620 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.409476    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9" podStartSLOduration=1.409458141 podStartE2EDuration="1.409458141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:11:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:11:45.408799987 +0000 UTC m=+814.465134367" watchObservedRunningTime="2026-11-02 22:11:45.409458141 +0000 UTC m=+814.465792522"
Nov 02 22:11:45.419323 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.419277    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr" event={"ID":"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6","Type":"ContainerStarted","Data":"c5025acd6ff46fbd12f082888c0f0ba67af20ccb79c706957892b69330a4f40f"}
Nov 02 22:11:45.419509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.419342    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr" event={"ID":"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6","Type":"ContainerStarted","Data":"a31056000dc9032892b1d959966e1824763fa671fa4617cecf02e8f7f185cd86"}
Nov 02 22:11:45.422198 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.422170    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks" event={"ID":"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa","Type":"ContainerStarted","Data":"7f0787fd47f984715c9ac6b8412f2072288b54425463d8d816ea844a1d751359"}
Nov 02 22:11:45.423110 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.423092    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks" event={"ID":"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa","Type":"ContainerStarted","Data":"7a837837b4402e3b782e687e3409c0b3492fe178bdce7d7d64e670512b3f50d0"}
Nov 02 22:11:45.437826 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.437784    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr" podStartSLOduration=1.437771573 podStartE2EDuration="1.437771573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:11:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:11:45.43775931 +0000 UTC m=+814.494093691" watchObservedRunningTime="2026-11-02 22:11:45.437771573 +0000 UTC m=+814.494105952"
Nov 02 22:11:45.573641 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.573601    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:45.634441 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.634283    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:45.706343 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.706250    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:45.815922 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:45.815885    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:46.437241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:46.433933    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:46.642241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:46.641324    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Nov 02 22:11:46.642241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:46.641390    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks" podUID="be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Nov 02 22:11:46.709102 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:46.709005    5076 patch_prober.go:29] interesting pod/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Nov 02 22:11:46.709374 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:46.709342    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr" podUID="5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Nov 02 22:11:46.826415 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:46.826375    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Nov 02 22:11:46.826694 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:46.826665    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9" podUID="8221cfb2-2c27-4949-9b2d-1f48aef1c671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Nov 02 22:11:47.021307 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:47.017582    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:47.636704 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:47.636670    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Nov 02 22:11:47.637350 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:47.637307    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks" podUID="be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Nov 02 22:11:47.715248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:47.712567    5076 patch_prober.go:29] interesting pod/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Nov 02 22:11:47.715248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:47.712625    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr" podUID="5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Nov 02 22:11:47.819243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:47.816712    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Nov 02 22:11:47.819243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:47.816792    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9" podUID="8221cfb2-2c27-4949-9b2d-1f48aef1c671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Nov 02 22:11:47.978821 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:47.978703    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:48.639237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:48.634701    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Nov 02 22:11:48.639237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:48.634763    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks" podUID="be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Nov 02 22:11:48.718247 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:48.706963    5076 patch_prober.go:29] interesting pod/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Nov 02 22:11:48.718247 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:48.707023    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr" podUID="5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Nov 02 22:11:48.832240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:48.822628    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Nov 02 22:11:48.832240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:48.822690    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9" podUID="8221cfb2-2c27-4949-9b2d-1f48aef1c671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Nov 02 22:11:49.162518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:49.162483    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:49.637805 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:49.637767    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Nov 02 22:11:49.638122 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:49.638086    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks" podUID="be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Nov 02 22:11:49.714242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:49.713646    5076 patch_prober.go:29] interesting pod/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Nov 02 22:11:49.714242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:49.713714    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr" podUID="5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Nov 02 22:11:49.819242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:49.818708    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Nov 02 22:11:49.819242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:49.818784    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9" podUID="8221cfb2-2c27-4949-9b2d-1f48aef1c671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Nov 02 22:11:50.342048 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:50.342012    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:50.636688 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:50.636648    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Nov 02 22:11:50.636980 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:50.636949    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks" podUID="be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Nov 02 22:11:50.709649 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:50.709612    5076 patch_prober.go:29] interesting pod/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Nov 02 22:11:50.709926 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:50.709897    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr" podUID="5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Nov 02 22:11:50.822657 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:50.822623    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Nov 02 22:11:50.823279 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:50.823245    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9" podUID="8221cfb2-2c27-4949-9b2d-1f48aef1c671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Nov 02 22:11:51.440141 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:51.440103    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:51.635596 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:51.635560    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Nov 02 22:11:51.635840 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:51.635810    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks" podUID="be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Nov 02 22:11:51.707652 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:51.707570    5076 patch_prober.go:29] interesting pod/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Nov 02 22:11:51.707898 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:51.707870    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr" podUID="5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Nov 02 22:11:51.817517 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:51.817480    5076 patch_prober.go:29] interesting pod/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Nov 02 22:11:51.817807 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:51.817780    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9" podUID="8221cfb2-2c27-4949-9b2d-1f48aef1c671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Nov 02 22:11:52.508797 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:52.508744    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:52.646552 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:52.645558    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Nov 02 22:11:52.646552 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:52.645621    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks" podUID="be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Nov 02 22:11:52.709061 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:52.708616    5076 patch_prober.go:29] interesting pod/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Nov 02 22:11:52.709061 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:52.708676    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr" podUID="5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Nov 02 22:11:53.462481 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:53.457937    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:53.464909 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:53.464887    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:53.466891 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:53.466868    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:11:53.630241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:53.626880    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks" podStartSLOduration=9.62685767 podStartE2EDuration="9.62685767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:11:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:11:45.457316235 +0000 UTC m=+814.513650617" watchObservedRunningTime="2026-11-02 22:11:53.62685767 +0000 UTC m=+822.683192052"
Nov 02 22:11:53.779999 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:53.760768    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:53.782130 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:53.781958    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:53.783290 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:53.783240    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:11:54.234264 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:54.233619    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:54.240240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:54.236174    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:54.247240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:54.244743    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:11:54.818377 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:54.818342    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:55.725504 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:55.725446    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:11:56.281238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:56.277786    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:56.963450 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:56.963415    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:57.684090 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:57.684056    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:58.490333 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:58.490302    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:59.186200 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.186168    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:11:59.581413 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.581329    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"]
Nov 02 22:11:59.585624 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.585603    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.594323 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.594296    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-credential-socket\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.594533 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.594507    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-workload-socket\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.594666 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.594552    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-istio-envoy\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.594666 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.594657    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/057d031c-18be-4ccf-b126-4a67835d3a56-istio-podinfo\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.594774 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.594688    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggfdc\" (UniqueName: \"kubernetes.io/projected/057d031c-18be-4ccf-b126-4a67835d3a56-kube-api-access-ggfdc\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.594774 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.594749    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-workload-certs\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.594930 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.594781    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-istio-data\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.594930 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.594817    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/057d031c-18be-4ccf-b126-4a67835d3a56-istiod-ca-cert\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.594930 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.594854    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/057d031c-18be-4ccf-b126-4a67835d3a56-istio-token\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.601146 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.601120    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"]
Nov 02 22:11:59.634954 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.634925    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"]
Nov 02 22:11:59.638900 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.638880    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.651989 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.651965    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"]
Nov 02 22:11:59.695979 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.695948    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-credential-socket\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.695979 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.695984    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75affa76-6588-4026-bb96-573b65ea5ce8-istiod-ca-cert\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.696209 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.696111    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-credential-socket\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.696209 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.696195    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-workload-socket\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.696362 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.696273    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-istio-data\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.696362 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.696308    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-istio-envoy\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.696485 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.696413    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z68pp\" (UniqueName: \"kubernetes.io/projected/75affa76-6588-4026-bb96-573b65ea5ce8-kube-api-access-z68pp\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.696485 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.696451    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/057d031c-18be-4ccf-b126-4a67835d3a56-istio-podinfo\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.696591 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.696485    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggfdc\" (UniqueName: \"kubernetes.io/projected/057d031c-18be-4ccf-b126-4a67835d3a56-kube-api-access-ggfdc\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.696591 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.696487    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-credential-socket\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.696591 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.696548    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75affa76-6588-4026-bb96-573b65ea5ce8-istio-podinfo\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.696591 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.696579    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-workload-certs\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.696786 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.696604    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-istio-data\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.696786 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.696635    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-istio-envoy\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.696786 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.696653    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/057d031c-18be-4ccf-b126-4a67835d3a56-istiod-ca-cert\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.696786 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.696677    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/057d031c-18be-4ccf-b126-4a67835d3a56-istio-token\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.696786 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.696701    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75affa76-6588-4026-bb96-573b65ea5ce8-istio-token\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.696786 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.696725    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-workload-certs\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.696786 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.696750    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-workload-socket\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.697125 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.697076    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-workload-certs\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.697125 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.697076    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-workload-socket\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.697697 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.697668    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/057d031c-18be-4ccf-b126-4a67835d3a56-istiod-ca-cert\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.698113 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.698082    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-istio-data\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.699811 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.699777    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-istio-envoy\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.700691 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.700672    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/057d031c-18be-4ccf-b126-4a67835d3a56-istio-podinfo\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.707586 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.707568    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggfdc\" (UniqueName: \"kubernetes.io/projected/057d031c-18be-4ccf-b126-4a67835d3a56-kube-api-access-ggfdc\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.709258 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.709239    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/057d031c-18be-4ccf-b126-4a67835d3a56-istio-token\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.797627 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.797600    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-credential-socket\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.797781 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.797648    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75affa76-6588-4026-bb96-573b65ea5ce8-istiod-ca-cert\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.797781 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.797708    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-istio-data\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.797885 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.797808    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z68pp\" (UniqueName: \"kubernetes.io/projected/75affa76-6588-4026-bb96-573b65ea5ce8-kube-api-access-z68pp\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.797885 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.797877    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75affa76-6588-4026-bb96-573b65ea5ce8-istio-podinfo\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.797988 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.797934    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-istio-envoy\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.798038 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.797982    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75affa76-6588-4026-bb96-573b65ea5ce8-istio-token\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.798038 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.798013    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-workload-certs\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.798131 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.798029    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-credential-socket\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.798131 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.798051    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-workload-socket\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.798319 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.798124    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-istio-data\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.798473 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.798450    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75affa76-6588-4026-bb96-573b65ea5ce8-istiod-ca-cert\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.798550 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.798468    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-workload-certs\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.798550 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.798511    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-workload-socket\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.800228 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.800182    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-istio-envoy\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.800655 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.800633    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75affa76-6588-4026-bb96-573b65ea5ce8-istio-podinfo\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.807699 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.807675    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z68pp\" (UniqueName: \"kubernetes.io/projected/75affa76-6588-4026-bb96-573b65ea5ce8-kube-api-access-z68pp\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.811637 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.811616    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75affa76-6588-4026-bb96-573b65ea5ce8-istio-token\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.892911 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:11:59.892877    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:11:59.904898 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.904877    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:11:59.991636 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.960847    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:11:59.991636 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.974192    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"]
Nov 02 22:11:59.991636 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.978986    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:11:59.991636 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.984385    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Nov 02 22:11:59.991636 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.985014    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Nov 02 22:11:59.991636 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.985100    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kzcn8\""
Nov 02 22:11:59.991636 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.985143    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Nov 02 22:11:59.991636 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:11:59.985317    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"]
Nov 02 22:12:00.003661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.000113    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60f5227d-b77d-4544-8c7f-422667ffca6c-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.003661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.000157    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/60f5227d-b77d-4544-8c7f-422667ffca6c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.003661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.000311    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd672\" (UniqueName: \"kubernetes.io/projected/60f5227d-b77d-4544-8c7f-422667ffca6c-kube-api-access-vd672\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.003661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.000380    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/60f5227d-b77d-4544-8c7f-422667ffca6c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.003661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.000451    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/60f5227d-b77d-4544-8c7f-422667ffca6c-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.003661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.000498    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/60f5227d-b77d-4544-8c7f-422667ffca6c-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.003661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.000647    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/60f5227d-b77d-4544-8c7f-422667ffca6c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.021136 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.020014    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:00.101808 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.101701    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/60f5227d-b77d-4544-8c7f-422667ffca6c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.101980 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.101839    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60f5227d-b77d-4544-8c7f-422667ffca6c-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.101980 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.101871    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/60f5227d-b77d-4544-8c7f-422667ffca6c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.101980 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.101915    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd672\" (UniqueName: \"kubernetes.io/projected/60f5227d-b77d-4544-8c7f-422667ffca6c-kube-api-access-vd672\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.101980 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.101975    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/60f5227d-b77d-4544-8c7f-422667ffca6c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.102582 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.102043    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/60f5227d-b77d-4544-8c7f-422667ffca6c-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.102582 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.102088    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/60f5227d-b77d-4544-8c7f-422667ffca6c-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.103067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.103040    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/60f5227d-b77d-4544-8c7f-422667ffca6c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.105349 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.104971    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/60f5227d-b77d-4544-8c7f-422667ffca6c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.105866 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.105817    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/60f5227d-b77d-4544-8c7f-422667ffca6c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.106154 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.106125    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/60f5227d-b77d-4544-8c7f-422667ffca6c-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.106396 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.106374    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/60f5227d-b77d-4544-8c7f-422667ffca6c-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.115002 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.114973    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60f5227d-b77d-4544-8c7f-422667ffca6c-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.119113 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.119089    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd672\" (UniqueName: \"kubernetes.io/projected/60f5227d-b77d-4544-8c7f-422667ffca6c-kube-api-access-vd672\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4vqfq\" (UID: \"60f5227d-b77d-4544-8c7f-422667ffca6c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.186937 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.186821    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:00.201135 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.200935    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"]
Nov 02 22:12:00.203973 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:12:00.203945    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod057d031c_18be_4ccf_b126_4a67835d3a56.slice/crio-cecbb677ab4e96d5a33b4b8b6a31acfdac1aaa0d407fed3c7e55ef671e4a83a7 WatchSource:0}: Error finding container cecbb677ab4e96d5a33b4b8b6a31acfdac1aaa0d407fed3c7e55ef671e4a83a7: Status 404 returned error can't find the container with id cecbb677ab4e96d5a33b4b8b6a31acfdac1aaa0d407fed3c7e55ef671e4a83a7
Nov 02 22:12:00.206413 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.206382    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:12:00.206490 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.206447    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:12:00.206490 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.206475    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:12:00.268497 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.268465    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"]
Nov 02 22:12:00.274733 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:12:00.274704    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75affa76_6588_4026_bb96_573b65ea5ce8.slice/crio-5ff4c9e93522e79d4a521e8c52f712fe7576611ed6312236e5939e784ac2efaf WatchSource:0}: Error finding container 5ff4c9e93522e79d4a521e8c52f712fe7576611ed6312236e5939e784ac2efaf: Status 404 returned error can't find the container with id 5ff4c9e93522e79d4a521e8c52f712fe7576611ed6312236e5939e784ac2efaf
Nov 02 22:12:00.278341 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.278298    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:12:00.278459 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.278402    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:12:00.278459 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.278451    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:12:00.315674 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.315381    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:00.738386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.735102    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"]
Nov 02 22:12:00.738386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.738004    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm" event={"ID":"75affa76-6588-4026-bb96-573b65ea5ce8","Type":"ContainerStarted","Data":"8d284727a202005e6f028dfa8e34578f517a379f4a80204199ea9ee48d5ddc7e"}
Nov 02 22:12:00.738386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.738062    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm" event={"ID":"75affa76-6588-4026-bb96-573b65ea5ce8","Type":"ContainerStarted","Data":"5ff4c9e93522e79d4a521e8c52f712fe7576611ed6312236e5939e784ac2efaf"}
Nov 02 22:12:00.740822 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:12:00.740603    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60f5227d_b77d_4544_8c7f_422667ffca6c.slice/crio-287f363fc4b14b87c283dd9827a73855589f96ac93076edf9ce3496f903d8fc4 WatchSource:0}: Error finding container 287f363fc4b14b87c283dd9827a73855589f96ac93076edf9ce3496f903d8fc4: Status 404 returned error can't find the container with id 287f363fc4b14b87c283dd9827a73855589f96ac93076edf9ce3496f903d8fc4
Nov 02 22:12:00.745514 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.745427    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf" event={"ID":"057d031c-18be-4ccf-b126-4a67835d3a56","Type":"ContainerStarted","Data":"39a6f222032d3d5649e98ab5214a30439bf8824ce9a6986386c08a37e2bf8649"}
Nov 02 22:12:00.746532 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.745679    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf" event={"ID":"057d031c-18be-4ccf-b126-4a67835d3a56","Type":"ContainerStarted","Data":"cecbb677ab4e96d5a33b4b8b6a31acfdac1aaa0d407fed3c7e55ef671e4a83a7"}
Nov 02 22:12:00.764541 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.764493    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm" podStartSLOduration=1.764476361 podStartE2EDuration="1.764476361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:11:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:12:00.760310316 +0000 UTC m=+829.816644694" watchObservedRunningTime="2026-11-02 22:12:00.764476361 +0000 UTC m=+829.820810741"
Nov 02 22:12:00.780012 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.779969    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf" podStartSLOduration=1.779952496 podStartE2EDuration="1.779952496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:11:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:12:00.778301177 +0000 UTC m=+829.834635558" watchObservedRunningTime="2026-11-02 22:12:00.779952496 +0000 UTC m=+829.836286877"
Nov 02 22:12:00.905942 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.905909    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:12:00.961776 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.961742    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:12:00.989274 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:00.989144    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:01.753255 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:01.753186    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq" event={"ID":"60f5227d-b77d-4544-8c7f-422667ffca6c","Type":"ContainerStarted","Data":"287f363fc4b14b87c283dd9827a73855589f96ac93076edf9ce3496f903d8fc4"}
Nov 02 22:12:01.925567 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:01.925376    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Nov 02 22:12:01.925567 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:01.925439    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf" podUID="057d031c-18be-4ccf-b126-4a67835d3a56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Nov 02 22:12:01.953225 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:01.953169    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:01.962972 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:01.962948    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Nov 02 22:12:01.963095 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:01.962998    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm" podUID="75affa76-6588-4026-bb96-573b65ea5ce8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Nov 02 22:12:02.815242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:02.814303    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:02.910243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:02.906747    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Nov 02 22:12:02.910243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:02.906812    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf" podUID="057d031c-18be-4ccf-b126-4a67835d3a56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Nov 02 22:12:02.962360 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:02.962327    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Nov 02 22:12:02.962529 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:02.962376    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm" podUID="75affa76-6588-4026-bb96-573b65ea5ce8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Nov 02 22:12:03.852691 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:03.852660    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:03.906015 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:03.905585    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Nov 02 22:12:03.906015 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:03.905649    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf" podUID="057d031c-18be-4ccf-b126-4a67835d3a56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Nov 02 22:12:03.963715 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:03.963679    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Nov 02 22:12:03.963885 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:03.963750    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm" podUID="75affa76-6588-4026-bb96-573b65ea5ce8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Nov 02 22:12:04.917261 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:04.916907    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Nov 02 22:12:04.917261 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:04.917013    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf" podUID="057d031c-18be-4ccf-b126-4a67835d3a56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Nov 02 22:12:04.962154 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:04.962059    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Nov 02 22:12:04.962154 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:04.962113    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm" podUID="75affa76-6588-4026-bb96-573b65ea5ce8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Nov 02 22:12:05.136162 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:05.136126    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:05.923311 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:05.920604    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Nov 02 22:12:05.923311 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:05.920677    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf" podUID="057d031c-18be-4ccf-b126-4a67835d3a56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Nov 02 22:12:05.961932 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:05.961897    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Nov 02 22:12:05.962097 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:05.961947    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm" podUID="75affa76-6588-4026-bb96-573b65ea5ce8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Nov 02 22:12:06.094254 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:06.092852    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:06.901148 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:06.901093    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:06.906694 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:06.906662    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Nov 02 22:12:06.906905 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:06.906722    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf" podUID="057d031c-18be-4ccf-b126-4a67835d3a56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Nov 02 22:12:06.961643 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:06.961602    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Nov 02 22:12:06.962063 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:06.961668    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm" podUID="75affa76-6588-4026-bb96-573b65ea5ce8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Nov 02 22:12:07.340439 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:07.340401    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:12:07.340588 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:07.340481    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:12:07.681586 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:07.681546    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:07.942289 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:07.937731    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq" event={"ID":"60f5227d-b77d-4544-8c7f-422667ffca6c","Type":"ContainerStarted","Data":"02059ecfd6d0199367a803291ffe021c0317d622c53bcfc1920feb060602896c"}
Nov 02 22:12:07.942289 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:07.938858    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:07.988615 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:07.981529    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq" podStartSLOduration=2.387788776 podStartE2EDuration="8.981509111s" totalImagesPullingTime="6.593720335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:12:07.972297027 +0000 UTC m=+837.028631408" watchObservedRunningTime="2026-11-02 22:12:07.981509111 +0000 UTC m=+837.037843491"
Nov 02 22:12:08.477773 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:08.477741    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:12:08.478667 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:08.478645    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:12:08.479446 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:08.479425    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:12:08.524575 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:08.524546    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:12:08.526310 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:08.526287    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:12:08.528722 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:08.528703    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:12:08.805794 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:08.804604    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:08.946354 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:08.946329    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4vqfq"
Nov 02 22:12:09.622496 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:09.622462    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:10.291723 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:10.291690    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:11.029323 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:11.029286    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:11.795562 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:11.795525    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:12.594319 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:12.594284    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:13.291685 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:13.291650    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:13.965605 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:13.965573    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:14.656278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.656241    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"]
Nov 02 22:12:14.661663 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.661638    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.673993 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.673966    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"]
Nov 02 22:12:14.798620 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.798567    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-envoy\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.798806 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.798719    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-data\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.798877 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.798835    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-workload-socket\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.798937 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.798887    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-podinfo\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.799081 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.799052    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-credential-socket\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.799145 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.799129    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-workload-certs\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.799181 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.799163    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcp42\" (UniqueName: \"kubernetes.io/projected/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-kube-api-access-zcp42\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.799212 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.799195    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-token\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.799360 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.799341    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istiod-ca-cert\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.804012 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.803979    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:14.900305 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.900261    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-credential-socket\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.900470 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.900350    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-workload-certs\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.900470 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.900380    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcp42\" (UniqueName: \"kubernetes.io/projected/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-kube-api-access-zcp42\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.900470 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.900415    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-token\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.900634 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.900542    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istiod-ca-cert\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.900634 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.900608    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-envoy\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.900738 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.900627    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-credential-socket\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.900738 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.900708    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-data\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.900850 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.900763    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-workload-socket\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.900850 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.900707    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-workload-certs\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.900850 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.900801    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-podinfo\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.901012 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.900950    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-data\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.901073 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.901023    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-workload-socket\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.901276 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.901253    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istiod-ca-cert\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.903381 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.903362    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-podinfo\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.903479 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.903405    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-envoy\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.908168 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.908084    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcp42\" (UniqueName: \"kubernetes.io/projected/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-kube-api-access-zcp42\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.908168 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.908093    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-token\") pod \"e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") " pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:14.978901 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:14.978864    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:15.287088 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:15.287053    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"]
Nov 02 22:12:15.287840 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:12:15.287801    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee3dbee5_3c45_4cc0_8540_ae039e7ebdbc.slice/crio-7186acd7a7f2c150fdf211232e4b8bcb6a07634ec140cda522567464c4d6cb43 WatchSource:0}: Error finding container 7186acd7a7f2c150fdf211232e4b8bcb6a07634ec140cda522567464c4d6cb43: Status 404 returned error can't find the container with id 7186acd7a7f2c150fdf211232e4b8bcb6a07634ec140cda522567464c4d6cb43
Nov 02 22:12:15.290550 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:15.290501    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:12:15.290673 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:15.290578    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:12:15.290673 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:15.290607    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:12:15.621436 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:15.621388    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:16.000472 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:16.000379    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w" event={"ID":"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc","Type":"ContainerStarted","Data":"d45f38988796d32f5b4448702eef681140286f4a8b753a759e8a55a0a079c22a"}
Nov 02 22:12:16.000472 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:16.000447    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w" event={"ID":"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc","Type":"ContainerStarted","Data":"7186acd7a7f2c150fdf211232e4b8bcb6a07634ec140cda522567464c4d6cb43"}
Nov 02 22:12:16.022637 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:16.022596    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w" podStartSLOduration=2.022583545 podStartE2EDuration="2.022583545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:12:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:12:16.021376081 +0000 UTC m=+845.077710475" watchObservedRunningTime="2026-11-02 22:12:16.022583545 +0000 UTC m=+845.078917925"
Nov 02 22:12:16.462035 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:16.462002    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:16.991244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:16.990428    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:16.991244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:16.990584    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 02 22:12:16.991244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:16.990635    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w" podUID="ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 02 22:12:17.265926 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:17.265828    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:17.981615 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:17.981577    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 02 22:12:17.981905 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:17.981869    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w" podUID="ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 02 22:12:18.053856 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:18.053821    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:18.993238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:18.980590    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 02 22:12:18.993238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:18.980687    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w" podUID="ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 02 22:12:19.005118 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:19.005084    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:19.933421 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:19.933383    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:19.979717 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:19.979677    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 02 22:12:19.980004 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:19.979961    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w" podUID="ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 02 22:12:20.980610 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:20.980032    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:20.980610 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:20.980151    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 02 22:12:20.980610 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:20.980206    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w" podUID="ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 02 22:12:21.984476 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:21.983969    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 02 22:12:21.984476 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:21.984029    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w" podUID="ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 02 22:12:22.352428 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:22.332268    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:23.645866 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:23.645811    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": context deadline exceeded"
Nov 02 22:12:23.873377 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:23.873324    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:23.887603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:23.887559    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:23.931296 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:23.911194    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:24.034403 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:24.034365    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:12:24.034694 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:24.034660    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w" podUID="ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:24.122242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:24.121305    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Nov 02 22:12:24.505636 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:24.505601    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:24.507337 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:24.507315    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:24.523581 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:24.523557    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:12:24.571424 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:24.571388    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:12:24.572772 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:24.572740    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm" podUID="75affa76-6588-4026-bb96-573b65ea5ce8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:24.706307 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:24.700547    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:24.732242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:24.706905    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:12:24.841418 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:24.841324    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:12:24.841685 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:24.841650    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks" podUID="be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:24.894113 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:24.892450    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:24.894113 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:24.892822    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:12:24.913239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:24.907381    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:24.913239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:24.910472    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:12:24.973189 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:24.972463    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:24.973189 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:24.972795    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:12:25.058237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:25.005809    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:12:25.201258 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:25.201200    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:25.357242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:25.344478    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Nov 02 22:12:25.500296 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:25.496825    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:12:25.500575 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:25.500554    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:12:25.500728 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:25.500714    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:12:25.543245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:25.541634    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:12:25.693164 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:25.693133    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:12:26.149717 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:26.149682    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:26.264594 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:26.264559    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:26.364531 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:26.364492    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:27.092269 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:27.092236    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:27.902709 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:27.902674    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:28.696237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:28.696189    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:29.501837 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.501800    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"]
Nov 02 22:12:29.506031 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.506007    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.527706 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.527671    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"]
Nov 02 22:12:29.589602 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.589572    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-workload-certs\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.589602 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.589604    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-istio-envoy\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.589810 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.589751    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-credential-socket\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.589880 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.589854    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-istio-data\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.589943 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.589906    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c29d7205-65d5-49f9-8e49-834671694b92-istio-token\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.590004 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.589945    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c29d7205-65d5-49f9-8e49-834671694b92-istio-podinfo\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.590124 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.590053    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9phk\" (UniqueName: \"kubernetes.io/projected/c29d7205-65d5-49f9-8e49-834671694b92-kube-api-access-t9phk\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.590124 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.590091    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-workload-socket\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.591076 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.590159    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c29d7205-65d5-49f9-8e49-834671694b92-istiod-ca-cert\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.623658 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.623628    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:29.691895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.691859    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-workload-certs\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.691895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.691900    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-istio-envoy\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.692160 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.691958    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-credential-socket\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.692160 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.691999    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-istio-data\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.692160 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.692026    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c29d7205-65d5-49f9-8e49-834671694b92-istio-token\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.692160 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.692058    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c29d7205-65d5-49f9-8e49-834671694b92-istio-podinfo\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.692160 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.692130    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9phk\" (UniqueName: \"kubernetes.io/projected/c29d7205-65d5-49f9-8e49-834671694b92-kube-api-access-t9phk\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.692441 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.692166    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-workload-socket\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.692441 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.692201    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c29d7205-65d5-49f9-8e49-834671694b92-istiod-ca-cert\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.692441 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.692349    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-workload-certs\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.692598 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.692473    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-istio-data\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.692655 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.692617    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-workload-socket\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.692743 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.692720    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-credential-socket\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.692963 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.692942    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c29d7205-65d5-49f9-8e49-834671694b92-istiod-ca-cert\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.694353 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.694331    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-istio-envoy\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.695127 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.695105    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c29d7205-65d5-49f9-8e49-834671694b92-istio-podinfo\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.706336 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.704435    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9phk\" (UniqueName: \"kubernetes.io/projected/c29d7205-65d5-49f9-8e49-834671694b92-kube-api-access-t9phk\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.706336 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.704637    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c29d7205-65d5-49f9-8e49-834671694b92-istio-token\") pod \"e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") " pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.821672 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:29.821590    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:29.900914 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:12:29.900745    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:12:30.119055 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:12:30.119021    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc29d7205_65d5_49f9_8e49_834671694b92.slice/crio-9bf13edd995ae6ab93bd5a003baa20b9894d8db5945886141a8e202abefdd064 WatchSource:0}: Error finding container 9bf13edd995ae6ab93bd5a003baa20b9894d8db5945886141a8e202abefdd064: Status 404 returned error can't find the container with id 9bf13edd995ae6ab93bd5a003baa20b9894d8db5945886141a8e202abefdd064
Nov 02 22:12:30.119182 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:30.119084    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"]
Nov 02 22:12:30.121584 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:30.121555    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:12:30.121669 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:30.121621    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:12:30.121669 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:30.121651    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:12:30.533142 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:30.533040    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c" event={"ID":"c29d7205-65d5-49f9-8e49-834671694b92","Type":"ContainerStarted","Data":"eb6cf98830cac1fedf6529bf2ca86e0bcea0ca92b5375d5c523161264d90fa7a"}
Nov 02 22:12:30.533622 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:30.533145    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c" event={"ID":"c29d7205-65d5-49f9-8e49-834671694b92","Type":"ContainerStarted","Data":"9bf13edd995ae6ab93bd5a003baa20b9894d8db5945886141a8e202abefdd064"}
Nov 02 22:12:30.557141 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:30.557093    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c" podStartSLOduration=1.557078204 podStartE2EDuration="1.557078204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:12:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:12:30.553080543 +0000 UTC m=+859.609414943" watchObservedRunningTime="2026-11-02 22:12:30.557078204 +0000 UTC m=+859.613412585"
Nov 02 22:12:30.571132 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:30.571098    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:30.821967 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:30.821888    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:31.394436 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:31.394398    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:31.823609 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:31.823536    5076 patch_prober.go:29] interesting pod/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Nov 02 22:12:31.823609 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:31.823590    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c" podUID="c29d7205-65d5-49f9-8e49-834671694b92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Nov 02 22:12:32.149179 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:32.149078    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:32.822514 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:32.822475    5076 patch_prober.go:29] interesting pod/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Nov 02 22:12:32.822736 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:32.822554    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c" podUID="c29d7205-65d5-49f9-8e49-834671694b92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Nov 02 22:12:33.008980 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:33.008942    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:33.538260 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:33.537819    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:33.822510 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:33.822427    5076 patch_prober.go:29] interesting pod/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Nov 02 22:12:33.822676 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:33.822511    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c" podUID="c29d7205-65d5-49f9-8e49-834671694b92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Nov 02 22:12:33.989241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:33.968692    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:34.751185 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:34.751149    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:34.823021 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:34.822985    5076 patch_prober.go:29] interesting pod/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Nov 02 22:12:34.823165 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:34.823038    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c" podUID="c29d7205-65d5-49f9-8e49-834671694b92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Nov 02 22:12:35.570726 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:35.570690    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:35.822398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:35.822318    5076 patch_prober.go:29] interesting pod/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Nov 02 22:12:35.822398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:35.822378    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c" podUID="c29d7205-65d5-49f9-8e49-834671694b92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Nov 02 22:12:36.489921 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:36.489883    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:36.822456 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:36.822370    5076 patch_prober.go:29] interesting pod/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Nov 02 22:12:36.822456 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:36.822439    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c" podUID="c29d7205-65d5-49f9-8e49-834671694b92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Nov 02 22:12:37.377406 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:37.377364    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:38.040260 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:38.034822    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:38.040260 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:38.036360    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:38.040260 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:38.037628    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:12:38.509863 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:38.509826    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:39.761378 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:39.761329    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:40.059299 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:40.059150    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:40.269239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:40.265306    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:40.292239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:40.289385    5076 patch_prober.go:29] interesting pod/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:12:40.292239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:40.289446    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr" podUID="5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:40.548390 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:40.548341    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:41.234238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:41.229316    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Nov 02 22:12:41.234753 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:41.234707    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:41.302470 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:41.302422    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:41.557302 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:41.550256    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:41.584325 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:41.567008    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:12:41.637242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:41.634424    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:12:41.637242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:41.634514    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:12:42.251242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:42.230569    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:42.577259 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:42.577146    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": context deadline exceeded"
Nov 02 22:12:42.587194 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:42.587140    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:42.605851 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:42.605811    5076 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:42.606443 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:42.606410    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Nov 02 22:12:42.730809 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:42.730761    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:43.156265 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:43.156205    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:43.550027 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:43.549927    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Nov 02 22:12:43.583732 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:43.583676    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:43.584749 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:43.584692    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:12:43.584982 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:43.584955    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm" podUID="4e04cfe4-512d-43a4-816f-35e123b876a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:43.588334 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:43.588293    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Nov 02 22:12:43.619640 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:43.617680    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:43.619640 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:43.618074    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:12:43.733360 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:43.733313    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:43.789244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:43.748785    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:12:44.253278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.204612    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": context deadline exceeded"
Nov 02 22:12:44.278242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.253909    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:12:44.375347 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.375306    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:12:44.390801 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.390759    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc" podUID="cfdf90d5-cf69-43d7-9109-8920f600f3b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:44.535098 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.534942    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:12:44.555770 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.555641    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:44.585088 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.585050    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": context deadline exceeded"
Nov 02 22:12:44.620901 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.618582    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Nov 02 22:12:44.683888 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.683836    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:12:44.700392 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.699479    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:12:44.708779 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.708752    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:12:44.711124 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.711095    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"]
Nov 02 22:12:44.760313 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.739182    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"]
Nov 02 22:12:44.760313 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.739289    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:12:44.760313 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.740062    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.769607 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.769568    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:12:44.802715 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.802638    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:44.814436 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.814405    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-workload-certs\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.814818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.814796    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcgcm\" (UniqueName: \"kubernetes.io/projected/399e680c-1ff2-487e-867d-50d34732dec7-kube-api-access-gcgcm\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.815285 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.815262    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-istio-data\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.815467 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.815447    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/399e680c-1ff2-487e-867d-50d34732dec7-istio-token\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.815603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.815589    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-istio-envoy\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.815772 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.815758    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/399e680c-1ff2-487e-867d-50d34732dec7-istio-podinfo\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.815885 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.815872    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-workload-socket\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.816039 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.816025    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/399e680c-1ff2-487e-867d-50d34732dec7-istiod-ca-cert\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.816410 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.816371    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-credential-socket\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.888309 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.888277    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"]
Nov 02 22:12:44.893567 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.893543    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:44.903550 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.903399    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"]
Nov 02 22:12:44.919018 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.918992    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-credential-socket\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.919155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.919074    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-workload-certs\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.919155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.919123    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcgcm\" (UniqueName: \"kubernetes.io/projected/399e680c-1ff2-487e-867d-50d34732dec7-kube-api-access-gcgcm\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.919290 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.919157    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-istio-data\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.919456 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.919434    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/399e680c-1ff2-487e-867d-50d34732dec7-istio-token\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.919538 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.919464    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-credential-socket\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.919538 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.919485    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-istio-data\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.919538 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.919500    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-istio-envoy\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.919706 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.919539    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-workload-certs\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.919706 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.919568    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/399e680c-1ff2-487e-867d-50d34732dec7-istio-podinfo\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.919706 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.919593    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-workload-socket\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.919706 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.919633    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/399e680c-1ff2-487e-867d-50d34732dec7-istiod-ca-cert\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.919953 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.919929    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-workload-socket\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.920310 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.920288    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/399e680c-1ff2-487e-867d-50d34732dec7-istiod-ca-cert\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.922456 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.922421    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-istio-envoy\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.922842 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.922819    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/399e680c-1ff2-487e-867d-50d34732dec7-istio-podinfo\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.928882 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.928854    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/399e680c-1ff2-487e-867d-50d34732dec7-istio-token\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:44.929095 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:44.929071    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcgcm\" (UniqueName: \"kubernetes.io/projected/399e680c-1ff2-487e-867d-50d34732dec7-kube-api-access-gcgcm\") pod \"e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") " pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:45.020916 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.020877    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-token\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.021085 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.021033    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-workload-certs\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.021085 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.021053    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istiod-ca-cert\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.021163 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.021095    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-data\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.021274 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.021250    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-envoy\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.021313 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.021284    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42fsr\" (UniqueName: \"kubernetes.io/projected/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-kube-api-access-42fsr\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.021313 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.021309    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-podinfo\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.021404 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.021392    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-workload-socket\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.021444 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.021413    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-credential-socket\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.101309 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.099482    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:45.143318 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.126519    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-workload-certs\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.143318 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.126580    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istiod-ca-cert\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.143318 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.126692    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-data\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.143318 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.126782    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-envoy\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.143318 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.126808    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42fsr\" (UniqueName: \"kubernetes.io/projected/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-kube-api-access-42fsr\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.143318 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.126857    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-podinfo\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.143318 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.126937    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-workload-socket\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.143318 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.126963    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-credential-socket\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.143318 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.130656    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-data\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.143318 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.131110    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-workload-certs\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.143318 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.131870    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istiod-ca-cert\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.143318 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.135687    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-workload-socket\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.143318 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.135991    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-credential-socket\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.143318 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.142740    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-token\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.148437 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.148412    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42fsr\" (UniqueName: \"kubernetes.io/projected/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-kube-api-access-42fsr\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.150416 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.150381    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-podinfo\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.151080 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.151059    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-token\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.151499 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.151477    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-envoy\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.213001 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.212968    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:45.436914 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:12:45.436875    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod399e680c_1ff2_487e_867d_50d34732dec7.slice/crio-3d9f08479385c97bfd2972a5c68dc548ec3494555577c8f7e9a7c20d3f098983 WatchSource:0}: Error finding container 3d9f08479385c97bfd2972a5c68dc548ec3494555577c8f7e9a7c20d3f098983: Status 404 returned error can't find the container with id 3d9f08479385c97bfd2972a5c68dc548ec3494555577c8f7e9a7c20d3f098983
Nov 02 22:12:45.440083 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.440035    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:12:45.440201 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.440143    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:12:45.440279 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.440198    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:12:45.441363 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.441344    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"]
Nov 02 22:12:45.524687 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.524656    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"]
Nov 02 22:12:45.525829 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:12:45.525495    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b21b282_ae28_40c1_85f0_0edb6b1e40ec.slice/crio-f43a4c967aba4b8feb884c3fba7204e24df9f870ed727d264a014b5d37dc088d WatchSource:0}: Error finding container f43a4c967aba4b8feb884c3fba7204e24df9f870ed727d264a014b5d37dc088d: Status 404 returned error can't find the container with id f43a4c967aba4b8feb884c3fba7204e24df9f870ed727d264a014b5d37dc088d
Nov 02 22:12:45.528517 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.528479    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:12:45.528617 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.528556    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:12:45.528617 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.528604    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:12:45.724791 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.724663    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t" event={"ID":"3b21b282-ae28-40c1-85f0-0edb6b1e40ec","Type":"ContainerStarted","Data":"8a49edfbf649328285d14dfd293dde086d6d1043f61618c3b7bbfe363c7264cf"}
Nov 02 22:12:45.724791 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.724713    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t" event={"ID":"3b21b282-ae28-40c1-85f0-0edb6b1e40ec","Type":"ContainerStarted","Data":"f43a4c967aba4b8feb884c3fba7204e24df9f870ed727d264a014b5d37dc088d"}
Nov 02 22:12:45.739238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.738250    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm" event={"ID":"399e680c-1ff2-487e-867d-50d34732dec7","Type":"ContainerStarted","Data":"d5c76e755624361dbce49af0c2410e810e0a2b4b9c74ab4ce7e503d3ca9ed689"}
Nov 02 22:12:45.739238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.738349    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm" event={"ID":"399e680c-1ff2-487e-867d-50d34732dec7","Type":"ContainerStarted","Data":"3d9f08479385c97bfd2972a5c68dc548ec3494555577c8f7e9a7c20d3f098983"}
Nov 02 22:12:45.761373 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.761314    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t" podStartSLOduration=1.761282163 podStartE2EDuration="1.761282163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:12:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:12:45.752281582 +0000 UTC m=+874.808615965" watchObservedRunningTime="2026-11-02 22:12:45.761282163 +0000 UTC m=+874.817616544"
Nov 02 22:12:45.781859 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.781795    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm" podStartSLOduration=1.781775867 podStartE2EDuration="1.781775867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:12:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:12:45.776076698 +0000 UTC m=+874.832411103" watchObservedRunningTime="2026-11-02 22:12:45.781775867 +0000 UTC m=+874.838110249"
Nov 02 22:12:45.899212 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:45.899170    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:46.101009 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:46.100930    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:46.102494 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:46.102467    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Nov 02 22:12:46.102618 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:46.102517    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm" podUID="399e680c-1ff2-487e-867d-50d34732dec7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Nov 02 22:12:46.213768 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:46.213729    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:46.215197 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:46.215164    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Nov 02 22:12:46.215341 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:46.215255    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t" podUID="3b21b282-ae28-40c1-85f0-0edb6b1e40ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Nov 02 22:12:46.884240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:46.878887    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:47.113240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:47.100668    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Nov 02 22:12:47.113240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:47.100728    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm" podUID="399e680c-1ff2-487e-867d-50d34732dec7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Nov 02 22:12:47.214691 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:47.214594    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Nov 02 22:12:47.214935 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:47.214908    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t" podUID="3b21b282-ae28-40c1-85f0-0edb6b1e40ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Nov 02 22:12:47.948949 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:47.948914    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:48.109640 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:48.109603    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Nov 02 22:12:48.109924 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:48.109896    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm" podUID="399e680c-1ff2-487e-867d-50d34732dec7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Nov 02 22:12:48.214293 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:48.213573    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Nov 02 22:12:48.214293 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:48.213652    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t" podUID="3b21b282-ae28-40c1-85f0-0edb6b1e40ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Nov 02 22:12:48.822557 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:48.821864    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:49.105296 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:49.103682    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Nov 02 22:12:49.105296 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:49.103741    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm" podUID="399e680c-1ff2-487e-867d-50d34732dec7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Nov 02 22:12:49.218545 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:49.218507    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Nov 02 22:12:49.218749 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:49.218565    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t" podUID="3b21b282-ae28-40c1-85f0-0edb6b1e40ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Nov 02 22:12:49.591294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:49.579696    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:50.114239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:50.114050    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Nov 02 22:12:50.114239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:50.114119    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm" podUID="399e680c-1ff2-487e-867d-50d34732dec7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Nov 02 22:12:50.215241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:50.214828    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Nov 02 22:12:50.215241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:50.214929    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t" podUID="3b21b282-ae28-40c1-85f0-0edb6b1e40ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Nov 02 22:12:50.488545 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:50.488458    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:51.118240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:51.117681    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Nov 02 22:12:51.118240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:51.117747    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm" podUID="399e680c-1ff2-487e-867d-50d34732dec7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Nov 02 22:12:51.214240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:51.213569    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Nov 02 22:12:51.214240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:51.213628    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t" podUID="3b21b282-ae28-40c1-85f0-0edb6b1e40ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Nov 02 22:12:51.300240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:51.299586    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:52.101533 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:52.101497    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Nov 02 22:12:52.101718 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:52.101556    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm" podUID="399e680c-1ff2-487e-867d-50d34732dec7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Nov 02 22:12:52.198354 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:52.198312    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:52.213515 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:52.213480    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Nov 02 22:12:52.213689 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:52.213548    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t" podUID="3b21b282-ae28-40c1-85f0-0edb6b1e40ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Nov 02 22:12:52.898246 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:52.896763    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:53.213982 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:53.213895    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Nov 02 22:12:53.214427 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:53.213978    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t" podUID="3b21b282-ae28-40c1-85f0-0edb6b1e40ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Nov 02 22:12:53.459272 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:53.459201    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:53.459704 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:53.459679    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:53.460685 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:53.460666    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:12:53.785902 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:53.785864    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:54.218674 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:54.218639    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:54.219345 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:54.219324    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:54.219937 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:54.219918    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:12:54.675005 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:54.674973    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:55.354695 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:55.354651    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:56.092605 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:56.092574    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:56.801471 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:56.801432    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:58.590239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:58.589310    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:58.740240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:58.739305    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:58.792272 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:58.787480    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:58.873293 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:58.856888    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:12:59.380132 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:59.379798    5076 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:59.566738 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:59.565632    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:59.612243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:59.568479    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:59.612243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:59.590301    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:59.612243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:59.591606    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:12:59.630084 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:59.628951    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:59.697482 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:59.697385    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"]
Nov 02 22:12:59.790244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:59.770407    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:59.805544 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:59.805499    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:12:59.852526 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:59.852489    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"]
Nov 02 22:12:59.852856 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:59.852840    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:12:59.853024 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:59.853012    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:12:59.853910 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:12:59.853885    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.067295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.001212    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-token\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.067295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.001320    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmfxl\" (UniqueName: \"kubernetes.io/projected/edb6e916-cc3b-40f3-8f88-80ec1411a271-kube-api-access-fmfxl\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.067295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.001351    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-workload-certs\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.067295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.001397    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-workload-socket\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.067295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.001432    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edb6e916-cc3b-40f3-8f88-80ec1411a271-istiod-ca-cert\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.067295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.001524    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-credential-socket\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.067295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.001686    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-envoy\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.067295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.001734    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-podinfo\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.067295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.001768    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-data\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.146511 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.105171    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-envoy\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.146511 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.105255    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-podinfo\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.146511 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.105297    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-data\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.146511 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.105436    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-token\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.146511 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.105500    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmfxl\" (UniqueName: \"kubernetes.io/projected/edb6e916-cc3b-40f3-8f88-80ec1411a271-kube-api-access-fmfxl\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.146511 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.105530    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-workload-certs\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.146511 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.105577    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-workload-socket\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.146511 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.105616    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edb6e916-cc3b-40f3-8f88-80ec1411a271-istiod-ca-cert\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.146511 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.105715    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-credential-socket\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.146511 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.138697    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-data\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.182739 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.165814    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-workload-socket\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.182739 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.166192    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-workload-certs\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.182739 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.171921    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edb6e916-cc3b-40f3-8f88-80ec1411a271-istiod-ca-cert\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.200660 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.200586    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-credential-socket\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.291345 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.269707    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-podinfo\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.291593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.285540    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"]
Nov 02 22:13:00.380414 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.374449    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"]
Nov 02 22:13:00.396322 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.377238    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.489239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.480577    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-istio-data\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.489239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.480653    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp727\" (UniqueName: \"kubernetes.io/projected/3f07035a-2595-4005-8d5b-bfebe3775611-kube-api-access-dp727\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.489239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.480715    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-workload-socket\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.489239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.480813    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f07035a-2595-4005-8d5b-bfebe3775611-istio-token\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.489239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.480844    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f07035a-2595-4005-8d5b-bfebe3775611-istiod-ca-cert\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.489239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.480898    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-credential-socket\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.489239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.481036    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-istio-envoy\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.489239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.481080    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-workload-certs\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.489239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.481135    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f07035a-2595-4005-8d5b-bfebe3775611-istio-podinfo\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.489239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.487400    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-token\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.489239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.487678    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-envoy\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.547543 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.524842    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmfxl\" (UniqueName: \"kubernetes.io/projected/edb6e916-cc3b-40f3-8f88-80ec1411a271-kube-api-access-fmfxl\") pod \"e2e-worker-w2-2532af-openshift-default-d47659495-k25gz\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") " pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.547543 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.546968    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:00.568789 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:13:00.556452    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:13:00.568789 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.567724    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Nov 02 22:13:00.568789 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.568055    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:13:00.609036 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.569300    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:00.609036 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.569679    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:13:00.609036 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.607514    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:00.696593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.640696    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:00.696593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.642016    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-istio-data\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.696593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.642091    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp727\" (UniqueName: \"kubernetes.io/projected/3f07035a-2595-4005-8d5b-bfebe3775611-kube-api-access-dp727\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.696593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.642197    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-workload-socket\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.696593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.642313    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f07035a-2595-4005-8d5b-bfebe3775611-istio-token\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.696593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.642342    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f07035a-2595-4005-8d5b-bfebe3775611-istiod-ca-cert\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.696593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.642392    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-credential-socket\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.696593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.642576    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-istio-envoy\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.696593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.642623    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-workload-certs\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.696593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.642677    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f07035a-2595-4005-8d5b-bfebe3775611-istio-podinfo\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.696593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.657296    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:13:00.696593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.658920    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-istio-data\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.696593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.669997    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-workload-socket\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.836248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.831635    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-credential-socket\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.869259 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.866583    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp727\" (UniqueName: \"kubernetes.io/projected/3f07035a-2595-4005-8d5b-bfebe3775611-kube-api-access-dp727\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.873580 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.873477    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f07035a-2595-4005-8d5b-bfebe3775611-istiod-ca-cert\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.877257 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.874445    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-workload-certs\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:00.962105 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.935434    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:13:00.962105 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.935546    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:13:00.963059 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:00.963009    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": context deadline exceeded"
Nov 02 22:13:01.093322 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:01.093278    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:01.217705 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:01.099841    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f07035a-2595-4005-8d5b-bfebe3775611-istio-token\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:01.217705 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:01.101593    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f07035a-2595-4005-8d5b-bfebe3775611-istio-podinfo\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:01.445797 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:01.445090    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-istio-envoy\") pod \"e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") " pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:02.168269 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:13:02.145773    5076 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.061s"
Nov 02 22:13:02.168269 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:02.145869    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:13:02.168269 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:02.145961    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:13:02.168269 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:02.146016    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:13:02.168269 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:02.146069    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:13:02.316016 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:02.315992    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:02.462815 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:02.454531    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:13:02.462815 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:02.454619    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:13:02.462815 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:02.454659    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:13:02.483237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:02.468203    5076 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/health\": context deadline exceeded"
Nov 02 22:13:02.486906 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:02.486874    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"]
Nov 02 22:13:02.533919 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:02.533889    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz" event={"ID":"edb6e916-cc3b-40f3-8f88-80ec1411a271","Type":"ContainerStarted","Data":"298f98c16c10e3ba9fd145f5131df97b497e6192808b0600d6383a528f381c72"}
Nov 02 22:13:02.780517 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:02.780484    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"]
Nov 02 22:13:02.782510 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:02.781355    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:13:02.782510 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:02.781418    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:13:02.782510 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:02.781447    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:13:03.086479 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:03.086404    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:03.543193 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:03.543153    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz" event={"ID":"edb6e916-cc3b-40f3-8f88-80ec1411a271","Type":"ContainerStarted","Data":"c5e679f384e3a96daaf2243e451945b85cbd4225c0f3c74d3c74f07a217cc179"}
Nov 02 22:13:03.545566 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:03.545539    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8" event={"ID":"3f07035a-2595-4005-8d5b-bfebe3775611","Type":"ContainerStarted","Data":"97f73362687d9b2ce3e4d4ce7b4a1cac9568dccae86f1e443795a210c86bad9b"}
Nov 02 22:13:03.545724 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:03.545590    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8" event={"ID":"3f07035a-2595-4005-8d5b-bfebe3775611","Type":"ContainerStarted","Data":"704fde1ec5689040fa6e7632692b9ab7e26092d07c86671323b0dd62de625e09"}
Nov 02 22:13:03.548232 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:03.548199    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:03.549673 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:03.549644    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Nov 02 22:13:03.549786 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:03.549716    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz" podUID="edb6e916-cc3b-40f3-8f88-80ec1411a271" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Nov 02 22:13:03.578239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:03.575711    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz" podStartSLOduration=4.575693211 podStartE2EDuration="4.575693211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:12:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:13:03.563378808 +0000 UTC m=+892.619713200" watchObservedRunningTime="2026-11-02 22:13:03.575693211 +0000 UTC m=+892.632027591"
Nov 02 22:13:03.621285 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:03.618843    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8" podStartSLOduration=4.618822724 podStartE2EDuration="4.618822724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:12:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:13:03.584717506 +0000 UTC m=+892.641051888" watchObservedRunningTime="2026-11-02 22:13:03.618822724 +0000 UTC m=+892.675157104"
Nov 02 22:13:04.365136 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:04.365100    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:04.395423 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:04.395392    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:04.396308 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:04.396281    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Nov 02 22:13:04.396483 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:04.396461    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8" podUID="3f07035a-2595-4005-8d5b-bfebe3775611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Nov 02 22:13:04.549847 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:04.549813    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Nov 02 22:13:04.550430 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:04.549872    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz" podUID="edb6e916-cc3b-40f3-8f88-80ec1411a271" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Nov 02 22:13:05.391241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:05.390613    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Nov 02 22:13:05.391241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:05.390674    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8" podUID="3f07035a-2595-4005-8d5b-bfebe3775611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Nov 02 22:13:05.516268 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:05.516233    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:05.548557 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:05.548524    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Nov 02 22:13:05.548790 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:05.548577    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz" podUID="edb6e916-cc3b-40f3-8f88-80ec1411a271" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Nov 02 22:13:06.392958 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:06.392923    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Nov 02 22:13:06.393603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:06.393558    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8" podUID="3f07035a-2595-4005-8d5b-bfebe3775611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Nov 02 22:13:06.396278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:06.396252    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:06.548885 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:06.548850    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Nov 02 22:13:06.549061 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:06.548924    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz" podUID="edb6e916-cc3b-40f3-8f88-80ec1411a271" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Nov 02 22:13:07.388248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:07.387858    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:07.400240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:07.397487    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Nov 02 22:13:07.400240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:07.397561    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8" podUID="3f07035a-2595-4005-8d5b-bfebe3775611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Nov 02 22:13:07.561296 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:07.549923    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Nov 02 22:13:07.561296 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:07.550037    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz" podUID="edb6e916-cc3b-40f3-8f88-80ec1411a271" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Nov 02 22:13:08.395242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:08.394601    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Nov 02 22:13:08.395242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:08.394697    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8" podUID="3f07035a-2595-4005-8d5b-bfebe3775611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Nov 02 22:13:08.414826 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:08.414526    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:08.552595 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:08.552560    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Nov 02 22:13:08.552885 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:08.552856    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz" podUID="edb6e916-cc3b-40f3-8f88-80ec1411a271" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Nov 02 22:13:09.245679 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:09.245626    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:09.401501 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:09.400446    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Nov 02 22:13:09.401501 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:09.400511    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8" podUID="3f07035a-2595-4005-8d5b-bfebe3775611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Nov 02 22:13:09.548168 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:09.548067    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Nov 02 22:13:09.548729 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:09.548234    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz" podUID="edb6e916-cc3b-40f3-8f88-80ec1411a271" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Nov 02 22:13:09.910259 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:09.910205    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:10.542212 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:10.542177    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:10.542928 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:10.542908    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:10.543891 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:10.543867    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:13:10.553073 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:10.553045    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:10.553511 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:10.553497    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:10.554386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:10.554369    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:13:10.727898 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:10.727863    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:11.148018 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:11.147987    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-6971-ec79c2"]
Nov 02 22:13:11.153130 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:11.152962    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6971-ec79c2"
Nov 02 22:13:11.157965 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:11.157882    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8p5jl\""
Nov 02 22:13:11.169101 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:11.168693    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-6971-ec79c2"]
Nov 02 22:13:11.263627 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:11.263590    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4585l\" (UniqueName: \"kubernetes.io/projected/c81a8f64-3691-4a0c-aae5-700dbd024bb9-kube-api-access-4585l\") pod \"test-curl-6971-ec79c2\" (UID: \"c81a8f64-3691-4a0c-aae5-700dbd024bb9\") " pod="opendatahub/test-curl-6971-ec79c2"
Nov 02 22:13:11.365305 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:11.365262    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4585l\" (UniqueName: \"kubernetes.io/projected/c81a8f64-3691-4a0c-aae5-700dbd024bb9-kube-api-access-4585l\") pod \"test-curl-6971-ec79c2\" (UID: \"c81a8f64-3691-4a0c-aae5-700dbd024bb9\") " pod="opendatahub/test-curl-6971-ec79c2"
Nov 02 22:13:11.372881 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:11.372852    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4585l\" (UniqueName: \"kubernetes.io/projected/c81a8f64-3691-4a0c-aae5-700dbd024bb9-kube-api-access-4585l\") pod \"test-curl-6971-ec79c2\" (UID: \"c81a8f64-3691-4a0c-aae5-700dbd024bb9\") " pod="opendatahub/test-curl-6971-ec79c2"
Nov 02 22:13:11.489307 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:11.489201    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6971-ec79c2"
Nov 02 22:13:11.548090 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:11.547974    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:11.778516 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:11.778427    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-6971-ec79c2"]
Nov 02 22:13:11.784698 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:13:11.784676    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc81a8f64_3691_4a0c_aae5_700dbd024bb9.slice/crio-3af79de6d395a396f29c2bc9ef96a4d1d9a345eab1608baf32081570beebf831 WatchSource:0}: Error finding container 3af79de6d395a396f29c2bc9ef96a4d1d9a345eab1608baf32081570beebf831: Status 404 returned error can't find the container with id 3af79de6d395a396f29c2bc9ef96a4d1d9a345eab1608baf32081570beebf831
Nov 02 22:13:12.377514 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:12.377476    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:12.787524 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:12.787485    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-6971-ec79c2" event={"ID":"c81a8f64-3691-4a0c-aae5-700dbd024bb9","Type":"ContainerStarted","Data":"78f8f211e4a9023ba197c8aaad7da9b80dbf80a5bbf1d95a3ba50ea13f400338"}
Nov 02 22:13:12.787931 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:12.787537    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-6971-ec79c2" event={"ID":"c81a8f64-3691-4a0c-aae5-700dbd024bb9","Type":"ContainerStarted","Data":"3af79de6d395a396f29c2bc9ef96a4d1d9a345eab1608baf32081570beebf831"}
Nov 02 22:13:12.804646 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:12.804595    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-6971-ec79c2" podStartSLOduration=1.04988978 podStartE2EDuration="1.804582694s" totalImagesPullingTime="754.692914ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:13:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:13:12.800801242 +0000 UTC m=+901.857135621" watchObservedRunningTime="2026-11-02 22:13:12.804582694 +0000 UTC m=+901.860917121"
Nov 02 22:13:13.082016 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:13.081930    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:13.453032 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:13.452992    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-6971-ec79c2"]
Nov 02 22:13:13.457988 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:13.457957    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-6971-ec79c2"]
Nov 02 22:13:13.598402 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:13.598369    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-6971-933dd5"]
Nov 02 22:13:13.599029 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:13.599009    5076 cpu_manager.go:414] "containerMap: removing container" podUID="c81a8f64-3691-4a0c-aae5-700dbd024bb9" containerName="test-curl-6971-ec79c2"
Nov 02 22:13:13.599135 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:13.599032    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c81a8f64-3691-4a0c-aae5-700dbd024bb9" containerName="test-curl-6971-ec79c2"
Nov 02 22:13:13.599279 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:13.599265    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="c81a8f64-3691-4a0c-aae5-700dbd024bb9" containerName="test-curl-6971-ec79c2"
Nov 02 22:13:13.603095 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:13.603072    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6971-933dd5"
Nov 02 22:13:13.608734 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:13.608706    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-6971-933dd5"]
Nov 02 22:13:13.686931 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:13.686894    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:13.705686 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:13.705609    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n97q\" (UniqueName: \"kubernetes.io/projected/a11f11f0-4672-4f72-8982-712bb27dbe84-kube-api-access-4n97q\") pod \"test-curl-6971-933dd5\" (UID: \"a11f11f0-4672-4f72-8982-712bb27dbe84\") " pod="opendatahub/test-curl-6971-933dd5"
Nov 02 22:13:13.808159 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:13.808122    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n97q\" (UniqueName: \"kubernetes.io/projected/a11f11f0-4672-4f72-8982-712bb27dbe84-kube-api-access-4n97q\") pod \"test-curl-6971-933dd5\" (UID: \"a11f11f0-4672-4f72-8982-712bb27dbe84\") " pod="opendatahub/test-curl-6971-933dd5"
Nov 02 22:13:13.823200 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:13.823156    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n97q\" (UniqueName: \"kubernetes.io/projected/a11f11f0-4672-4f72-8982-712bb27dbe84-kube-api-access-4n97q\") pod \"test-curl-6971-933dd5\" (UID: \"a11f11f0-4672-4f72-8982-712bb27dbe84\") " pod="opendatahub/test-curl-6971-933dd5"
Nov 02 22:13:13.921411 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:13.921371    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6971-933dd5"
Nov 02 22:13:14.200013 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:14.199982    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-6971-933dd5"]
Nov 02 22:13:14.200648 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:13:14.200620    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda11f11f0_4672_4f72_8982_712bb27dbe84.slice/crio-3dd4d285a964ff89441eb797d02e33856da5b6867ce26bb03fa7cf2f1f6b2260 WatchSource:0}: Error finding container 3dd4d285a964ff89441eb797d02e33856da5b6867ce26bb03fa7cf2f1f6b2260: Status 404 returned error can't find the container with id 3dd4d285a964ff89441eb797d02e33856da5b6867ce26bb03fa7cf2f1f6b2260
Nov 02 22:13:14.524788 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:14.524696    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:14.864919 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:14.864877    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-6971-ec79c2" podUID="c81a8f64-3691-4a0c-aae5-700dbd024bb9" containerName="test-curl-6971-ec79c2" containerID="cri-o://78f8f211e4a9023ba197c8aaad7da9b80dbf80a5bbf1d95a3ba50ea13f400338" gracePeriod=2
Nov 02 22:13:14.866581 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:14.866553    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-6971-933dd5" event={"ID":"a11f11f0-4672-4f72-8982-712bb27dbe84","Type":"ContainerStarted","Data":"4bbab5c367dffdc0124a1db6ad6766573ffadda214613b6fe0a199fe5605cb13"}
Nov 02 22:13:14.866760 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:14.866744    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-6971-933dd5" event={"ID":"a11f11f0-4672-4f72-8982-712bb27dbe84","Type":"ContainerStarted","Data":"3dd4d285a964ff89441eb797d02e33856da5b6867ce26bb03fa7cf2f1f6b2260"}
Nov 02 22:13:14.887519 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:13:14.887487    5076 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-6971-ec79c2\" is forbidden: User \"system:node:ip-10-0-142-132.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-132.us-east-2.compute.internal' and this object" podUID="c81a8f64-3691-4a0c-aae5-700dbd024bb9" pod="opendatahub/test-curl-6971-ec79c2"
Nov 02 22:13:14.889943 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:13:14.889912    5076 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-6971-ec79c2\" is forbidden: User \"system:node:ip-10-0-142-132.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-132.us-east-2.compute.internal' and this object" podUID="c81a8f64-3691-4a0c-aae5-700dbd024bb9" pod="opendatahub/test-curl-6971-ec79c2"
Nov 02 22:13:14.892936 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:14.892886    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-6971-933dd5" podStartSLOduration=1.89286902 podStartE2EDuration="1.89286902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:13:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:13:14.883364776 +0000 UTC m=+903.939699157" watchObservedRunningTime="2026-11-02 22:13:14.89286902 +0000 UTC m=+903.949203399"
Nov 02 22:13:16.457045 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:16.456998    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:16.622275 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:16.621724    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:16.920243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:16.918653    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:16.939256 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:16.923480    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:16.967656 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:16.967283    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:16.976859 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:16.976773    5076 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:17.168405 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:17.126188    5076 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:17.258247 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:17.168309    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:17.530812 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:17.465308    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:17.530812 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:17.465659    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:13:17.637243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:17.622335    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:17.637243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:17.623061    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:13:17.926562 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:17.925318    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:17.942244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:17.927718    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:13:17.942244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:17.928911    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:17.942497 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:17.942429    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:13:17.972887 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:17.969784    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:17.972887 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:17.971022    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:13:18.095150 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:18.095102    5076 generic.go:356] "Generic (PLEG): container finished" podID="c81a8f64-3691-4a0c-aae5-700dbd024bb9" containerID="78f8f211e4a9023ba197c8aaad7da9b80dbf80a5bbf1d95a3ba50ea13f400338" exitCode=137
Nov 02 22:13:18.326293 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:18.303024    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Nov 02 22:13:18.326293 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:18.304648    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:13:18.470280 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:18.466479    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:18.784139 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:18.784078    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:18.950432 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:18.950377    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Nov 02 22:13:18.953074 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:18.953027    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Nov 02 22:13:19.007242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:18.981626    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": context deadline exceeded"
Nov 02 22:13:19.305591 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:19.304784    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Nov 02 22:13:19.319243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:19.318791    5076 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/health\": context deadline exceeded"
Nov 02 22:13:19.488242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:19.484333    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:19.807325 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:19.802922    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:19.966441 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:19.966347    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Nov 02 22:13:19.967078 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:19.967046    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Nov 02 22:13:19.968853 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:19.968822    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:20.032786 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:20.032756    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6971-ec79c2"
Nov 02 22:13:20.128284 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:20.080742    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c81a8f64-3691-4a0c-aae5-700dbd024bb9-kube-api-access-4585l\" (UniqueName: \"kubernetes.io/projected/c81a8f64-3691-4a0c-aae5-700dbd024bb9-kube-api-access-4585l\") pod \"c81a8f64-3691-4a0c-aae5-700dbd024bb9\" (UID: \"c81a8f64-3691-4a0c-aae5-700dbd024bb9\") "
Nov 02 22:13:20.227478 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:20.227393    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": context deadline exceeded"
Nov 02 22:13:20.228053 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:20.225913    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c81a8f64-3691-4a0c-aae5-700dbd024bb9-kube-api-access-4585l" pod "c81a8f64-3691-4a0c-aae5-700dbd024bb9" (UID: "c81a8f64-3691-4a0c-aae5-700dbd024bb9"). InnerVolumeSpecName "kube-api-access-4585l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:13:20.262148 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:20.257852    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:13:20.262148 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:20.257925    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:13:20.335246 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:20.321407    5076 scope.go:122] "RemoveContainer" containerID="78f8f211e4a9023ba197c8aaad7da9b80dbf80a5bbf1d95a3ba50ea13f400338"
Nov 02 22:13:20.335246 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:20.321620    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6971-ec79c2"
Nov 02 22:13:20.337849 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:20.337822    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4585l\" (UniqueName: \"kubernetes.io/projected/c81a8f64-3691-4a0c-aae5-700dbd024bb9-kube-api-access-4585l\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:13:20.339864 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:20.339782    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Nov 02 22:13:20.517528 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:20.517484    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:13:20.521387 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:13:20.521338    5076 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-6971-ec79c2\" is forbidden: User \"system:node:ip-10-0-142-132.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-132.us-east-2.compute.internal' and this object" podUID="c81a8f64-3691-4a0c-aae5-700dbd024bb9" pod="opendatahub/test-curl-6971-ec79c2"
Nov 02 22:13:20.528808 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:20.528786    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:13:20.532168 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:20.532148    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:13:20.552284 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:20.552250    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-6971-933dd5"]
Nov 02 22:13:20.552471 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:20.552446    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-6971-933dd5" podUID="a11f11f0-4672-4f72-8982-712bb27dbe84" containerName="test-curl-6971-933dd5" containerID="cri-o://4bbab5c367dffdc0124a1db6ad6766573ffadda214613b6fe0a199fe5605cb13" gracePeriod=2
Nov 02 22:13:20.557990 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:20.557965    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:13:20.560032 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:20.559987    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-6971-933dd5"]
Nov 02 22:13:20.561420 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:13:20.561387    5076 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-6971-ec79c2\" is forbidden: User \"system:node:ip-10-0-142-132.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-132.us-east-2.compute.internal' and this object" podUID="c81a8f64-3691-4a0c-aae5-700dbd024bb9" pod="opendatahub/test-curl-6971-ec79c2"
Nov 02 22:13:20.564596 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:13:20.564570    5076 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-6971-ec79c2\" is forbidden: User \"system:node:ip-10-0-142-132.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-132.us-east-2.compute.internal' and this object" podUID="c81a8f64-3691-4a0c-aae5-700dbd024bb9" pod="opendatahub/test-curl-6971-ec79c2"
Nov 02 22:13:20.628837 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:13:20.628802    5076 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-6971-933dd5\" is forbidden: User \"system:node:ip-10-0-142-132.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-132.us-east-2.compute.internal' and this object" podUID="a11f11f0-4672-4f72-8982-712bb27dbe84" pod="opendatahub/test-curl-6971-933dd5"
Nov 02 22:13:21.053325 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:13:21.053279    5076 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-6971-933dd5\" is forbidden: User \"system:node:ip-10-0-142-132.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-132.us-east-2.compute.internal' and this object" podUID="a11f11f0-4672-4f72-8982-712bb27dbe84" pod="opendatahub/test-curl-6971-933dd5"
Nov 02 22:13:21.055351 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:13:21.055316    5076 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-6971-ec79c2\" is forbidden: User \"system:node:ip-10-0-142-132.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-132.us-east-2.compute.internal' and this object" podUID="c81a8f64-3691-4a0c-aae5-700dbd024bb9" pod="opendatahub/test-curl-6971-ec79c2"
Nov 02 22:13:21.056096 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:21.056074    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c81a8f64-3691-4a0c-aae5-700dbd024bb9" path="/var/lib/kubelet/pods/c81a8f64-3691-4a0c-aae5-700dbd024bb9/volumes"
Nov 02 22:13:21.255310 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:21.254796    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:21.436534 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:21.436497    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:21.737887 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:21.737809    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:21.838210 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:21.838170    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:22.347927 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:22.347893    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:22.831792 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:22.831761    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6971-933dd5"
Nov 02 22:13:22.888191 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:22.888115    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a11f11f0-4672-4f72-8982-712bb27dbe84-kube-api-access-4n97q\" (UniqueName: \"kubernetes.io/projected/a11f11f0-4672-4f72-8982-712bb27dbe84-kube-api-access-4n97q\") pod \"a11f11f0-4672-4f72-8982-712bb27dbe84\" (UID: \"a11f11f0-4672-4f72-8982-712bb27dbe84\") "
Nov 02 22:13:22.890340 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:22.890310    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a11f11f0-4672-4f72-8982-712bb27dbe84-kube-api-access-4n97q" pod "a11f11f0-4672-4f72-8982-712bb27dbe84" (UID: "a11f11f0-4672-4f72-8982-712bb27dbe84"). InnerVolumeSpecName "kube-api-access-4n97q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:13:22.990581 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:22.990500    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n97q\" (UniqueName: \"kubernetes.io/projected/a11f11f0-4672-4f72-8982-712bb27dbe84-kube-api-access-4n97q\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:13:23.059169 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:23.059127    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a11f11f0-4672-4f72-8982-712bb27dbe84" path="/var/lib/kubelet/pods/a11f11f0-4672-4f72-8982-712bb27dbe84/volumes"
Nov 02 22:13:23.267158 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:23.267070    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:23.357763 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:23.356432    5076 generic.go:356] "Generic (PLEG): container finished" podID="a11f11f0-4672-4f72-8982-712bb27dbe84" containerID="4bbab5c367dffdc0124a1db6ad6766573ffadda214613b6fe0a199fe5605cb13" exitCode=137
Nov 02 22:13:23.357763 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:23.356735    5076 scope.go:122] "RemoveContainer" containerID="4bbab5c367dffdc0124a1db6ad6766573ffadda214613b6fe0a199fe5605cb13"
Nov 02 22:13:23.359870 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:23.359190    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6971-933dd5"
Nov 02 22:13:23.397873 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:23.397455    5076 scope.go:122] "RemoveContainer" containerID="4bbab5c367dffdc0124a1db6ad6766573ffadda214613b6fe0a199fe5605cb13"
Nov 02 22:13:23.398741 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:13:23.398707    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bbab5c367dffdc0124a1db6ad6766573ffadda214613b6fe0a199fe5605cb13\": container with ID starting with 4bbab5c367dffdc0124a1db6ad6766573ffadda214613b6fe0a199fe5605cb13 not found: ID does not exist" containerID="4bbab5c367dffdc0124a1db6ad6766573ffadda214613b6fe0a199fe5605cb13"
Nov 02 22:13:23.398887 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:23.398755    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bbab5c367dffdc0124a1db6ad6766573ffadda214613b6fe0a199fe5605cb13"} err="failed to get container status \"4bbab5c367dffdc0124a1db6ad6766573ffadda214613b6fe0a199fe5605cb13\": rpc error: code = NotFound desc = could not find container \"4bbab5c367dffdc0124a1db6ad6766573ffadda214613b6fe0a199fe5605cb13\": container with ID starting with 4bbab5c367dffdc0124a1db6ad6766573ffadda214613b6fe0a199fe5605cb13 not found: ID does not exist"
Nov 02 22:13:24.289113 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:24.289074    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:24.733054 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:24.733021    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:24.920227 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:24.920164    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:25.204414 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:25.204366    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:25.933609 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:25.933576    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:26.038672 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:26.038633    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:26.127155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:26.127120    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:26.900469 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:26.900435    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:27.778810 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:27.778770    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:28.667052 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:28.667015    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:29.301172 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:29.301131    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:29.897637 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:13:29.897594    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:13:30.189023 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:30.188931    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:30.755711 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:30.755675    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"]
Nov 02 22:13:30.757086 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:30.757057    5076 cpu_manager.go:414] "containerMap: removing container" podUID="a11f11f0-4672-4f72-8982-712bb27dbe84" containerName="test-curl-6971-933dd5"
Nov 02 22:13:30.757086 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:30.757084    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a11f11f0-4672-4f72-8982-712bb27dbe84" containerName="test-curl-6971-933dd5"
Nov 02 22:13:30.757348 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:30.757232    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="a11f11f0-4672-4f72-8982-712bb27dbe84" containerName="test-curl-6971-933dd5"
Nov 02 22:13:30.785478 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:30.785446    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"]
Nov 02 22:13:30.785638 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:30.785586    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"
Nov 02 22:13:30.795690 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:30.795661    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ec62fcf4-serving-cert\""
Nov 02 22:13:30.805575 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:30.805116    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:30.903395 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:30.903357    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:30.936889 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:30.936851    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzbrq\" (UniqueName: \"kubernetes.io/projected/91a92227-8553-41e1-a2ef-684757084e4e-kube-api-access-gzbrq\") pod \"maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28\" (UID: \"91a92227-8553-41e1-a2ef-684757084e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"
Nov 02 22:13:30.937055 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:30.936908    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91a92227-8553-41e1-a2ef-684757084e4e-openshift-service-ca\") pod \"maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28\" (UID: \"91a92227-8553-41e1-a2ef-684757084e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"
Nov 02 22:13:30.937055 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:30.936924    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91a92227-8553-41e1-a2ef-684757084e4e-metrics-certs\") pod \"maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28\" (UID: \"91a92227-8553-41e1-a2ef-684757084e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"
Nov 02 22:13:30.937233 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:30.937196    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91a92227-8553-41e1-a2ef-684757084e4e-maas-api-tls\") pod \"maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28\" (UID: \"91a92227-8553-41e1-a2ef-684757084e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"
Nov 02 22:13:31.007189 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:31.007104    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:31.038746 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:31.038705    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91a92227-8553-41e1-a2ef-684757084e4e-maas-api-tls\") pod \"maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28\" (UID: \"91a92227-8553-41e1-a2ef-684757084e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"
Nov 02 22:13:31.038945 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:31.038813    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzbrq\" (UniqueName: \"kubernetes.io/projected/91a92227-8553-41e1-a2ef-684757084e4e-kube-api-access-gzbrq\") pod \"maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28\" (UID: \"91a92227-8553-41e1-a2ef-684757084e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"
Nov 02 22:13:31.038945 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:31.038870    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91a92227-8553-41e1-a2ef-684757084e4e-openshift-service-ca\") pod \"maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28\" (UID: \"91a92227-8553-41e1-a2ef-684757084e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"
Nov 02 22:13:31.038945 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:31.038891    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91a92227-8553-41e1-a2ef-684757084e4e-metrics-certs\") pod \"maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28\" (UID: \"91a92227-8553-41e1-a2ef-684757084e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"
Nov 02 22:13:31.040439 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:31.040412    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91a92227-8553-41e1-a2ef-684757084e4e-openshift-service-ca\") pod \"maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28\" (UID: \"91a92227-8553-41e1-a2ef-684757084e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"
Nov 02 22:13:31.043173 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:31.043102    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91a92227-8553-41e1-a2ef-684757084e4e-maas-api-tls\") pod \"maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28\" (UID: \"91a92227-8553-41e1-a2ef-684757084e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"
Nov 02 22:13:31.043375 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:31.043107    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91a92227-8553-41e1-a2ef-684757084e4e-metrics-certs\") pod \"maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28\" (UID: \"91a92227-8553-41e1-a2ef-684757084e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"
Nov 02 22:13:31.051262 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:31.051195    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzbrq\" (UniqueName: \"kubernetes.io/projected/91a92227-8553-41e1-a2ef-684757084e4e-kube-api-access-gzbrq\") pod \"maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28\" (UID: \"91a92227-8553-41e1-a2ef-684757084e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"
Nov 02 22:13:31.111379 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:31.111333    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"
Nov 02 22:13:31.499644 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:31.499604    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"]
Nov 02 22:13:31.684194 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:31.684164    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:32.466295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:32.466207    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:32.490118 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:32.490084    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28" event={"ID":"91a92227-8553-41e1-a2ef-684757084e4e","Type":"ContainerStarted","Data":"292ec0b3112eed6b893c00b707c95bd940f0089f2b9e0a18e90dae71dbc8d190"}
Nov 02 22:13:32.490306 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:32.490145    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28" event={"ID":"91a92227-8553-41e1-a2ef-684757084e4e","Type":"ContainerStarted","Data":"939c663877b06843cc6b8f08e5a630e1ee4a811914256e076a340c55a72503f6"}
Nov 02 22:13:32.490306 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:32.490179    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"
Nov 02 22:13:32.507524 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:32.507475    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28" podStartSLOduration=1.98313156 podStartE2EDuration="2.507462079s" totalImagesPullingTime="524.330519ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:13:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:13:32.505738362 +0000 UTC m=+921.562072742" watchObservedRunningTime="2026-11-02 22:13:32.507462079 +0000 UTC m=+921.563796458"
Nov 02 22:13:33.193148 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:33.193085    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:33.589346 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:33.589263    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:33.966932 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:33.966897    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:34.684812 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:34.684777    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:35.378769 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:35.378733    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:35.990072 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:35.990037    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:36.744667 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:36.744632    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:38.761192 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:38.761158    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"
Nov 02 22:13:38.830598 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:38.829598    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:39.262531 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:39.262485    5076 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:39.635392 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:39.635352    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:13:39.636562 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:39.636520    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm" podUID="75affa76-6588-4026-bb96-573b65ea5ce8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:39.872372 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:39.857369    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:39.872372 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:39.858093    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:13:39.906420 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:39.906337    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:13:40.022242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:40.020370    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:40.031160 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:40.031124    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:40.315385 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:40.306419    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:13:40.315385 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:40.306512    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t" podUID="3b21b282-ae28-40c1-85f0-0edb6b1e40ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:40.315385 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:40.307808    5076 patch_prober.go:29] interesting pod/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:13:40.315385 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:40.307963    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr" podUID="5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:40.338029 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:40.337981    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:40.530740 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:40.529272    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:40.564386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:40.564306    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:40.595505 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:40.595394    5076 patch_prober.go:29] interesting pod/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:13:40.595781 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:40.595737    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w" podUID="ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:41.029346 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:41.029297    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:41.030652 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:41.030629    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:13:41.091463 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:41.091423    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:41.315304 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:41.299866    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:13:41.350359 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:41.350315    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Nov 02 22:13:41.375245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:41.351295    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:13:41.375245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:41.368384    5076 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:41.546242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:41.540902    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:41.546242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:41.541709    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:13:41.570573 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:41.570475    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:41.643327 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:41.585702    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:13:41.643327 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:41.592556    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:41.674271 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:41.651912    5076 patch_prober.go:29] interesting pod/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:13:41.674271 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:41.651982    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz" podUID="edb6e916-cc3b-40f3-8f88-80ec1411a271" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:41.676140 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:41.676090    5076 patch_prober.go:29] interesting pod/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:13:41.676420 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:41.676379    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8" podUID="3f07035a-2595-4005-8d5b-bfebe3775611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:42.074243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:42.023581    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": context deadline exceeded"
Nov 02 22:13:42.093283 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:42.030427    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:42.116139 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:42.116087    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:42.410923 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:42.410879    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Nov 02 22:13:42.477099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:42.477052    5076 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/health\": context deadline exceeded"
Nov 02 22:13:42.562588 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:42.562528    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Nov 02 22:13:42.582246 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:42.573294    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:42.770569 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:42.770485    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:13:42.854255 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:42.845593    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:13:43.137296 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:43.095210    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:13:43.323999 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:43.323966    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:13:43.324654 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:43.324636    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:13:43.459190 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:43.459108    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:13:43.587251 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:43.585152    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:43.831671 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:43.831545    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:44.182514 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:44.182468    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:44.477940 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:44.477837    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:45.391449 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:45.391414    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:45.771300 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:45.771184    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:45.868782 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:45.868741    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:45.971389 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:45.971351    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:46.119769 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:46.119723    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:46.980810 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:46.980772    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:47.408749 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:47.408709    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:47.831398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:47.831300    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:47.929149 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:47.929116    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:48.040505 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:48.034305    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:48.650188 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:48.650143    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:49.374736 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:49.374698    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:50.176512 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:50.176479    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:50.277063 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:50.277008    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:50.459831 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:50.459752    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:50.557614 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:50.557578    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:50.859165 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:50.859125    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:51.037255 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:51.035821    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:51.258022 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:51.257927    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:51.427170 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:51.427130    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:51.995967 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:51.995913    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:52.535766 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:52.535729    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:52.635100 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:52.635057    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:53.070654 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:53.070570    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:54.335573 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:54.335533    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:54.572780 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:54.572742    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:54.659915 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:54.659877    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:54.902763 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:54.902685    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:55.329360 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:55.328265    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:55.434246 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:55.433850    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:55.697702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:55.697669    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:55.926304 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:55.926263    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:55.931908 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:55.931882    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc"]
Nov 02 22:13:55.937501 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:55.937481    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc"
Nov 02 22:13:55.943729 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:55.943698    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-d47f8605-dockercfg-nd8fd\""
Nov 02 22:13:55.943878 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:55.943782    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-d47f8605\""
Nov 02 22:13:55.948916 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:55.948858    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc"]
Nov 02 22:13:56.045240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:56.036917    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92ccf4c8-837a-4299-89c1-7b5e97690a68-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc\" (UID: \"92ccf4c8-837a-4299-89c1-7b5e97690a68\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc"
Nov 02 22:13:56.045240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:56.037067    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7kxb\" (UniqueName: \"kubernetes.io/projected/92ccf4c8-837a-4299-89c1-7b5e97690a68-kube-api-access-n7kxb\") pod \"payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc\" (UID: \"92ccf4c8-837a-4299-89c1-7b5e97690a68\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc"
Nov 02 22:13:56.045240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:56.038020    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:56.158286 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:56.139273    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92ccf4c8-837a-4299-89c1-7b5e97690a68-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc\" (UID: \"92ccf4c8-837a-4299-89c1-7b5e97690a68\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc"
Nov 02 22:13:56.158286 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:56.145375    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7kxb\" (UniqueName: \"kubernetes.io/projected/92ccf4c8-837a-4299-89c1-7b5e97690a68-kube-api-access-n7kxb\") pod \"payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc\" (UID: \"92ccf4c8-837a-4299-89c1-7b5e97690a68\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc"
Nov 02 22:13:56.158286 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:56.146883    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92ccf4c8-837a-4299-89c1-7b5e97690a68-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc\" (UID: \"92ccf4c8-837a-4299-89c1-7b5e97690a68\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc"
Nov 02 22:13:56.163336 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:56.163305    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7kxb\" (UniqueName: \"kubernetes.io/projected/92ccf4c8-837a-4299-89c1-7b5e97690a68-kube-api-access-n7kxb\") pod \"payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc\" (UID: \"92ccf4c8-837a-4299-89c1-7b5e97690a68\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc"
Nov 02 22:13:56.236807 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:56.236715    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:56.262568 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:56.262527    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc"
Nov 02 22:13:56.493803 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:56.492811    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:56.659265 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:56.653832    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc"]
Nov 02 22:13:56.687451 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:56.687367    5076 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 22:13:56.713575 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:56.713390    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:57.017243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:57.012239    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:57.493955 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:57.493915    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:57.611630 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:57.605660    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc" event={"ID":"92ccf4c8-837a-4299-89c1-7b5e97690a68","Type":"ContainerStarted","Data":"526f0961654510b7abb0f4095aa3e57cb8a7d8a019c22babcc9fe8ac1aa50168"}
Nov 02 22:13:58.307046 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:58.307007    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:59.366931 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:59.366895    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:59.626171 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:59.626138    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc" event={"ID":"92ccf4c8-837a-4299-89c1-7b5e97690a68","Type":"ContainerStarted","Data":"e73b5051c9167093a245bf145a5c7178980bd38e62b25b0faae43234876a7403"}
Nov 02 22:13:59.626404 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:59.626277    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc"
Nov 02 22:13:59.645322 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:59.645269    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc" podStartSLOduration=2.023182963 podStartE2EDuration="4.64525333s" totalImagesPullingTime="2.622070367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:13:59.640495953 +0000 UTC m=+948.696830337" watchObservedRunningTime="2026-11-02 22:13:59.64525333 +0000 UTC m=+948.701587709"
Nov 02 22:13:59.773022 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:59.772982    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:13:59.876394 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:13:59.876292    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:00.014314 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:14:00.013380    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:14:00.449195 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.449159    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"]
Nov 02 22:14:00.456063 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.456034    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"
Nov 02 22:14:00.463449 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.463420    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"]
Nov 02 22:14:00.473240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.469008    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-8da3b70c-serving-cert\""
Nov 02 22:14:00.511907 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.511877    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:00.638102 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.638069    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-openshift-service-ca\") pod \"maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj\" (UID: \"2e95e9c2-58d9-4516-94ff-0b8c0b10985a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"
Nov 02 22:14:00.638359 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.638151    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-maas-api-tls\") pod \"maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj\" (UID: \"2e95e9c2-58d9-4516-94ff-0b8c0b10985a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"
Nov 02 22:14:00.638359 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.638300    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-metrics-certs\") pod \"maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj\" (UID: \"2e95e9c2-58d9-4516-94ff-0b8c0b10985a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"
Nov 02 22:14:00.638635 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.638595    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpdqk\" (UniqueName: \"kubernetes.io/projected/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-kube-api-access-cpdqk\") pod \"maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj\" (UID: \"2e95e9c2-58d9-4516-94ff-0b8c0b10985a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"
Nov 02 22:14:00.639717 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.639687    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:00.747345 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.744297    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:00.755037 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.755000    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-openshift-service-ca\") pod \"maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj\" (UID: \"2e95e9c2-58d9-4516-94ff-0b8c0b10985a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"
Nov 02 22:14:00.755287 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.755097    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-maas-api-tls\") pod \"maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj\" (UID: \"2e95e9c2-58d9-4516-94ff-0b8c0b10985a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"
Nov 02 22:14:00.755287 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.755188    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-metrics-certs\") pod \"maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj\" (UID: \"2e95e9c2-58d9-4516-94ff-0b8c0b10985a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"
Nov 02 22:14:00.755508 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.755416    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpdqk\" (UniqueName: \"kubernetes.io/projected/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-kube-api-access-cpdqk\") pod \"maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj\" (UID: \"2e95e9c2-58d9-4516-94ff-0b8c0b10985a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"
Nov 02 22:14:00.755999 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.755972    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-openshift-service-ca\") pod \"maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj\" (UID: \"2e95e9c2-58d9-4516-94ff-0b8c0b10985a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"
Nov 02 22:14:00.762776 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.759667    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-metrics-certs\") pod \"maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj\" (UID: \"2e95e9c2-58d9-4516-94ff-0b8c0b10985a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"
Nov 02 22:14:00.763654 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.763630    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-maas-api-tls\") pod \"maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj\" (UID: \"2e95e9c2-58d9-4516-94ff-0b8c0b10985a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"
Nov 02 22:14:00.790265 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.785779    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpdqk\" (UniqueName: \"kubernetes.io/projected/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-kube-api-access-cpdqk\") pod \"maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj\" (UID: \"2e95e9c2-58d9-4516-94ff-0b8c0b10985a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"
Nov 02 22:14:00.790708 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.790682    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"
Nov 02 22:14:00.926239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:00.923885    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:01.038510 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:01.038197    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:01.582944 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:14:01.559352    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e95e9c2_58d9_4516_94ff_0b8c0b10985a.slice/crio-695508a40774c0890ee6bc5b214fbe574fdfa872502732501db8732110dff36c WatchSource:0}: Error finding container 695508a40774c0890ee6bc5b214fbe574fdfa872502732501db8732110dff36c: Status 404 returned error can't find the container with id 695508a40774c0890ee6bc5b214fbe574fdfa872502732501db8732110dff36c
Nov 02 22:14:01.582944 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:01.575893    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"]
Nov 02 22:14:01.602351 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:01.586445    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:01.650971 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:01.646863    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj" event={"ID":"2e95e9c2-58d9-4516-94ff-0b8c0b10985a","Type":"ContainerStarted","Data":"695508a40774c0890ee6bc5b214fbe574fdfa872502732501db8732110dff36c"}
Nov 02 22:14:01.679907 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:01.679604    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:02.071499 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:02.071460    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:02.536147 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:02.536084    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:02.635093 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:02.635056    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:02.658462 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:02.658427    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj" event={"ID":"2e95e9c2-58d9-4516-94ff-0b8c0b10985a","Type":"ContainerStarted","Data":"7767831b780ca30d7bfae2589f2388b1ea5b4da0eea644b546d8a2c904ddbfca"}
Nov 02 22:14:02.658651 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:02.658485    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"
Nov 02 22:14:02.677750 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:02.677698    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj" podStartSLOduration=2.147785809 podStartE2EDuration="2.677681823s" totalImagesPullingTime="529.896014ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:14:02.673990622 +0000 UTC m=+951.730325003" watchObservedRunningTime="2026-11-02 22:14:02.677681823 +0000 UTC m=+951.734016202"
Nov 02 22:14:02.844270 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:02.844134    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"]
Nov 02 22:14:02.844801 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:02.844439    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28" podUID="91a92227-8553-41e1-a2ef-684757084e4e" containerName="maas-api" containerID="cri-o://292ec0b3112eed6b893c00b707c95bd940f0089f2b9e0a18e90dae71dbc8d190" gracePeriod=30
Nov 02 22:14:02.907243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:02.895707    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:03.417453 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.417007    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"
Nov 02 22:14:03.496790 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.496750    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/91a92227-8553-41e1-a2ef-684757084e4e-kube-api-access-gzbrq\" (UniqueName: \"kubernetes.io/projected/91a92227-8553-41e1-a2ef-684757084e4e-kube-api-access-gzbrq\") pod \"91a92227-8553-41e1-a2ef-684757084e4e\" (UID: \"91a92227-8553-41e1-a2ef-684757084e4e\") "
Nov 02 22:14:03.496988 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.496965    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/91a92227-8553-41e1-a2ef-684757084e4e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91a92227-8553-41e1-a2ef-684757084e4e-openshift-service-ca\") pod \"91a92227-8553-41e1-a2ef-684757084e4e\" (UID: \"91a92227-8553-41e1-a2ef-684757084e4e\") "
Nov 02 22:14:03.497055 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.497021    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/91a92227-8553-41e1-a2ef-684757084e4e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/91a92227-8553-41e1-a2ef-684757084e4e-metrics-certs\") pod \"91a92227-8553-41e1-a2ef-684757084e4e\" (UID: \"91a92227-8553-41e1-a2ef-684757084e4e\") "
Nov 02 22:14:03.497055 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.497042    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/91a92227-8553-41e1-a2ef-684757084e4e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91a92227-8553-41e1-a2ef-684757084e4e-maas-api-tls\") pod \"91a92227-8553-41e1-a2ef-684757084e4e\" (UID: \"91a92227-8553-41e1-a2ef-684757084e4e\") "
Nov 02 22:14:03.511276 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.498116    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91a92227-8553-41e1-a2ef-684757084e4e-openshift-service-ca" pod "91a92227-8553-41e1-a2ef-684757084e4e" (UID: "91a92227-8553-41e1-a2ef-684757084e4e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:14:03.511276 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.501774    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91a92227-8553-41e1-a2ef-684757084e4e-metrics-certs" pod "91a92227-8553-41e1-a2ef-684757084e4e" (UID: "91a92227-8553-41e1-a2ef-684757084e4e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:14:03.511276 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.501937    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91a92227-8553-41e1-a2ef-684757084e4e-kube-api-access-gzbrq" pod "91a92227-8553-41e1-a2ef-684757084e4e" (UID: "91a92227-8553-41e1-a2ef-684757084e4e"). InnerVolumeSpecName "kube-api-access-gzbrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:14:03.511276 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.501999    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91a92227-8553-41e1-a2ef-684757084e4e-maas-api-tls" pod "91a92227-8553-41e1-a2ef-684757084e4e" (UID: "91a92227-8553-41e1-a2ef-684757084e4e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:14:03.512066 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.511979    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:03.599468 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.599431    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91a92227-8553-41e1-a2ef-684757084e4e-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:03.599468 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.599470    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91a92227-8553-41e1-a2ef-684757084e4e-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:03.599771 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.599486    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzbrq\" (UniqueName: \"kubernetes.io/projected/91a92227-8553-41e1-a2ef-684757084e4e-kube-api-access-gzbrq\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:03.599771 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.599503    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91a92227-8553-41e1-a2ef-684757084e4e-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:03.604082 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.604049    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:03.690241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.678935    5076 generic.go:356] "Generic (PLEG): container finished" podID="91a92227-8553-41e1-a2ef-684757084e4e" containerID="292ec0b3112eed6b893c00b707c95bd940f0089f2b9e0a18e90dae71dbc8d190" exitCode=0
Nov 02 22:14:03.690241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.680136    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"
Nov 02 22:14:03.699292 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.691187    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28" event={"ID":"91a92227-8553-41e1-a2ef-684757084e4e","Type":"ContainerDied","Data":"292ec0b3112eed6b893c00b707c95bd940f0089f2b9e0a18e90dae71dbc8d190"}
Nov 02 22:14:03.699292 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.691274    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28" event={"ID":"91a92227-8553-41e1-a2ef-684757084e4e","Type":"ContainerDied","Data":"939c663877b06843cc6b8f08e5a630e1ee4a811914256e076a340c55a72503f6"}
Nov 02 22:14:03.699292 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.691310    5076 scope.go:122] "RemoveContainer" containerID="292ec0b3112eed6b893c00b707c95bd940f0089f2b9e0a18e90dae71dbc8d190"
Nov 02 22:14:03.716521 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.715869    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:03.738802 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.738354    5076 scope.go:122] "RemoveContainer" containerID="292ec0b3112eed6b893c00b707c95bd940f0089f2b9e0a18e90dae71dbc8d190"
Nov 02 22:14:03.738802 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:14:03.738729    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"292ec0b3112eed6b893c00b707c95bd940f0089f2b9e0a18e90dae71dbc8d190\": container with ID starting with 292ec0b3112eed6b893c00b707c95bd940f0089f2b9e0a18e90dae71dbc8d190 not found: ID does not exist" containerID="292ec0b3112eed6b893c00b707c95bd940f0089f2b9e0a18e90dae71dbc8d190"
Nov 02 22:14:03.738802 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.738765    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"292ec0b3112eed6b893c00b707c95bd940f0089f2b9e0a18e90dae71dbc8d190"} err="failed to get container status \"292ec0b3112eed6b893c00b707c95bd940f0089f2b9e0a18e90dae71dbc8d190\": rpc error: code = NotFound desc = could not find container \"292ec0b3112eed6b893c00b707c95bd940f0089f2b9e0a18e90dae71dbc8d190\": container with ID starting with 292ec0b3112eed6b893c00b707c95bd940f0089f2b9e0a18e90dae71dbc8d190 not found: ID does not exist"
Nov 02 22:14:03.752584 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.752557    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"]
Nov 02 22:14:03.759390 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.759363    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ec62fcf4-6bc97c6bf6-dvk28"]
Nov 02 22:14:03.813968 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:03.813705    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:04.396895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.396860    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:04.498694 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.498659    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:04.542276 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.542245    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"]
Nov 02 22:14:04.542943 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.542923    5076 cpu_manager.go:414] "containerMap: removing container" podUID="91a92227-8553-41e1-a2ef-684757084e4e" containerName="maas-api"
Nov 02 22:14:04.543020 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.542946    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="91a92227-8553-41e1-a2ef-684757084e4e" containerName="maas-api"
Nov 02 22:14:04.543128 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.543114    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="91a92227-8553-41e1-a2ef-684757084e4e" containerName="maas-api"
Nov 02 22:14:04.548564 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.548543    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"
Nov 02 22:14:04.553560 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.553537    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d47f8605-serving-cert\""
Nov 02 22:14:04.564744 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.563066    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"]
Nov 02 22:14:04.607663 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.607623    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:04.643568 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.643536    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0f154ab-91ad-4884-8d87-1f842b7ca30b-maas-api-tls\") pod \"maas-api-e2e-ait-d47f8605-5569f49985-vpg8z\" (UID: \"f0f154ab-91ad-4884-8d87-1f842b7ca30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"
Nov 02 22:14:04.643719 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.643677    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0f154ab-91ad-4884-8d87-1f842b7ca30b-metrics-certs\") pod \"maas-api-e2e-ait-d47f8605-5569f49985-vpg8z\" (UID: \"f0f154ab-91ad-4884-8d87-1f842b7ca30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"
Nov 02 22:14:04.643774 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.643714    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpq84\" (UniqueName: \"kubernetes.io/projected/f0f154ab-91ad-4884-8d87-1f842b7ca30b-kube-api-access-lpq84\") pod \"maas-api-e2e-ait-d47f8605-5569f49985-vpg8z\" (UID: \"f0f154ab-91ad-4884-8d87-1f842b7ca30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"
Nov 02 22:14:04.643868 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.643853    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0f154ab-91ad-4884-8d87-1f842b7ca30b-openshift-service-ca\") pod \"maas-api-e2e-ait-d47f8605-5569f49985-vpg8z\" (UID: \"f0f154ab-91ad-4884-8d87-1f842b7ca30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"
Nov 02 22:14:04.706165 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.706080    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:04.745004 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.744971    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0f154ab-91ad-4884-8d87-1f842b7ca30b-maas-api-tls\") pod \"maas-api-e2e-ait-d47f8605-5569f49985-vpg8z\" (UID: \"f0f154ab-91ad-4884-8d87-1f842b7ca30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"
Nov 02 22:14:04.745197 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.745095    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0f154ab-91ad-4884-8d87-1f842b7ca30b-metrics-certs\") pod \"maas-api-e2e-ait-d47f8605-5569f49985-vpg8z\" (UID: \"f0f154ab-91ad-4884-8d87-1f842b7ca30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"
Nov 02 22:14:04.745197 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.745140    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpq84\" (UniqueName: \"kubernetes.io/projected/f0f154ab-91ad-4884-8d87-1f842b7ca30b-kube-api-access-lpq84\") pod \"maas-api-e2e-ait-d47f8605-5569f49985-vpg8z\" (UID: \"f0f154ab-91ad-4884-8d87-1f842b7ca30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"
Nov 02 22:14:04.745338 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.745294    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0f154ab-91ad-4884-8d87-1f842b7ca30b-openshift-service-ca\") pod \"maas-api-e2e-ait-d47f8605-5569f49985-vpg8z\" (UID: \"f0f154ab-91ad-4884-8d87-1f842b7ca30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"
Nov 02 22:14:04.746394 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.746372    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0f154ab-91ad-4884-8d87-1f842b7ca30b-openshift-service-ca\") pod \"maas-api-e2e-ait-d47f8605-5569f49985-vpg8z\" (UID: \"f0f154ab-91ad-4884-8d87-1f842b7ca30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"
Nov 02 22:14:04.747925 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.747896    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0f154ab-91ad-4884-8d87-1f842b7ca30b-maas-api-tls\") pod \"maas-api-e2e-ait-d47f8605-5569f49985-vpg8z\" (UID: \"f0f154ab-91ad-4884-8d87-1f842b7ca30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"
Nov 02 22:14:04.755842 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.755811    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpq84\" (UniqueName: \"kubernetes.io/projected/f0f154ab-91ad-4884-8d87-1f842b7ca30b-kube-api-access-lpq84\") pod \"maas-api-e2e-ait-d47f8605-5569f49985-vpg8z\" (UID: \"f0f154ab-91ad-4884-8d87-1f842b7ca30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"
Nov 02 22:14:04.759997 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.758382    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0f154ab-91ad-4884-8d87-1f842b7ca30b-metrics-certs\") pod \"maas-api-e2e-ait-d47f8605-5569f49985-vpg8z\" (UID: \"f0f154ab-91ad-4884-8d87-1f842b7ca30b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"
Nov 02 22:14:04.871525 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:04.871490    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"
Nov 02 22:14:05.064823 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:05.064780    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="91a92227-8553-41e1-a2ef-684757084e4e" path="/var/lib/kubelet/pods/91a92227-8553-41e1-a2ef-684757084e4e/volumes"
Nov 02 22:14:05.099100 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:05.099052    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:05.207959 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:05.207878    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"]
Nov 02 22:14:05.208889 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:14:05.208854    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f154ab_91ad_4884_8d87_1f842b7ca30b.slice/crio-9ec612d48e45d0275531b856474708b6b3abad376042325e8e3d3d8cb35b7ee0 WatchSource:0}: Error finding container 9ec612d48e45d0275531b856474708b6b3abad376042325e8e3d3d8cb35b7ee0: Status 404 returned error can't find the container with id 9ec612d48e45d0275531b856474708b6b3abad376042325e8e3d3d8cb35b7ee0
Nov 02 22:14:05.336693 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:05.336621    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:05.741247 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:05.741069    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z" event={"ID":"f0f154ab-91ad-4884-8d87-1f842b7ca30b","Type":"ContainerStarted","Data":"9ec612d48e45d0275531b856474708b6b3abad376042325e8e3d3d8cb35b7ee0"}
Nov 02 22:14:06.102670 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:06.102632    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:06.762471 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:06.762427    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z" event={"ID":"f0f154ab-91ad-4884-8d87-1f842b7ca30b","Type":"ContainerStarted","Data":"79bd8c8531ff03d7686ee6b792dbf07653b366dde3b52fa9c1fe7a8760e6db0e"}
Nov 02 22:14:06.762973 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:06.762544    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"
Nov 02 22:14:06.781225 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:06.781164    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z" podStartSLOduration=2.328935852 podStartE2EDuration="2.781146655s" totalImagesPullingTime="452.210803ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:14:06.778946189 +0000 UTC m=+955.835280592" watchObservedRunningTime="2026-11-02 22:14:06.781146655 +0000 UTC m=+955.837481037"
Nov 02 22:14:06.997072 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:06.997030    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:07.682441 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:07.682400    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:08.220586 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:08.220548    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:08.320356 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:08.320319    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:08.545134 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:08.545032    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:08.637454 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:08.637420    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:08.687613 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:08.686291    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"
Nov 02 22:14:08.837402 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:08.831487    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:09.585992 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:09.585922    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:10.274241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:10.269323    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"]
Nov 02 22:14:10.278694 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:10.278663    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"]
Nov 02 22:14:10.279047 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:10.279027    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"
Nov 02 22:14:10.284819 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:10.284310    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:10.284819 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:10.284627    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-6a72dd63-serving-cert\""
Nov 02 22:14:10.372920 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:10.372887    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:10.443400 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:10.443354    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/511e242c-c8bb-45fb-8baa-d60bbf95f776-metrics-certs\") pod \"maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9\" (UID: \"511e242c-c8bb-45fb-8baa-d60bbf95f776\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"
Nov 02 22:14:10.443939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:10.443913    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/511e242c-c8bb-45fb-8baa-d60bbf95f776-maas-api-tls\") pod \"maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9\" (UID: \"511e242c-c8bb-45fb-8baa-d60bbf95f776\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"
Nov 02 22:14:10.446207 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:10.446171    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/511e242c-c8bb-45fb-8baa-d60bbf95f776-openshift-service-ca\") pod \"maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9\" (UID: \"511e242c-c8bb-45fb-8baa-d60bbf95f776\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"
Nov 02 22:14:10.446337 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:10.446241    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7q7h\" (UniqueName: \"kubernetes.io/projected/511e242c-c8bb-45fb-8baa-d60bbf95f776-kube-api-access-h7q7h\") pod \"maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9\" (UID: \"511e242c-c8bb-45fb-8baa-d60bbf95f776\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"
Nov 02 22:14:10.548491 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:10.548400    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/511e242c-c8bb-45fb-8baa-d60bbf95f776-maas-api-tls\") pod \"maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9\" (UID: \"511e242c-c8bb-45fb-8baa-d60bbf95f776\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"
Nov 02 22:14:10.548661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:10.548496    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/511e242c-c8bb-45fb-8baa-d60bbf95f776-openshift-service-ca\") pod \"maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9\" (UID: \"511e242c-c8bb-45fb-8baa-d60bbf95f776\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"
Nov 02 22:14:10.548661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:10.548537    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7q7h\" (UniqueName: \"kubernetes.io/projected/511e242c-c8bb-45fb-8baa-d60bbf95f776-kube-api-access-h7q7h\") pod \"maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9\" (UID: \"511e242c-c8bb-45fb-8baa-d60bbf95f776\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"
Nov 02 22:14:10.548661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:10.548627    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/511e242c-c8bb-45fb-8baa-d60bbf95f776-metrics-certs\") pod \"maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9\" (UID: \"511e242c-c8bb-45fb-8baa-d60bbf95f776\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"
Nov 02 22:14:10.548661 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:14:10.548541    5076 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-serving-cert: secret "maas-api-e2e-ait-6a72dd63-serving-cert" not found
Nov 02 22:14:10.548882 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:14:10.548735    5076 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/511e242c-c8bb-45fb-8baa-d60bbf95f776-maas-api-tls podName:511e242c-c8bb-45fb-8baa-d60bbf95f776 nodeName:}" failed. No retries permitted until 2026-11-02 22:14:11.048708704 +0000 UTC m=+960.105043076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/511e242c-c8bb-45fb-8baa-d60bbf95f776-maas-api-tls") pod "maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9" (UID: "511e242c-c8bb-45fb-8baa-d60bbf95f776") : secret "maas-api-e2e-ait-6a72dd63-serving-cert" not found
Nov 02 22:14:10.549351 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:10.549323    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/511e242c-c8bb-45fb-8baa-d60bbf95f776-openshift-service-ca\") pod \"maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9\" (UID: \"511e242c-c8bb-45fb-8baa-d60bbf95f776\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"
Nov 02 22:14:10.551345 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:10.551316    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/511e242c-c8bb-45fb-8baa-d60bbf95f776-metrics-certs\") pod \"maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9\" (UID: \"511e242c-c8bb-45fb-8baa-d60bbf95f776\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"
Nov 02 22:14:10.559362 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:10.559340    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7q7h\" (UniqueName: \"kubernetes.io/projected/511e242c-c8bb-45fb-8baa-d60bbf95f776-kube-api-access-h7q7h\") pod \"maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9\" (UID: \"511e242c-c8bb-45fb-8baa-d60bbf95f776\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"
Nov 02 22:14:10.640841 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:10.640792    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc"
Nov 02 22:14:10.666636 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:10.666600    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:11.089719 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.089684    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/511e242c-c8bb-45fb-8baa-d60bbf95f776-maas-api-tls\") pod \"maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9\" (UID: \"511e242c-c8bb-45fb-8baa-d60bbf95f776\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"
Nov 02 22:14:11.092285 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.092252    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/511e242c-c8bb-45fb-8baa-d60bbf95f776-maas-api-tls\") pod \"maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9\" (UID: \"511e242c-c8bb-45fb-8baa-d60bbf95f776\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"
Nov 02 22:14:11.164393 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.164353    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:11.204911 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.204884    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"
Nov 02 22:14:11.521626 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.521597    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"]
Nov 02 22:14:11.521728 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:14:11.521688    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod511e242c_c8bb_45fb_8baa_d60bbf95f776.slice/crio-882725cf3585a8d355ff4c8f58bb345cf2844a52665d80ba18dca59e367d5931 WatchSource:0}: Error finding container 882725cf3585a8d355ff4c8f58bb345cf2844a52665d80ba18dca59e367d5931: Status 404 returned error can't find the container with id 882725cf3585a8d355ff4c8f58bb345cf2844a52665d80ba18dca59e367d5931
Nov 02 22:14:11.747765 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.747689    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"]
Nov 02 22:14:11.754335 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.754312    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"
Nov 02 22:14:11.759272 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.759248    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-10852f9c-serving-cert\""
Nov 02 22:14:11.760792 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.760715    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"]
Nov 02 22:14:11.799853 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.799818    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:11.800425 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.800393    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfx8m\" (UniqueName: \"kubernetes.io/projected/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-kube-api-access-pfx8m\") pod \"maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt\" (UID: \"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"
Nov 02 22:14:11.800555 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.800443    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-openshift-service-ca\") pod \"maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt\" (UID: \"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"
Nov 02 22:14:11.800677 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.800651    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-metrics-certs\") pod \"maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt\" (UID: \"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"
Nov 02 22:14:11.800761 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.800733    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-maas-api-tls\") pod \"maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt\" (UID: \"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"
Nov 02 22:14:11.909737 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.907695    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-metrics-certs\") pod \"maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt\" (UID: \"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"
Nov 02 22:14:11.909737 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.907783    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-maas-api-tls\") pod \"maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt\" (UID: \"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"
Nov 02 22:14:11.909737 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.908014    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfx8m\" (UniqueName: \"kubernetes.io/projected/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-kube-api-access-pfx8m\") pod \"maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt\" (UID: \"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"
Nov 02 22:14:11.909737 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.908047    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-openshift-service-ca\") pod \"maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt\" (UID: \"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"
Nov 02 22:14:11.909737 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.908966    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-openshift-service-ca\") pod \"maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt\" (UID: \"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"
Nov 02 22:14:11.912523 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.912353    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:11.924732 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.923362    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-maas-api-tls\") pod \"maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt\" (UID: \"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"
Nov 02 22:14:11.927887 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.927858    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-metrics-certs\") pod \"maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt\" (UID: \"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"
Nov 02 22:14:11.930154 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.930061    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfx8m\" (UniqueName: \"kubernetes.io/projected/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-kube-api-access-pfx8m\") pod \"maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt\" (UID: \"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"
Nov 02 22:14:11.966248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.966177    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9" event={"ID":"511e242c-c8bb-45fb-8baa-d60bbf95f776","Type":"ContainerStarted","Data":"882725cf3585a8d355ff4c8f58bb345cf2844a52665d80ba18dca59e367d5931"}
Nov 02 22:14:11.999582 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:11.999463    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:12.083009 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:12.082546    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"
Nov 02 22:14:12.548430 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:12.543516    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"]
Nov 02 22:14:12.778894 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:12.778865    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"
Nov 02 22:14:12.864738 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:12.864703    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:12.980974 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:12.980938    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt" event={"ID":"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a","Type":"ContainerStarted","Data":"c073730573c0ef3140ed9cd6207a89fbe47e3a34915948369c0b512dfadc28f4"}
Nov 02 22:14:12.982845 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:12.982809    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9" event={"ID":"511e242c-c8bb-45fb-8baa-d60bbf95f776","Type":"ContainerStarted","Data":"6058f4596dea7aab2f43401ca06c9044904d766948c0451ac99f0cf34c589a7b"}
Nov 02 22:14:12.982987 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:12.982935    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"
Nov 02 22:14:12.999378 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:12.999325    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9" podStartSLOduration=2.500033648 podStartE2EDuration="2.99931046s" totalImagesPullingTime="499.276812ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:14:12.998260231 +0000 UTC m=+962.054594613" watchObservedRunningTime="2026-11-02 22:14:12.99931046 +0000 UTC m=+962.055644841"
Nov 02 22:14:13.605868 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:13.605832    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:13.992493 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:13.992407    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt" event={"ID":"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a","Type":"ContainerStarted","Data":"6d38c87631744783cc1fff73fb9a7ded17acdede0f078aeac6bf68791017b57e"}
Nov 02 22:14:13.992881 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:13.992508    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"
Nov 02 22:14:14.546415 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:14.546383    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:15.373402 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:15.373367    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:16.276895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:16.276860    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:17.493244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:17.489323    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:17.929240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:17.915328    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:18.124392 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:18.124339    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:18.300301 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:18.283680    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:18.589517 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:18.589415    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:18.736242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:18.687848    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:18.860303 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:18.830665    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:14:18.866912 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:18.866304    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:18.937241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:18.936543    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt" podStartSLOduration=7.470781448 podStartE2EDuration="7.936521056s" totalImagesPullingTime="465.739608ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:14:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:14:14.013087646 +0000 UTC m=+963.069422027" watchObservedRunningTime="2026-11-02 22:14:18.936521056 +0000 UTC m=+967.992855437"
Nov 02 22:14:19.191773 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:19.191672    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:19.284510 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:19.284464    5076 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:19.285325 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:19.285292    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:19.288392 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:19.288368    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"
Nov 02 22:14:19.288587 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:19.288571    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:14:19.308406 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:19.308379    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:14:19.801355 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:19.801306    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:19.849480 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:19.849433    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:19.850285 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:19.850253    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:14:20.000246 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:19.980162    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Nov 02 22:14:20.000246 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:19.980665    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:14:20.168264 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:20.168234    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"
Nov 02 22:14:20.292095 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:20.292049    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": context deadline exceeded"
Nov 02 22:14:20.316073 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:20.316048    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:14:20.318110 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:20.318078    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Nov 02 22:14:20.953622 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:20.900434    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:14:21.159381 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:20.907359    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:21.235782 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:20.985128    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:21.892405 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:21.892326    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Nov 02 22:14:21.907243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:21.893212    5076 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/health\": context deadline exceeded"
Nov 02 22:14:21.924246 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:21.909012    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:22.147301 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:22.147110    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:22.349266 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:22.332741    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:22.349884 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:22.349828    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Nov 02 22:14:22.711242 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:14:22.706498    5076 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.411s"
Nov 02 22:14:23.566741 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:23.565499    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:23.574254 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:23.569701    5076 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:23.574254 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:23.569791    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:23.574254 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:23.570058    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:23.671241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:23.670306    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:23.671241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:23.670770    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.60:8000/ready\": context deadline exceeded"
Nov 02 22:14:23.719728 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:23.709553    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:14:23.719728 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:23.709627    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:14:23.719728 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:23.709666    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:14:23.960874 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:23.960834    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:14:24.193244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:24.188429    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:24.290317 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:24.284432    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:24.565298 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:24.554297    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:24.696129 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:24.575386    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:14:24.696129 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:24.576339    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:14:24.696129 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:24.685897    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Nov 02 22:14:25.163779 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:25.163750    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:14:25.180333 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:25.180308    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:14:25.644896 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:25.644860    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"]
Nov 02 22:14:25.654349 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:25.654311    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"
Nov 02 22:14:25.657512 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:25.657488    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"]
Nov 02 22:14:25.673275 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:25.673207    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-bb16f94c-serving-cert\""
Nov 02 22:14:25.742710 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:25.742676    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:25.744468 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:25.744433    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmbsh\" (UniqueName: \"kubernetes.io/projected/ebe9a79d-af76-444c-b55d-2444753d650b-kube-api-access-nmbsh\") pod \"maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc\" (UID: \"ebe9a79d-af76-444c-b55d-2444753d650b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"
Nov 02 22:14:25.744624 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:25.744604    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebe9a79d-af76-444c-b55d-2444753d650b-openshift-service-ca\") pod \"maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc\" (UID: \"ebe9a79d-af76-444c-b55d-2444753d650b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"
Nov 02 22:14:25.744708 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:25.744688    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebe9a79d-af76-444c-b55d-2444753d650b-metrics-certs\") pod \"maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc\" (UID: \"ebe9a79d-af76-444c-b55d-2444753d650b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"
Nov 02 22:14:25.744887 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:25.744870    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebe9a79d-af76-444c-b55d-2444753d650b-maas-api-tls\") pod \"maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc\" (UID: \"ebe9a79d-af76-444c-b55d-2444753d650b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"
Nov 02 22:14:25.853237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:25.847914    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmbsh\" (UniqueName: \"kubernetes.io/projected/ebe9a79d-af76-444c-b55d-2444753d650b-kube-api-access-nmbsh\") pod \"maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc\" (UID: \"ebe9a79d-af76-444c-b55d-2444753d650b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"
Nov 02 22:14:25.853237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:25.848046    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebe9a79d-af76-444c-b55d-2444753d650b-openshift-service-ca\") pod \"maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc\" (UID: \"ebe9a79d-af76-444c-b55d-2444753d650b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"
Nov 02 22:14:25.853237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:25.848093    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebe9a79d-af76-444c-b55d-2444753d650b-metrics-certs\") pod \"maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc\" (UID: \"ebe9a79d-af76-444c-b55d-2444753d650b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"
Nov 02 22:14:25.853237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:25.848293    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebe9a79d-af76-444c-b55d-2444753d650b-maas-api-tls\") pod \"maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc\" (UID: \"ebe9a79d-af76-444c-b55d-2444753d650b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"
Nov 02 22:14:25.853237 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:14:25.848490    5076 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-serving-cert: secret "maas-api-e2e-migrate-bb16f94c-serving-cert" not found
Nov 02 22:14:25.853237 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:14:25.848568    5076 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebe9a79d-af76-444c-b55d-2444753d650b-maas-api-tls podName:ebe9a79d-af76-444c-b55d-2444753d650b nodeName:}" failed. No retries permitted until 2026-11-02 22:14:26.348543921 +0000 UTC m=+975.404878285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ebe9a79d-af76-444c-b55d-2444753d650b-maas-api-tls") pod "maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc" (UID: "ebe9a79d-af76-444c-b55d-2444753d650b") : secret "maas-api-e2e-migrate-bb16f94c-serving-cert" not found
Nov 02 22:14:25.853237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:25.849714    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebe9a79d-af76-444c-b55d-2444753d650b-openshift-service-ca\") pod \"maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc\" (UID: \"ebe9a79d-af76-444c-b55d-2444753d650b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"
Nov 02 22:14:25.858088 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:25.858057    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:25.866459 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:25.866398    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmbsh\" (UniqueName: \"kubernetes.io/projected/ebe9a79d-af76-444c-b55d-2444753d650b-kube-api-access-nmbsh\") pod \"maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc\" (UID: \"ebe9a79d-af76-444c-b55d-2444753d650b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"
Nov 02 22:14:25.867402 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:25.867381    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebe9a79d-af76-444c-b55d-2444753d650b-metrics-certs\") pod \"maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc\" (UID: \"ebe9a79d-af76-444c-b55d-2444753d650b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"
Nov 02 22:14:25.969577 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:25.969494    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:26.366433 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:26.362199    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebe9a79d-af76-444c-b55d-2444753d650b-maas-api-tls\") pod \"maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc\" (UID: \"ebe9a79d-af76-444c-b55d-2444753d650b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"
Nov 02 22:14:26.397053 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:26.396282    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebe9a79d-af76-444c-b55d-2444753d650b-maas-api-tls\") pod \"maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc\" (UID: \"ebe9a79d-af76-444c-b55d-2444753d650b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"
Nov 02 22:14:26.599459 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:26.599416    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"
Nov 02 22:14:26.693066 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:26.693028    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:26.982947 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:26.982916    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"]
Nov 02 22:14:26.985062 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:14:26.985035    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebe9a79d_af76_444c_b55d_2444753d650b.slice/crio-d86dbbe2596bbf56a5059ce458edc3121f71bb9e2276d7ce319fc6e4509136aa WatchSource:0}: Error finding container d86dbbe2596bbf56a5059ce458edc3121f71bb9e2276d7ce319fc6e4509136aa: Status 404 returned error can't find the container with id d86dbbe2596bbf56a5059ce458edc3121f71bb9e2276d7ce319fc6e4509136aa
Nov 02 22:14:27.178910 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:27.178880    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc" event={"ID":"ebe9a79d-af76-444c-b55d-2444753d650b","Type":"ContainerStarted","Data":"d86dbbe2596bbf56a5059ce458edc3121f71bb9e2276d7ce319fc6e4509136aa"}
Nov 02 22:14:27.583167 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:27.583132    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:28.192818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:28.192776    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc" event={"ID":"ebe9a79d-af76-444c-b55d-2444753d650b","Type":"ContainerStarted","Data":"757e7986585b3278be4fc8c4b464c492811b5c5f854a5ba3b90b0e41c45307e8"}
Nov 02 22:14:28.193459 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:28.193149    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"
Nov 02 22:14:28.200499 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:28.200466    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:28.212846 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:28.212799    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc" podStartSLOduration=2.787361804 podStartE2EDuration="3.212786637s" totalImagesPullingTime="425.424833ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:14:28.209481248 +0000 UTC m=+977.265815625" watchObservedRunningTime="2026-11-02 22:14:28.212786637 +0000 UTC m=+977.269121031"
Nov 02 22:14:29.000874 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:29.000838    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:29.902436 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:14:29.902395    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:14:29.991540 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:29.991502    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:30.321809 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.321730    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"]
Nov 02 22:14:30.326848 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.326824    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.337771 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.337748    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"]
Nov 02 22:14:30.495184 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.495143    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-626q2\" (UniqueName: \"kubernetes.io/projected/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-kube-api-access-626q2\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.495397 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.495336    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.495397 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.495390    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.495542 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.495518    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.495636 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.495621    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.495763 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.495742    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.495812 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.495775    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.596902 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.596815    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.597077 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.596900    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.597077 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.596961    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.597077 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.597050    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.597255 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.597177    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.597255 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.597229    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.597366 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.597320    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-626q2\" (UniqueName: \"kubernetes.io/projected/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-kube-api-access-626q2\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.598000 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.597970    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.599476 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.599445    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.599584 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.599489    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.599584 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.599542    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.599584 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.599555    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.604527 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.604506    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.606708 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.606684    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-626q2\" (UniqueName: \"kubernetes.io/projected/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-kube-api-access-626q2\") pod \"istiod-openshift-gateway-7ddd9cfdc8-d5mx9\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.642436 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.642410    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:30.860990 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.860961    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:30.971516 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.971482    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"]
Nov 02 22:14:30.976586 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:14:30.976558    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb7c9431_656a_4ff5_9ee6_bbdf456ec5fa.slice/crio-a56e09fc948512bd62be040a47ff8d7a8e922a0291a8c913b8ca05731c7baf25 WatchSource:0}: Error finding container a56e09fc948512bd62be040a47ff8d7a8e922a0291a8c913b8ca05731c7baf25: Status 404 returned error can't find the container with id a56e09fc948512bd62be040a47ff8d7a8e922a0291a8c913b8ca05731c7baf25
Nov 02 22:14:30.982511 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.982472    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:14:30.982597 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:30.982543    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:14:31.226120 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:31.226026    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9" event={"ID":"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa","Type":"ContainerStarted","Data":"324dbfef0855bfd9bb9972e75f4e66435ff2e16d73a1a141a87c50ee5b80186e"}
Nov 02 22:14:31.226120 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:31.226088    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:31.226120 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:31.226103    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9" event={"ID":"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa","Type":"ContainerStarted","Data":"a56e09fc948512bd62be040a47ff8d7a8e922a0291a8c913b8ca05731c7baf25"}
Nov 02 22:14:31.247700 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:31.247648    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9" podStartSLOduration=1.247634686 podStartE2EDuration="1.247634686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:14:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:14:31.243931464 +0000 UTC m=+980.300265843" watchObservedRunningTime="2026-11-02 22:14:31.247634686 +0000 UTC m=+980.303969076"
Nov 02 22:14:31.960402 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:31.960363    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:32.239020 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:32.238942    5076 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-d5mx9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 22:14:32.239020 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:32.238997    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9" podUID="db7c9431-656a-4ff5-9ee6-bbdf456ec5fa" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 22:14:33.043916 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:33.043886    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:33.630151 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:33.630112    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:34.078253 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:34.078128    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:34.212377 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:34.212344    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"
Nov 02 22:14:34.963907 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:34.963873    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:35.063897 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:35.063859    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:35.237967 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:35.237881    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:14:35.790763 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:35.790721    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:35.963858 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:35.963811    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:36.518971 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:36.518936    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:36.616362 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:36.616325    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:36.736244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:36.732306    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:36.883389 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:36.883302    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:37.475694 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:37.475649    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:37.798174 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:37.798070    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:38.437496 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:38.437433    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:39.171635 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:39.171603    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:39.767912 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:39.767869    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:40.466119 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:40.466082    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:41.060339 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:41.060308    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:41.580008 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:41.579968    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc"]
Nov 02 22:14:41.631245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:41.631195    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:41.731464 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:41.731430    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:41.839086 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:41.839001    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:42.270771 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:42.270736    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"]
Nov 02 22:14:42.271360 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:42.271315    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj" podUID="2e95e9c2-58d9-4516-94ff-0b8c0b10985a" containerName="maas-api" containerID="cri-o://7767831b780ca30d7bfae2589f2388b1ea5b4da0eea644b546d8a2c904ddbfca" gracePeriod=30
Nov 02 22:14:42.305618 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:42.305587    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:42.662740 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:42.660997    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:42.821937 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:42.820434    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:42.906093 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:42.906067    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"
Nov 02 22:14:42.944061 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:42.943979    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:42.999236 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:42.999182    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-kube-api-access-cpdqk\" (UniqueName: \"kubernetes.io/projected/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-kube-api-access-cpdqk\") pod \"2e95e9c2-58d9-4516-94ff-0b8c0b10985a\" (UID: \"2e95e9c2-58d9-4516-94ff-0b8c0b10985a\") "
Nov 02 22:14:42.999429 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:42.999316    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-maas-api-tls\") pod \"2e95e9c2-58d9-4516-94ff-0b8c0b10985a\" (UID: \"2e95e9c2-58d9-4516-94ff-0b8c0b10985a\") "
Nov 02 22:14:42.999429 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:42.999410    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-metrics-certs\") pod \"2e95e9c2-58d9-4516-94ff-0b8c0b10985a\" (UID: \"2e95e9c2-58d9-4516-94ff-0b8c0b10985a\") "
Nov 02 22:14:42.999559 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:42.999512    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-openshift-service-ca\") pod \"2e95e9c2-58d9-4516-94ff-0b8c0b10985a\" (UID: \"2e95e9c2-58d9-4516-94ff-0b8c0b10985a\") "
Nov 02 22:14:43.001232 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:43.001187    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-openshift-service-ca" pod "2e95e9c2-58d9-4516-94ff-0b8c0b10985a" (UID: "2e95e9c2-58d9-4516-94ff-0b8c0b10985a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:14:43.014986 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:43.014954    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-maas-api-tls" pod "2e95e9c2-58d9-4516-94ff-0b8c0b10985a" (UID: "2e95e9c2-58d9-4516-94ff-0b8c0b10985a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:14:43.015167 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:43.015138    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-metrics-certs" pod "2e95e9c2-58d9-4516-94ff-0b8c0b10985a" (UID: "2e95e9c2-58d9-4516-94ff-0b8c0b10985a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:14:43.015501 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:43.015478    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-kube-api-access-cpdqk" pod "2e95e9c2-58d9-4516-94ff-0b8c0b10985a" (UID: "2e95e9c2-58d9-4516-94ff-0b8c0b10985a"). InnerVolumeSpecName "kube-api-access-cpdqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:14:43.042889 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:43.042857    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:43.127797 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:43.112772    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:43.127797 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:43.112811    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpdqk\" (UniqueName: \"kubernetes.io/projected/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-kube-api-access-cpdqk\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:43.127797 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:43.112829    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:43.127797 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:43.112843    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e95e9c2-58d9-4516-94ff-0b8c0b10985a-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:43.340274 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:43.340143    5076 generic.go:356] "Generic (PLEG): container finished" podID="2e95e9c2-58d9-4516-94ff-0b8c0b10985a" containerID="7767831b780ca30d7bfae2589f2388b1ea5b4da0eea644b546d8a2c904ddbfca" exitCode=0
Nov 02 22:14:43.340274 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:43.340194    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"
Nov 02 22:14:43.340274 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:43.340208    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj" event={"ID":"2e95e9c2-58d9-4516-94ff-0b8c0b10985a","Type":"ContainerDied","Data":"7767831b780ca30d7bfae2589f2388b1ea5b4da0eea644b546d8a2c904ddbfca"}
Nov 02 22:14:43.340554 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:43.340295    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj" event={"ID":"2e95e9c2-58d9-4516-94ff-0b8c0b10985a","Type":"ContainerDied","Data":"695508a40774c0890ee6bc5b214fbe574fdfa872502732501db8732110dff36c"}
Nov 02 22:14:43.340554 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:43.340319    5076 scope.go:122] "RemoveContainer" containerID="7767831b780ca30d7bfae2589f2388b1ea5b4da0eea644b546d8a2c904ddbfca"
Nov 02 22:14:43.352930 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:43.352900    5076 scope.go:122] "RemoveContainer" containerID="7767831b780ca30d7bfae2589f2388b1ea5b4da0eea644b546d8a2c904ddbfca"
Nov 02 22:14:43.353288 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:14:43.353204    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7767831b780ca30d7bfae2589f2388b1ea5b4da0eea644b546d8a2c904ddbfca\": container with ID starting with 7767831b780ca30d7bfae2589f2388b1ea5b4da0eea644b546d8a2c904ddbfca not found: ID does not exist" containerID="7767831b780ca30d7bfae2589f2388b1ea5b4da0eea644b546d8a2c904ddbfca"
Nov 02 22:14:43.353288 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:43.353250    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7767831b780ca30d7bfae2589f2388b1ea5b4da0eea644b546d8a2c904ddbfca"} err="failed to get container status \"7767831b780ca30d7bfae2589f2388b1ea5b4da0eea644b546d8a2c904ddbfca\": rpc error: code = NotFound desc = could not find container \"7767831b780ca30d7bfae2589f2388b1ea5b4da0eea644b546d8a2c904ddbfca\": container with ID starting with 7767831b780ca30d7bfae2589f2388b1ea5b4da0eea644b546d8a2c904ddbfca not found: ID does not exist"
Nov 02 22:14:43.361744 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:43.361722    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"]
Nov 02 22:14:43.365864 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:43.365839    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8da3b70c-6f5f74794b-xxkqj"]
Nov 02 22:14:43.474997 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:43.474960    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:43.912303 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:43.912258    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:44.024907 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:44.024860    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:44.494331 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:44.492591    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"]
Nov 02 22:14:44.494331 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:44.492832    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z" podUID="f0f154ab-91ad-4884-8d87-1f842b7ca30b" containerName="maas-api" containerID="cri-o://79bd8c8531ff03d7686ee6b792dbf07653b366dde3b52fa9c1fe7a8760e6db0e" gracePeriod=30
Nov 02 22:14:44.515411 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:44.508517    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:44.700819 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:44.696518    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:45.026053 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.025957    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:45.074302 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.064486    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e95e9c2-58d9-4516-94ff-0b8c0b10985a" path="/var/lib/kubelet/pods/2e95e9c2-58d9-4516-94ff-0b8c0b10985a/volumes"
Nov 02 22:14:45.091594 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.091562    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"
Nov 02 22:14:45.123764 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.123728    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:45.173790 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.173759    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f0f154ab-91ad-4884-8d87-1f842b7ca30b-kube-api-access-lpq84\" (UniqueName: \"kubernetes.io/projected/f0f154ab-91ad-4884-8d87-1f842b7ca30b-kube-api-access-lpq84\") pod \"f0f154ab-91ad-4884-8d87-1f842b7ca30b\" (UID: \"f0f154ab-91ad-4884-8d87-1f842b7ca30b\") "
Nov 02 22:14:45.173985 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.173932    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f0f154ab-91ad-4884-8d87-1f842b7ca30b-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0f154ab-91ad-4884-8d87-1f842b7ca30b-openshift-service-ca\") pod \"f0f154ab-91ad-4884-8d87-1f842b7ca30b\" (UID: \"f0f154ab-91ad-4884-8d87-1f842b7ca30b\") "
Nov 02 22:14:45.174056 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.173997    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f0f154ab-91ad-4884-8d87-1f842b7ca30b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0f154ab-91ad-4884-8d87-1f842b7ca30b-metrics-certs\") pod \"f0f154ab-91ad-4884-8d87-1f842b7ca30b\" (UID: \"f0f154ab-91ad-4884-8d87-1f842b7ca30b\") "
Nov 02 22:14:45.174120 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.174080    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f0f154ab-91ad-4884-8d87-1f842b7ca30b-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0f154ab-91ad-4884-8d87-1f842b7ca30b-maas-api-tls\") pod \"f0f154ab-91ad-4884-8d87-1f842b7ca30b\" (UID: \"f0f154ab-91ad-4884-8d87-1f842b7ca30b\") "
Nov 02 22:14:45.175407 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.175372    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0f154ab-91ad-4884-8d87-1f842b7ca30b-openshift-service-ca" pod "f0f154ab-91ad-4884-8d87-1f842b7ca30b" (UID: "f0f154ab-91ad-4884-8d87-1f842b7ca30b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:14:45.178912 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.178882    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0f154ab-91ad-4884-8d87-1f842b7ca30b-maas-api-tls" pod "f0f154ab-91ad-4884-8d87-1f842b7ca30b" (UID: "f0f154ab-91ad-4884-8d87-1f842b7ca30b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:14:45.179053 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.178970    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0f154ab-91ad-4884-8d87-1f842b7ca30b-metrics-certs" pod "f0f154ab-91ad-4884-8d87-1f842b7ca30b" (UID: "f0f154ab-91ad-4884-8d87-1f842b7ca30b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:14:45.179118 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.179077    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0f154ab-91ad-4884-8d87-1f842b7ca30b-kube-api-access-lpq84" pod "f0f154ab-91ad-4884-8d87-1f842b7ca30b" (UID: "f0f154ab-91ad-4884-8d87-1f842b7ca30b"). InnerVolumeSpecName "kube-api-access-lpq84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:14:45.276269 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.276201    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpq84\" (UniqueName: \"kubernetes.io/projected/f0f154ab-91ad-4884-8d87-1f842b7ca30b-kube-api-access-lpq84\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:45.276269 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.276272    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0f154ab-91ad-4884-8d87-1f842b7ca30b-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:45.276494 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.276283    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0f154ab-91ad-4884-8d87-1f842b7ca30b-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:45.276494 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.276293    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0f154ab-91ad-4884-8d87-1f842b7ca30b-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:45.359155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.359118    5076 generic.go:356] "Generic (PLEG): container finished" podID="f0f154ab-91ad-4884-8d87-1f842b7ca30b" containerID="79bd8c8531ff03d7686ee6b792dbf07653b366dde3b52fa9c1fe7a8760e6db0e" exitCode=0
Nov 02 22:14:45.359355 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.359163    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"
Nov 02 22:14:45.359355 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.359197    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z" event={"ID":"f0f154ab-91ad-4884-8d87-1f842b7ca30b","Type":"ContainerDied","Data":"79bd8c8531ff03d7686ee6b792dbf07653b366dde3b52fa9c1fe7a8760e6db0e"}
Nov 02 22:14:45.359355 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.359294    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z" event={"ID":"f0f154ab-91ad-4884-8d87-1f842b7ca30b","Type":"ContainerDied","Data":"9ec612d48e45d0275531b856474708b6b3abad376042325e8e3d3d8cb35b7ee0"}
Nov 02 22:14:45.359355 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.359325    5076 scope.go:122] "RemoveContainer" containerID="79bd8c8531ff03d7686ee6b792dbf07653b366dde3b52fa9c1fe7a8760e6db0e"
Nov 02 22:14:45.371209 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.371197    5076 scope.go:122] "RemoveContainer" containerID="79bd8c8531ff03d7686ee6b792dbf07653b366dde3b52fa9c1fe7a8760e6db0e"
Nov 02 22:14:45.371631 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:14:45.371608    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79bd8c8531ff03d7686ee6b792dbf07653b366dde3b52fa9c1fe7a8760e6db0e\": container with ID starting with 79bd8c8531ff03d7686ee6b792dbf07653b366dde3b52fa9c1fe7a8760e6db0e not found: ID does not exist" containerID="79bd8c8531ff03d7686ee6b792dbf07653b366dde3b52fa9c1fe7a8760e6db0e"
Nov 02 22:14:45.371733 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.371636    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79bd8c8531ff03d7686ee6b792dbf07653b366dde3b52fa9c1fe7a8760e6db0e"} err="failed to get container status \"79bd8c8531ff03d7686ee6b792dbf07653b366dde3b52fa9c1fe7a8760e6db0e\": rpc error: code = NotFound desc = could not find container \"79bd8c8531ff03d7686ee6b792dbf07653b366dde3b52fa9c1fe7a8760e6db0e\": container with ID starting with 79bd8c8531ff03d7686ee6b792dbf07653b366dde3b52fa9c1fe7a8760e6db0e not found: ID does not exist"
Nov 02 22:14:45.383697 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.383674    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"]
Nov 02 22:14:45.389057 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.389036    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d47f8605-5569f49985-vpg8z"]
Nov 02 22:14:45.691614 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:45.691512    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:46.162297 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:46.162264    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:46.555936 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:46.555845    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:46.580850 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:46.580810    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc" podUID="92ccf4c8-837a-4299-89c1-7b5e97690a68" containerName="payload-pre-processing" containerID="cri-o://e73b5051c9167093a245bf145a5c7178980bd38e62b25b0faae43234876a7403" gracePeriod=25
Nov 02 22:14:46.657697 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:46.657664    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:46.823197 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:46.822806    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:46.927062 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:46.926884    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:46.954933 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:46.954832    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc"
Nov 02 22:14:47.020662 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:47.020615    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/92ccf4c8-837a-4299-89c1-7b5e97690a68-kube-api-access-n7kxb\" (UniqueName: \"kubernetes.io/projected/92ccf4c8-837a-4299-89c1-7b5e97690a68-kube-api-access-n7kxb\") pod \"92ccf4c8-837a-4299-89c1-7b5e97690a68\" (UID: \"92ccf4c8-837a-4299-89c1-7b5e97690a68\") "
Nov 02 22:14:47.020825 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:47.020738    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92ccf4c8-837a-4299-89c1-7b5e97690a68-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92ccf4c8-837a-4299-89c1-7b5e97690a68-plugins-config-volume\") pod \"92ccf4c8-837a-4299-89c1-7b5e97690a68\" (UID: \"92ccf4c8-837a-4299-89c1-7b5e97690a68\") "
Nov 02 22:14:47.022029 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:47.021992    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92ccf4c8-837a-4299-89c1-7b5e97690a68-plugins-config-volume" pod "92ccf4c8-837a-4299-89c1-7b5e97690a68" (UID: "92ccf4c8-837a-4299-89c1-7b5e97690a68"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:14:47.024530 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:47.024500    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92ccf4c8-837a-4299-89c1-7b5e97690a68-kube-api-access-n7kxb" pod "92ccf4c8-837a-4299-89c1-7b5e97690a68" (UID: "92ccf4c8-837a-4299-89c1-7b5e97690a68"). InnerVolumeSpecName "kube-api-access-n7kxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:14:47.078286 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:47.068422    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f0f154ab-91ad-4884-8d87-1f842b7ca30b" path="/var/lib/kubelet/pods/f0f154ab-91ad-4884-8d87-1f842b7ca30b/volumes"
Nov 02 22:14:47.129825 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:47.129091    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7kxb\" (UniqueName: \"kubernetes.io/projected/92ccf4c8-837a-4299-89c1-7b5e97690a68-kube-api-access-n7kxb\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:47.130054 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:47.130033    5076 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92ccf4c8-837a-4299-89c1-7b5e97690a68-plugins-config-volume\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:47.394566 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:47.394499    5076 generic.go:356] "Generic (PLEG): container finished" podID="92ccf4c8-837a-4299-89c1-7b5e97690a68" containerID="e73b5051c9167093a245bf145a5c7178980bd38e62b25b0faae43234876a7403" exitCode=0
Nov 02 22:14:47.395068 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:47.394706    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc" event={"ID":"92ccf4c8-837a-4299-89c1-7b5e97690a68","Type":"ContainerDied","Data":"e73b5051c9167093a245bf145a5c7178980bd38e62b25b0faae43234876a7403"}
Nov 02 22:14:47.396172 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:47.395361    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc"
Nov 02 22:14:47.401283 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:47.396678    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc" event={"ID":"92ccf4c8-837a-4299-89c1-7b5e97690a68","Type":"ContainerDied","Data":"526f0961654510b7abb0f4095aa3e57cb8a7d8a019c22babcc9fe8ac1aa50168"}
Nov 02 22:14:47.401283 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:47.396745    5076 scope.go:122] "RemoveContainer" containerID="e73b5051c9167093a245bf145a5c7178980bd38e62b25b0faae43234876a7403"
Nov 02 22:14:47.425268 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:47.422515    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc"]
Nov 02 22:14:47.437264 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:47.429212    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d47f8605-d99b765bc-7wbzc"]
Nov 02 22:14:47.437264 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:47.429547    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:47.441896 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:47.441875    5076 scope.go:122] "RemoveContainer" containerID="e73b5051c9167093a245bf145a5c7178980bd38e62b25b0faae43234876a7403"
Nov 02 22:14:47.442202 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:14:47.442177    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e73b5051c9167093a245bf145a5c7178980bd38e62b25b0faae43234876a7403\": container with ID starting with e73b5051c9167093a245bf145a5c7178980bd38e62b25b0faae43234876a7403 not found: ID does not exist" containerID="e73b5051c9167093a245bf145a5c7178980bd38e62b25b0faae43234876a7403"
Nov 02 22:14:47.442317 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:47.442209    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e73b5051c9167093a245bf145a5c7178980bd38e62b25b0faae43234876a7403"} err="failed to get container status \"e73b5051c9167093a245bf145a5c7178980bd38e62b25b0faae43234876a7403\": rpc error: code = NotFound desc = could not find container \"e73b5051c9167093a245bf145a5c7178980bd38e62b25b0faae43234876a7403\": container with ID starting with e73b5051c9167093a245bf145a5c7178980bd38e62b25b0faae43234876a7403 not found: ID does not exist"
Nov 02 22:14:47.604171 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:47.604135    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:47.720280 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:47.720128    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:48.374444 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:48.374403    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:49.051894 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:49.051835    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:49.057678 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:49.057645    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="92ccf4c8-837a-4299-89c1-7b5e97690a68" path="/var/lib/kubelet/pods/92ccf4c8-837a-4299-89c1-7b5e97690a68/volumes"
Nov 02 22:14:49.593088 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:49.593044    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:49.601327 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:49.600275    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"]
Nov 02 22:14:49.601327 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:49.600520    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9" podUID="511e242c-c8bb-45fb-8baa-d60bbf95f776" containerName="maas-api" containerID="cri-o://6058f4596dea7aab2f43401ca06c9044904d766948c0451ac99f0cf34c589a7b" gracePeriod=30
Nov 02 22:14:49.764328 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:49.764278    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:50.078769 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.078723    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:50.178563 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.178527    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:50.207710 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.207685    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"
Nov 02 22:14:50.331716 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.331643    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/511e242c-c8bb-45fb-8baa-d60bbf95f776-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/511e242c-c8bb-45fb-8baa-d60bbf95f776-maas-api-tls\") pod \"511e242c-c8bb-45fb-8baa-d60bbf95f776\" (UID: \"511e242c-c8bb-45fb-8baa-d60bbf95f776\") "
Nov 02 22:14:50.331917 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.331748    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/511e242c-c8bb-45fb-8baa-d60bbf95f776-metrics-certs\" (UniqueName: \"kubernetes.io/secret/511e242c-c8bb-45fb-8baa-d60bbf95f776-metrics-certs\") pod \"511e242c-c8bb-45fb-8baa-d60bbf95f776\" (UID: \"511e242c-c8bb-45fb-8baa-d60bbf95f776\") "
Nov 02 22:14:50.331917 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.331901    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/511e242c-c8bb-45fb-8baa-d60bbf95f776-kube-api-access-h7q7h\" (UniqueName: \"kubernetes.io/projected/511e242c-c8bb-45fb-8baa-d60bbf95f776-kube-api-access-h7q7h\") pod \"511e242c-c8bb-45fb-8baa-d60bbf95f776\" (UID: \"511e242c-c8bb-45fb-8baa-d60bbf95f776\") "
Nov 02 22:14:50.332002 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.331967    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/511e242c-c8bb-45fb-8baa-d60bbf95f776-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/511e242c-c8bb-45fb-8baa-d60bbf95f776-openshift-service-ca\") pod \"511e242c-c8bb-45fb-8baa-d60bbf95f776\" (UID: \"511e242c-c8bb-45fb-8baa-d60bbf95f776\") "
Nov 02 22:14:50.334275 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.333085    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/511e242c-c8bb-45fb-8baa-d60bbf95f776-openshift-service-ca" pod "511e242c-c8bb-45fb-8baa-d60bbf95f776" (UID: "511e242c-c8bb-45fb-8baa-d60bbf95f776"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:14:50.335406 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.335368    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/511e242c-c8bb-45fb-8baa-d60bbf95f776-kube-api-access-h7q7h" pod "511e242c-c8bb-45fb-8baa-d60bbf95f776" (UID: "511e242c-c8bb-45fb-8baa-d60bbf95f776"). InnerVolumeSpecName "kube-api-access-h7q7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:14:50.337343 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.337300    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/511e242c-c8bb-45fb-8baa-d60bbf95f776-metrics-certs" pod "511e242c-c8bb-45fb-8baa-d60bbf95f776" (UID: "511e242c-c8bb-45fb-8baa-d60bbf95f776"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:14:50.338478 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.338457    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/511e242c-c8bb-45fb-8baa-d60bbf95f776-maas-api-tls" pod "511e242c-c8bb-45fb-8baa-d60bbf95f776" (UID: "511e242c-c8bb-45fb-8baa-d60bbf95f776"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:14:50.419646 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.419613    5076 generic.go:356] "Generic (PLEG): container finished" podID="511e242c-c8bb-45fb-8baa-d60bbf95f776" containerID="6058f4596dea7aab2f43401ca06c9044904d766948c0451ac99f0cf34c589a7b" exitCode=0
Nov 02 22:14:50.419810 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.419658    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"
Nov 02 22:14:50.419810 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.419668    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9" event={"ID":"511e242c-c8bb-45fb-8baa-d60bbf95f776","Type":"ContainerDied","Data":"6058f4596dea7aab2f43401ca06c9044904d766948c0451ac99f0cf34c589a7b"}
Nov 02 22:14:50.419810 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.419719    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9" event={"ID":"511e242c-c8bb-45fb-8baa-d60bbf95f776","Type":"ContainerDied","Data":"882725cf3585a8d355ff4c8f58bb345cf2844a52665d80ba18dca59e367d5931"}
Nov 02 22:14:50.419810 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.419741    5076 scope.go:122] "RemoveContainer" containerID="6058f4596dea7aab2f43401ca06c9044904d766948c0451ac99f0cf34c589a7b"
Nov 02 22:14:50.431386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.431368    5076 scope.go:122] "RemoveContainer" containerID="6058f4596dea7aab2f43401ca06c9044904d766948c0451ac99f0cf34c589a7b"
Nov 02 22:14:50.431690 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:14:50.431672    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6058f4596dea7aab2f43401ca06c9044904d766948c0451ac99f0cf34c589a7b\": container with ID starting with 6058f4596dea7aab2f43401ca06c9044904d766948c0451ac99f0cf34c589a7b not found: ID does not exist" containerID="6058f4596dea7aab2f43401ca06c9044904d766948c0451ac99f0cf34c589a7b"
Nov 02 22:14:50.431735 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.431700    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6058f4596dea7aab2f43401ca06c9044904d766948c0451ac99f0cf34c589a7b"} err="failed to get container status \"6058f4596dea7aab2f43401ca06c9044904d766948c0451ac99f0cf34c589a7b\": rpc error: code = NotFound desc = could not find container \"6058f4596dea7aab2f43401ca06c9044904d766948c0451ac99f0cf34c589a7b\": container with ID starting with 6058f4596dea7aab2f43401ca06c9044904d766948c0451ac99f0cf34c589a7b not found: ID does not exist"
Nov 02 22:14:50.433910 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.433886    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7q7h\" (UniqueName: \"kubernetes.io/projected/511e242c-c8bb-45fb-8baa-d60bbf95f776-kube-api-access-h7q7h\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:50.434001 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.433913    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/511e242c-c8bb-45fb-8baa-d60bbf95f776-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:50.434001 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.433927    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/511e242c-c8bb-45fb-8baa-d60bbf95f776-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:50.434001 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.433940    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/511e242c-c8bb-45fb-8baa-d60bbf95f776-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:50.444973 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.444947    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"]
Nov 02 22:14:50.448614 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:50.448590    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a72dd63-7479ff4546-dstn9"]
Nov 02 22:14:51.056717 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:51.056681    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="511e242c-c8bb-45fb-8baa-d60bbf95f776" path="/var/lib/kubelet/pods/511e242c-c8bb-45fb-8baa-d60bbf95f776/volumes"
Nov 02 22:14:51.070562 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:51.070506    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:51.584889 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:51.584843    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:51.681932 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:51.681896    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:52.181246 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:52.181178    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:52.534888 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:52.534800    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:52.634277 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:52.634242    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:52.740033 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:52.740000    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:52.837407 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:52.837318    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:52.937150 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:52.937056    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:53.636163 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:53.636104    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:53.750005 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:53.749952    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:53.930292 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:53.915779    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:54.054240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:54.046476    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:54.979441 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:54.979410    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:55.786274 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:55.786239    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"]
Nov 02 22:14:55.787073 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:55.787037    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc" podUID="ebe9a79d-af76-444c-b55d-2444753d650b" containerName="maas-api" containerID="cri-o://757e7986585b3278be4fc8c4b464c492811b5c5f854a5ba3b90b0e41c45307e8" gracePeriod=30
Nov 02 22:14:55.833847 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:55.833799    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:55.984238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:55.977722    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:56.082033 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:56.081937    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:56.322301 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:56.322260    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:56.495313 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:56.487364    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:56.629298 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:56.628322    5076 generic.go:356] "Generic (PLEG): container finished" podID="ebe9a79d-af76-444c-b55d-2444753d650b" containerID="757e7986585b3278be4fc8c4b464c492811b5c5f854a5ba3b90b0e41c45307e8" exitCode=0
Nov 02 22:14:56.629298 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:56.628647    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc" event={"ID":"ebe9a79d-af76-444c-b55d-2444753d650b","Type":"ContainerDied","Data":"757e7986585b3278be4fc8c4b464c492811b5c5f854a5ba3b90b0e41c45307e8"}
Nov 02 22:14:56.629298 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:56.628717    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc" event={"ID":"ebe9a79d-af76-444c-b55d-2444753d650b","Type":"ContainerDied","Data":"d86dbbe2596bbf56a5059ce458edc3121f71bb9e2276d7ce319fc6e4509136aa"}
Nov 02 22:14:56.629298 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:56.628744    5076 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d86dbbe2596bbf56a5059ce458edc3121f71bb9e2276d7ce319fc6e4509136aa"
Nov 02 22:14:56.645240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:56.640672    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"
Nov 02 22:14:56.756447 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:56.756373    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ebe9a79d-af76-444c-b55d-2444753d650b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebe9a79d-af76-444c-b55d-2444753d650b-metrics-certs\") pod \"ebe9a79d-af76-444c-b55d-2444753d650b\" (UID: \"ebe9a79d-af76-444c-b55d-2444753d650b\") "
Nov 02 22:14:56.756718 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:56.756691    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ebe9a79d-af76-444c-b55d-2444753d650b-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebe9a79d-af76-444c-b55d-2444753d650b-openshift-service-ca\") pod \"ebe9a79d-af76-444c-b55d-2444753d650b\" (UID: \"ebe9a79d-af76-444c-b55d-2444753d650b\") "
Nov 02 22:14:56.757137 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:56.757112    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebe9a79d-af76-444c-b55d-2444753d650b-openshift-service-ca" pod "ebe9a79d-af76-444c-b55d-2444753d650b" (UID: "ebe9a79d-af76-444c-b55d-2444753d650b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:14:56.757334 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:56.757309    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ebe9a79d-af76-444c-b55d-2444753d650b-kube-api-access-nmbsh\" (UniqueName: \"kubernetes.io/projected/ebe9a79d-af76-444c-b55d-2444753d650b-kube-api-access-nmbsh\") pod \"ebe9a79d-af76-444c-b55d-2444753d650b\" (UID: \"ebe9a79d-af76-444c-b55d-2444753d650b\") "
Nov 02 22:14:56.757480 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:56.757380    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ebe9a79d-af76-444c-b55d-2444753d650b-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebe9a79d-af76-444c-b55d-2444753d650b-maas-api-tls\") pod \"ebe9a79d-af76-444c-b55d-2444753d650b\" (UID: \"ebe9a79d-af76-444c-b55d-2444753d650b\") "
Nov 02 22:14:56.758128 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:56.758085    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebe9a79d-af76-444c-b55d-2444753d650b-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:56.761343 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:56.760186    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebe9a79d-af76-444c-b55d-2444753d650b-kube-api-access-nmbsh" pod "ebe9a79d-af76-444c-b55d-2444753d650b" (UID: "ebe9a79d-af76-444c-b55d-2444753d650b"). InnerVolumeSpecName "kube-api-access-nmbsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:14:56.761343 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:56.761240    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebe9a79d-af76-444c-b55d-2444753d650b-metrics-certs" pod "ebe9a79d-af76-444c-b55d-2444753d650b" (UID: "ebe9a79d-af76-444c-b55d-2444753d650b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:14:56.762606 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:56.762581    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebe9a79d-af76-444c-b55d-2444753d650b-maas-api-tls" pod "ebe9a79d-af76-444c-b55d-2444753d650b" (UID: "ebe9a79d-af76-444c-b55d-2444753d650b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:14:56.862274 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:56.860314    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmbsh\" (UniqueName: \"kubernetes.io/projected/ebe9a79d-af76-444c-b55d-2444753d650b-kube-api-access-nmbsh\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:56.862274 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:56.860373    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebe9a79d-af76-444c-b55d-2444753d650b-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:56.862274 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:56.860388    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebe9a79d-af76-444c-b55d-2444753d650b-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:14:57.207030 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:57.206983    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:57.309580 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:57.309542    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:57.525242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:57.524277    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:57.626540 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:57.626495    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:57.637306 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:57.637206    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"
Nov 02 22:14:57.660045 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:57.660012    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"]
Nov 02 22:14:57.663769 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:57.663743    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bb16f94c-68cd468b65-qfcgc"]
Nov 02 22:14:58.254241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:58.250818    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:58.956236 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:58.956184    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:59.062241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:59.061671    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ebe9a79d-af76-444c-b55d-2444753d650b" path="/var/lib/kubelet/pods/ebe9a79d-af76-444c-b55d-2444753d650b/volumes"
Nov 02 22:14:59.817105 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:59.817061    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:14:59.914953 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:14:59.914891    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:14:59.924557 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:14:59.924403    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:00.018277 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.018226    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:00.180982 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.180946    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j"]
Nov 02 22:15:00.184155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.181932    5076 cpu_manager.go:414] "containerMap: removing container" podUID="ebe9a79d-af76-444c-b55d-2444753d650b" containerName="maas-api"
Nov 02 22:15:00.184155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.181958    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ebe9a79d-af76-444c-b55d-2444753d650b" containerName="maas-api"
Nov 02 22:15:00.184155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.181984    5076 cpu_manager.go:414] "containerMap: removing container" podUID="2e95e9c2-58d9-4516-94ff-0b8c0b10985a" containerName="maas-api"
Nov 02 22:15:00.184155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.181992    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e95e9c2-58d9-4516-94ff-0b8c0b10985a" containerName="maas-api"
Nov 02 22:15:00.184155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.182027    5076 cpu_manager.go:414] "containerMap: removing container" podUID="f0f154ab-91ad-4884-8d87-1f842b7ca30b" containerName="maas-api"
Nov 02 22:15:00.184155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.182036    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f0f154ab-91ad-4884-8d87-1f842b7ca30b" containerName="maas-api"
Nov 02 22:15:00.184155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.182050    5076 cpu_manager.go:414] "containerMap: removing container" podUID="92ccf4c8-837a-4299-89c1-7b5e97690a68" containerName="payload-pre-processing"
Nov 02 22:15:00.184155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.182058    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92ccf4c8-837a-4299-89c1-7b5e97690a68" containerName="payload-pre-processing"
Nov 02 22:15:00.184155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.182089    5076 cpu_manager.go:414] "containerMap: removing container" podUID="511e242c-c8bb-45fb-8baa-d60bbf95f776" containerName="maas-api"
Nov 02 22:15:00.184155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.182096    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="511e242c-c8bb-45fb-8baa-d60bbf95f776" containerName="maas-api"
Nov 02 22:15:00.184155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.182255    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e95e9c2-58d9-4516-94ff-0b8c0b10985a" containerName="maas-api"
Nov 02 22:15:00.184155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.182276    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="f0f154ab-91ad-4884-8d87-1f842b7ca30b" containerName="maas-api"
Nov 02 22:15:00.184155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.182286    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="92ccf4c8-837a-4299-89c1-7b5e97690a68" containerName="payload-pre-processing"
Nov 02 22:15:00.184155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.182300    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="511e242c-c8bb-45fb-8baa-d60bbf95f776" containerName="maas-api"
Nov 02 22:15:00.184155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.182314    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="ebe9a79d-af76-444c-b55d-2444753d650b" containerName="maas-api"
Nov 02 22:15:00.191174 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.191110    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz"]
Nov 02 22:15:00.194640 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.194577    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:00.201768 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.201521    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j"
Nov 02 22:15:00.219527 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.219106    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz"
Nov 02 22:15:00.220910 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.220884    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j"]
Nov 02 22:15:00.228321 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.228294    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz"]
Nov 02 22:15:00.236467 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.235531    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e243c9ca-e8a2-4a1d-820c-5f536cf3d722-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j\" (UID: \"e243c9ca-e8a2-4a1d-820c-5f536cf3d722\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j"
Nov 02 22:15:00.236467 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.235586    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl5hv\" (UniqueName: \"kubernetes.io/projected/733f2d26-543f-4263-8eb3-c6c25ae61a54-kube-api-access-tl5hv\") pod \"maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz\" (UID: \"733f2d26-543f-4263-8eb3-c6c25ae61a54\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz"
Nov 02 22:15:00.236467 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.235675    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2lfr\" (UniqueName: \"kubernetes.io/projected/e243c9ca-e8a2-4a1d-820c-5f536cf3d722-kube-api-access-v2lfr\") pod \"maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j\" (UID: \"e243c9ca-e8a2-4a1d-820c-5f536cf3d722\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j"
Nov 02 22:15:00.236467 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.235717    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/733f2d26-543f-4263-8eb3-c6c25ae61a54-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz\" (UID: \"733f2d26-543f-4263-8eb3-c6c25ae61a54\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz"
Nov 02 22:15:00.263622 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.263571    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n7t66\""
Nov 02 22:15:00.337567 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.337530    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e243c9ca-e8a2-4a1d-820c-5f536cf3d722-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j\" (UID: \"e243c9ca-e8a2-4a1d-820c-5f536cf3d722\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j"
Nov 02 22:15:00.337766 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.337586    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl5hv\" (UniqueName: \"kubernetes.io/projected/733f2d26-543f-4263-8eb3-c6c25ae61a54-kube-api-access-tl5hv\") pod \"maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz\" (UID: \"733f2d26-543f-4263-8eb3-c6c25ae61a54\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz"
Nov 02 22:15:00.337766 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.337676    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2lfr\" (UniqueName: \"kubernetes.io/projected/e243c9ca-e8a2-4a1d-820c-5f536cf3d722-kube-api-access-v2lfr\") pod \"maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j\" (UID: \"e243c9ca-e8a2-4a1d-820c-5f536cf3d722\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j"
Nov 02 22:15:00.337766 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.337719    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/733f2d26-543f-4263-8eb3-c6c25ae61a54-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz\" (UID: \"733f2d26-543f-4263-8eb3-c6c25ae61a54\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz"
Nov 02 22:15:00.338283 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.338253    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e243c9ca-e8a2-4a1d-820c-5f536cf3d722-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j\" (UID: \"e243c9ca-e8a2-4a1d-820c-5f536cf3d722\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j"
Nov 02 22:15:00.338576 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.338556    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/733f2d26-543f-4263-8eb3-c6c25ae61a54-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz\" (UID: \"733f2d26-543f-4263-8eb3-c6c25ae61a54\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz"
Nov 02 22:15:00.349720 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.349695    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl5hv\" (UniqueName: \"kubernetes.io/projected/733f2d26-543f-4263-8eb3-c6c25ae61a54-kube-api-access-tl5hv\") pod \"maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz\" (UID: \"733f2d26-543f-4263-8eb3-c6c25ae61a54\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz"
Nov 02 22:15:00.350918 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.350896    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2lfr\" (UniqueName: \"kubernetes.io/projected/e243c9ca-e8a2-4a1d-820c-5f536cf3d722-kube-api-access-v2lfr\") pod \"maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j\" (UID: \"e243c9ca-e8a2-4a1d-820c-5f536cf3d722\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j"
Nov 02 22:15:00.538287 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.536532    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j"
Nov 02 22:15:00.590824 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:00.586038    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz"
Nov 02 22:15:01.012257 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:01.011689    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:01.032313 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:01.032280    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j"]
Nov 02 22:15:01.035999 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:15:01.035972    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode243c9ca_e8a2_4a1d_820c_5f536cf3d722.slice/crio-fd6a47e2896088fabb9834c96c3fe7ae890ed4830957671f5d3a0c29373a97ca WatchSource:0}: Error finding container fd6a47e2896088fabb9834c96c3fe7ae890ed4830957671f5d3a0c29373a97ca: Status 404 returned error can't find the container with id fd6a47e2896088fabb9834c96c3fe7ae890ed4830957671f5d3a0c29373a97ca
Nov 02 22:15:01.154465 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:01.154431    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz"]
Nov 02 22:15:01.709963 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:01.709911    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j" event={"ID":"e243c9ca-e8a2-4a1d-820c-5f536cf3d722","Type":"ContainerStarted","Data":"fd6a47e2896088fabb9834c96c3fe7ae890ed4830957671f5d3a0c29373a97ca"}
Nov 02 22:15:01.710179 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:01.710156    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:01.711489 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:01.711466    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz" event={"ID":"733f2d26-543f-4263-8eb3-c6c25ae61a54","Type":"ContainerStarted","Data":"260af743c82a1389a6150280dab06119b1cf9dd7b421f86470d518b8f800c8bd"}
Nov 02 22:15:02.376901 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:02.376858    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:03.202658 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:03.202620    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:03.963001 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:03.962960    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:04.068054 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:04.066680    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:04.779316 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:04.779283    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:05.578536 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:05.578499    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:05.752677 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:05.752595    5076 generic.go:356] "Generic (PLEG): container finished" podID="733f2d26-543f-4263-8eb3-c6c25ae61a54" containerID="7365fe3642288cc25ddde2232b0fda92aae8995178cca0e07089c97da9964a54" exitCode=60
Nov 02 22:15:05.752859 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:05.752676    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz" event={"ID":"733f2d26-543f-4263-8eb3-c6c25ae61a54","Type":"ContainerDied","Data":"7365fe3642288cc25ddde2232b0fda92aae8995178cca0e07089c97da9964a54"}
Nov 02 22:15:05.753030 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:05.753010    5076 scope.go:122] "RemoveContainer" containerID="7365fe3642288cc25ddde2232b0fda92aae8995178cca0e07089c97da9964a54"
Nov 02 22:15:05.756013 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:05.755984    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j" event={"ID":"e243c9ca-e8a2-4a1d-820c-5f536cf3d722","Type":"ContainerStarted","Data":"c3c18fe78e4af993d718980e5a237437f7d1443af441bbdabdefc45917cd4059"}
Nov 02 22:15:05.791824 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:05.791748    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j" podStartSLOduration=2.213388129 podStartE2EDuration="5.791732536s" totalImagesPullingTime="3.578344407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:15:05.788620298 +0000 UTC m=+1014.844954678" watchObservedRunningTime="2026-11-02 22:15:05.791732536 +0000 UTC m=+1014.848066907"
Nov 02 22:15:05.917181 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:05.917150    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:06.261553 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:06.261506    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:06.764725 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:06.764690    5076 generic.go:356] "Generic (PLEG): container finished" podID="e243c9ca-e8a2-4a1d-820c-5f536cf3d722" containerID="c3c18fe78e4af993d718980e5a237437f7d1443af441bbdabdefc45917cd4059" exitCode=60
Nov 02 22:15:06.765174 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:06.764783    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j" event={"ID":"e243c9ca-e8a2-4a1d-820c-5f536cf3d722","Type":"ContainerDied","Data":"c3c18fe78e4af993d718980e5a237437f7d1443af441bbdabdefc45917cd4059"}
Nov 02 22:15:06.765174 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:06.765020    5076 scope.go:122] "RemoveContainer" containerID="c3c18fe78e4af993d718980e5a237437f7d1443af441bbdabdefc45917cd4059"
Nov 02 22:15:06.766979 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:06.766957    5076 generic.go:356] "Generic (PLEG): container finished" podID="733f2d26-543f-4263-8eb3-c6c25ae61a54" containerID="aa40f005f49381edb38cdad1e39845bb32cb3089ee11f73e654080ef3b449193" exitCode=60
Nov 02 22:15:06.767097 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:06.767040    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz" event={"ID":"733f2d26-543f-4263-8eb3-c6c25ae61a54","Type":"ContainerDied","Data":"aa40f005f49381edb38cdad1e39845bb32cb3089ee11f73e654080ef3b449193"}
Nov 02 22:15:06.767097 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:06.767092    5076 scope.go:122] "RemoveContainer" containerID="7365fe3642288cc25ddde2232b0fda92aae8995178cca0e07089c97da9964a54"
Nov 02 22:15:06.767465 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:06.767361    5076 scope.go:122] "RemoveContainer" containerID="aa40f005f49381edb38cdad1e39845bb32cb3089ee11f73e654080ef3b449193"
Nov 02 22:15:06.767677 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:15:06.767655    5076 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz_odh-ai-gateway-infra(733f2d26-543f-4263-8eb3-c6c25ae61a54)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz" podUID="733f2d26-543f-4263-8eb3-c6c25ae61a54"
Nov 02 22:15:06.979093 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:06.979063    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:07.081337 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:07.081299    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:07.181117 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:07.181085    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:07.516324 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:07.516196    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:07.759242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:07.754778    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:07.848711 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:07.848674    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j" event={"ID":"e243c9ca-e8a2-4a1d-820c-5f536cf3d722","Type":"ContainerStarted","Data":"63c9f47a0317f34e0d19fd945f1df36faf6aa572f08c5d2966b7c93b5c422243"}
Nov 02 22:15:07.866574 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:07.861765    5076 scope.go:122] "RemoveContainer" containerID="aa40f005f49381edb38cdad1e39845bb32cb3089ee11f73e654080ef3b449193"
Nov 02 22:15:07.875329 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:15:07.874925    5076 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz_odh-ai-gateway-infra(733f2d26-543f-4263-8eb3-c6c25ae61a54)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz" podUID="733f2d26-543f-4263-8eb3-c6c25ae61a54"
Nov 02 22:15:07.916878 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:07.916787    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:08.863797 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:08.863752    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:08.873011 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:08.872982    5076 generic.go:356] "Generic (PLEG): container finished" podID="e243c9ca-e8a2-4a1d-820c-5f536cf3d722" containerID="63c9f47a0317f34e0d19fd945f1df36faf6aa572f08c5d2966b7c93b5c422243" exitCode=60
Nov 02 22:15:08.873196 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:08.873181    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j" event={"ID":"e243c9ca-e8a2-4a1d-820c-5f536cf3d722","Type":"ContainerDied","Data":"63c9f47a0317f34e0d19fd945f1df36faf6aa572f08c5d2966b7c93b5c422243"}
Nov 02 22:15:08.873294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:08.873277    5076 scope.go:122] "RemoveContainer" containerID="c3c18fe78e4af993d718980e5a237437f7d1443af441bbdabdefc45917cd4059"
Nov 02 22:15:08.873744 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:08.873721    5076 scope.go:122] "RemoveContainer" containerID="63c9f47a0317f34e0d19fd945f1df36faf6aa572f08c5d2966b7c93b5c422243"
Nov 02 22:15:08.874118 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:15:08.874084    5076 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j_odh-ai-gateway-infra(e243c9ca-e8a2-4a1d-820c-5f536cf3d722)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j" podUID="e243c9ca-e8a2-4a1d-820c-5f536cf3d722"
Nov 02 22:15:09.566250 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:09.566190    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:09.882917 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:09.882889    5076 scope.go:122] "RemoveContainer" containerID="63c9f47a0317f34e0d19fd945f1df36faf6aa572f08c5d2966b7c93b5c422243"
Nov 02 22:15:09.883410 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:15:09.883184    5076 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j_odh-ai-gateway-infra(e243c9ca-e8a2-4a1d-820c-5f536cf3d722)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j" podUID="e243c9ca-e8a2-4a1d-820c-5f536cf3d722"
Nov 02 22:15:10.281620 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:10.281524    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:10.979604 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:10.979564    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:11.565191 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:11.565145    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:11.771632 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:11.771548    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:11.882243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:11.881679    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:11.998191 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:11.998134    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:12.108504 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:12.099363    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:12.390526 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:12.390431    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:12.497641 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:12.495876    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:12.911147 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:12.911107    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:13.078919 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:13.078879    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:13.308490 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:13.308398    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:13.405881 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:13.405849    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:13.894151 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:13.894107    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:14.581807 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:14.581772    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:15.366699 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:15.366652    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:15.992049 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:15.992006    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:16.679168 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:16.679130    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:17.047050 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:17.046954    5076 scope.go:122] "RemoveContainer" containerID="aa40f005f49381edb38cdad1e39845bb32cb3089ee11f73e654080ef3b449193"
Nov 02 22:15:17.132174 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:17.132132    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:17.231179 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:17.231130    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:17.483725 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:17.483694    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:18.040989 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:18.040950    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz" event={"ID":"733f2d26-543f-4263-8eb3-c6c25ae61a54","Type":"ContainerStarted","Data":"00d37760a7fb59f1b4035559da79a2b9db630b25e3c9865989a57a53b87cc8c2"}
Nov 02 22:15:18.060164 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:18.060113    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz" podStartSLOduration=14.604240829 podStartE2EDuration="18.060098381s" totalImagesPullingTime="3.455857552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:15:18.056611347 +0000 UTC m=+1027.112945728" watchObservedRunningTime="2026-11-02 22:15:18.060098381 +0000 UTC m=+1027.116432739"
Nov 02 22:15:18.290770 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:18.290729    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:18.390143 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:18.390110    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:18.475896 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:18.475865    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:19.043475 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.043434    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"]
Nov 02 22:15:19.051173 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.051127    5076 scope.go:122] "RemoveContainer" containerID="63c9f47a0317f34e0d19fd945f1df36faf6aa572f08c5d2966b7c93b5c422243"
Nov 02 22:15:19.051998 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.051571    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"
Nov 02 22:15:19.079088 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.079062    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-84a94060-serving-cert\""
Nov 02 22:15:19.080739 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.080716    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"]
Nov 02 22:15:19.080887 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.080775    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz"]
Nov 02 22:15:19.088887 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.088863    5076 generic.go:356] "Generic (PLEG): container finished" podID="733f2d26-543f-4263-8eb3-c6c25ae61a54" containerID="00d37760a7fb59f1b4035559da79a2b9db630b25e3c9865989a57a53b87cc8c2" exitCode=60
Nov 02 22:15:19.089287 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.089265    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz" event={"ID":"733f2d26-543f-4263-8eb3-c6c25ae61a54","Type":"ContainerDied","Data":"00d37760a7fb59f1b4035559da79a2b9db630b25e3c9865989a57a53b87cc8c2"}
Nov 02 22:15:19.089421 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.089409    5076 scope.go:122] "RemoveContainer" containerID="aa40f005f49381edb38cdad1e39845bb32cb3089ee11f73e654080ef3b449193"
Nov 02 22:15:19.098526 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.098308    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:19.140194 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.140168    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-maas-api-tls\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg\" (UID: \"beeb9085-15f2-42f7-8f76-6739e4b4cdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"
Nov 02 22:15:19.140349 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.140258    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-openshift-service-ca\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg\" (UID: \"beeb9085-15f2-42f7-8f76-6739e4b4cdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"
Nov 02 22:15:19.140686 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.140657    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbxrn\" (UniqueName: \"kubernetes.io/projected/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-kube-api-access-rbxrn\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg\" (UID: \"beeb9085-15f2-42f7-8f76-6739e4b4cdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"
Nov 02 22:15:19.140786 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.140744    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-metrics-certs\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg\" (UID: \"beeb9085-15f2-42f7-8f76-6739e4b4cdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"
Nov 02 22:15:19.180206 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.180167    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:19.262484 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.258079    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-metrics-certs\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg\" (UID: \"beeb9085-15f2-42f7-8f76-6739e4b4cdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"
Nov 02 22:15:19.262484 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.258207    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-maas-api-tls\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg\" (UID: \"beeb9085-15f2-42f7-8f76-6739e4b4cdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"
Nov 02 22:15:19.262484 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.258297    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-openshift-service-ca\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg\" (UID: \"beeb9085-15f2-42f7-8f76-6739e4b4cdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"
Nov 02 22:15:19.262484 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.258568    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbxrn\" (UniqueName: \"kubernetes.io/projected/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-kube-api-access-rbxrn\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg\" (UID: \"beeb9085-15f2-42f7-8f76-6739e4b4cdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"
Nov 02 22:15:19.311310 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.275384    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-openshift-service-ca\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg\" (UID: \"beeb9085-15f2-42f7-8f76-6739e4b4cdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"
Nov 02 22:15:19.311310 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.298280    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-metrics-certs\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg\" (UID: \"beeb9085-15f2-42f7-8f76-6739e4b4cdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"
Nov 02 22:15:19.311310 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.300974    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:19.331641 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.331611    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-maas-api-tls\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg\" (UID: \"beeb9085-15f2-42f7-8f76-6739e4b4cdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"
Nov 02 22:15:19.334530 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.334498    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbxrn\" (UniqueName: \"kubernetes.io/projected/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-kube-api-access-rbxrn\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg\" (UID: \"beeb9085-15f2-42f7-8f76-6739e4b4cdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"
Nov 02 22:15:19.377953 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.377909    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz"
Nov 02 22:15:19.397082 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.397049    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"
Nov 02 22:15:19.566987 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.566101    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/733f2d26-543f-4263-8eb3-c6c25ae61a54-kube-api-access-tl5hv\" (UniqueName: \"kubernetes.io/projected/733f2d26-543f-4263-8eb3-c6c25ae61a54-kube-api-access-tl5hv\") pod \"733f2d26-543f-4263-8eb3-c6c25ae61a54\" (UID: \"733f2d26-543f-4263-8eb3-c6c25ae61a54\") "
Nov 02 22:15:19.566987 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.566279    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/733f2d26-543f-4263-8eb3-c6c25ae61a54-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/733f2d26-543f-4263-8eb3-c6c25ae61a54-maas-api-service-ca\") pod \"733f2d26-543f-4263-8eb3-c6c25ae61a54\" (UID: \"733f2d26-543f-4263-8eb3-c6c25ae61a54\") "
Nov 02 22:15:19.566987 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.566952    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/733f2d26-543f-4263-8eb3-c6c25ae61a54-maas-api-service-ca" pod "733f2d26-543f-4263-8eb3-c6c25ae61a54" (UID: "733f2d26-543f-4263-8eb3-c6c25ae61a54"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:15:19.567903 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.567330    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/733f2d26-543f-4263-8eb3-c6c25ae61a54-maas-api-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:15:19.579391 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.569008    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/733f2d26-543f-4263-8eb3-c6c25ae61a54-kube-api-access-tl5hv" pod "733f2d26-543f-4263-8eb3-c6c25ae61a54" (UID: "733f2d26-543f-4263-8eb3-c6c25ae61a54"). InnerVolumeSpecName "kube-api-access-tl5hv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:15:19.668610 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.668577    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tl5hv\" (UniqueName: \"kubernetes.io/projected/733f2d26-543f-4263-8eb3-c6c25ae61a54-kube-api-access-tl5hv\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:15:19.807243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:19.802691    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"]
Nov 02 22:15:19.852249 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:15:19.850158    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeeb9085_15f2_42f7_8f76_6739e4b4cdc2.slice/crio-42aadd89cccc0b2ca0526f0d497c60d1d03c991de8555c9ecbb8bfff24faa2c9 WatchSource:0}: Error finding container 42aadd89cccc0b2ca0526f0d497c60d1d03c991de8555c9ecbb8bfff24faa2c9: Status 404 returned error can't find the container with id 42aadd89cccc0b2ca0526f0d497c60d1d03c991de8555c9ecbb8bfff24faa2c9
Nov 02 22:15:20.058406 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:20.058367    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:20.101294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:20.101212    5076 generic.go:356] "Generic (PLEG): container finished" podID="e243c9ca-e8a2-4a1d-820c-5f536cf3d722" containerID="38e0f03f4d1fd2a32f3c7c464702acdf8b9ac31048fc4e6bbb3d509849fd1507" exitCode=60
Nov 02 22:15:20.101711 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:20.101270    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j" event={"ID":"e243c9ca-e8a2-4a1d-820c-5f536cf3d722","Type":"ContainerDied","Data":"38e0f03f4d1fd2a32f3c7c464702acdf8b9ac31048fc4e6bbb3d509849fd1507"}
Nov 02 22:15:20.101711 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:20.101341    5076 scope.go:122] "RemoveContainer" containerID="63c9f47a0317f34e0d19fd945f1df36faf6aa572f08c5d2966b7c93b5c422243"
Nov 02 22:15:20.101839 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:20.101762    5076 scope.go:122] "RemoveContainer" containerID="38e0f03f4d1fd2a32f3c7c464702acdf8b9ac31048fc4e6bbb3d509849fd1507"
Nov 02 22:15:20.102199 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:15:20.102174    5076 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j_odh-ai-gateway-infra(e243c9ca-e8a2-4a1d-820c-5f536cf3d722)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j" podUID="e243c9ca-e8a2-4a1d-820c-5f536cf3d722"
Nov 02 22:15:20.103061 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:20.103037    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg" event={"ID":"beeb9085-15f2-42f7-8f76-6739e4b4cdc2","Type":"ContainerStarted","Data":"42aadd89cccc0b2ca0526f0d497c60d1d03c991de8555c9ecbb8bfff24faa2c9"}
Nov 02 22:15:20.104690 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:20.104649    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz"
Nov 02 22:15:20.104810 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:20.104693    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz" event={"ID":"733f2d26-543f-4263-8eb3-c6c25ae61a54","Type":"ContainerDied","Data":"260af743c82a1389a6150280dab06119b1cf9dd7b421f86470d518b8f800c8bd"}
Nov 02 22:15:20.129811 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:20.129794    5076 scope.go:122] "RemoveContainer" containerID="00d37760a7fb59f1b4035559da79a2b9db630b25e3c9865989a57a53b87cc8c2"
Nov 02 22:15:20.174895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:20.174861    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz"]
Nov 02 22:15:20.180340 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:20.180057    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-719012-29894295-zlxbz"]
Nov 02 22:15:20.772421 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:20.772377    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:21.056770 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:21.056696    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="733f2d26-543f-4263-8eb3-c6c25ae61a54" path="/var/lib/kubelet/pods/733f2d26-543f-4263-8eb3-c6c25ae61a54/volumes"
Nov 02 22:15:21.116701 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:21.116668    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg" event={"ID":"beeb9085-15f2-42f7-8f76-6739e4b4cdc2","Type":"ContainerStarted","Data":"8f4e08c8c40d286d249ce4dcb8c971db827d9e278287803c1c2dede153e7daca"}
Nov 02 22:15:21.117080 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:21.116807    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"
Nov 02 22:15:21.131081 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:21.131052    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j"]
Nov 02 22:15:21.141474 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:21.141431    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg" podStartSLOduration=1.349261979 podStartE2EDuration="2.141414271s" totalImagesPullingTime="792.152292ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:15:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:15:21.136932421 +0000 UTC m=+1030.193266802" watchObservedRunningTime="2026-11-02 22:15:21.141414271 +0000 UTC m=+1030.197748654"
Nov 02 22:15:21.364193 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:21.364160    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j"
Nov 02 22:15:21.430383 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:21.430351    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e243c9ca-e8a2-4a1d-820c-5f536cf3d722-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e243c9ca-e8a2-4a1d-820c-5f536cf3d722-maas-api-service-ca\") pod \"e243c9ca-e8a2-4a1d-820c-5f536cf3d722\" (UID: \"e243c9ca-e8a2-4a1d-820c-5f536cf3d722\") "
Nov 02 22:15:21.430575 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:21.430443    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e243c9ca-e8a2-4a1d-820c-5f536cf3d722-kube-api-access-v2lfr\" (UniqueName: \"kubernetes.io/projected/e243c9ca-e8a2-4a1d-820c-5f536cf3d722-kube-api-access-v2lfr\") pod \"e243c9ca-e8a2-4a1d-820c-5f536cf3d722\" (UID: \"e243c9ca-e8a2-4a1d-820c-5f536cf3d722\") "
Nov 02 22:15:21.431278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:21.430769    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e243c9ca-e8a2-4a1d-820c-5f536cf3d722-maas-api-service-ca" pod "e243c9ca-e8a2-4a1d-820c-5f536cf3d722" (UID: "e243c9ca-e8a2-4a1d-820c-5f536cf3d722"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:15:21.431364 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:21.431276    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e243c9ca-e8a2-4a1d-820c-5f536cf3d722-maas-api-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:15:21.433112 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:21.433084    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e243c9ca-e8a2-4a1d-820c-5f536cf3d722-kube-api-access-v2lfr" pod "e243c9ca-e8a2-4a1d-820c-5f536cf3d722" (UID: "e243c9ca-e8a2-4a1d-820c-5f536cf3d722"). InnerVolumeSpecName "kube-api-access-v2lfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:15:21.486145 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:21.486116    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:21.533321 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:21.533290    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2lfr\" (UniqueName: \"kubernetes.io/projected/e243c9ca-e8a2-4a1d-820c-5f536cf3d722-kube-api-access-v2lfr\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:15:22.128921 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:22.128885    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j"
Nov 02 22:15:22.128921 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:22.128897    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j" event={"ID":"e243c9ca-e8a2-4a1d-820c-5f536cf3d722","Type":"ContainerDied","Data":"fd6a47e2896088fabb9834c96c3fe7ae890ed4830957671f5d3a0c29373a97ca"}
Nov 02 22:15:22.129533 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:22.128963    5076 scope.go:122] "RemoveContainer" containerID="38e0f03f4d1fd2a32f3c7c464702acdf8b9ac31048fc4e6bbb3d509849fd1507"
Nov 02 22:15:22.162712 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:22.162681    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j"]
Nov 02 22:15:22.167454 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:22.167430    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-a1d78c-29894295-d4q9j"]
Nov 02 22:15:22.492295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:22.491954    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:23.072243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:23.063724    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e243c9ca-e8a2-4a1d-820c-5f536cf3d722" path="/var/lib/kubelet/pods/e243c9ca-e8a2-4a1d-820c-5f536cf3d722/volumes"
Nov 02 22:15:23.325490 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:23.325396    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:24.003884 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:24.003851    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:24.139111 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:24.139067    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:24.944337 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:24.940571    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:25.961250 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:25.959947    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:26.148240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:26.135676    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:26.317914 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:26.317786    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:26.838853 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:26.838800    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:27.134860 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:27.134828    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"
Nov 02 22:15:27.473725 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:27.473632    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:28.109372 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:28.109340    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:28.807765 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:28.807719    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:29.716256 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:29.716196    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:29.892906 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:15:29.892865    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:15:30.469048 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:30.469007    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:31.171040 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:31.170949    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:31.794495 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:31.794462    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:32.074821 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:32.074742    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:32.597842 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:32.597804    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:33.395283 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:33.395200    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:33.682757 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:33.682676    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:33.784443 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:33.784398    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:34.198493 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:34.196187    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:34.879265 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:34.879198    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:35.676031 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:35.675993    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:36.565509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:36.565467    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:37.292920 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:37.292879    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:37.887527 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:37.887488    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:38.594752 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:38.594714    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:39.396907 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:39.396872    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:40.191638 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:40.191601    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:40.939660 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:40.939629    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:41.693841 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:41.693800    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:42.398204 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:42.398161    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:43.111674 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:43.111638    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:43.955510 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:43.955471    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:44.816963 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:44.816924    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:45.466029 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:45.465995    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:46.070365 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:46.070330    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:46.700748 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:46.700709    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:47.766001 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:47.765965    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:48.058708 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:48.058628    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:48.673952 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:48.673911    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:49.264641 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:49.264606    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:49.872268 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:49.872229    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:50.622847 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:50.622809    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:51.410449 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:51.410407    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:52.289969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:52.289938    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:52.999843 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:52.999807    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:53.687668 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:53.687627    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:54.470281 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:54.470211    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:55.171936 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:55.171895    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:55.768855 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:55.768811    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:56.396037 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:56.395990    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:57.021640 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:57.021609    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:57.670747 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:57.670712    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:58.266499 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:58.266454    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:58.886427 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:58.886384    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:59.579363 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:15:59.579328    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:15:59.889602 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:15:59.889560    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:16:00.260295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:00.260167    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:01.088033 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:01.087983    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:01.678951 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:01.678911    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:02.267755 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:02.267719    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:02.993136 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:02.993097    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:03.329070 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:03.328935    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:03.434930 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:03.434883    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:03.536470 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:03.536413    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:03.730183 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:03.730144    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:04.738212 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:04.738173    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:04.837984 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:04.837947    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:05.294867 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:05.294826    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:05.893886 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:05.893839    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:06.573777 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:06.573744    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:07.273152 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:07.273045    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:08.377237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:08.377188    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:09.241712 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:09.241674    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:09.815721 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:09.815657    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:10.500861 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:10.500829    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:11.169420 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:11.169384    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:11.776816 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:11.776773    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:12.388795 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:12.388763    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:13.102649 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:13.102607    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:13.775434 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:13.775397    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:14.386463 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:14.386426    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:14.989704 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:14.989667    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:15.691033 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:15.690997    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:16.151027 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:16.150970    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:16.376484 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:16.376450    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:16.974281 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:16.974239    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:17.589348 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:17.589295    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:17.995813 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:17.995780    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:18.096353 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:18.096318    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:18.287306 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:18.286421    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:19.084141 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:19.084098    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:19.775035 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:19.774995    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:20.275859 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:20.275818    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:20.874812 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:20.874770    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:21.620928 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:21.620893    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:22.074773 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:22.074674    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:22.208825 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:22.208789    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:22.879036 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:22.879006    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:23.558749 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:23.558720    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:23.837458 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:23.837371    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:24.274551 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:24.274513    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:24.966917 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:24.966881    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:25.437579 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:25.437546    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"]
Nov 02 22:16:25.438175 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:25.438130    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt" podUID="a1af5dd6-6577-4ee8-9f96-b2a5ce73258a" containerName="maas-api" containerID="cri-o://6d38c87631744783cc1fff73fb9a7ded17acdede0f078aeac6bf68791017b57e" gracePeriod=30
Nov 02 22:16:25.474970 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:25.474937    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:25.619190 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:25.619155    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:25.745145 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:25.745054    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:25.828840 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:25.828807    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:26.015688 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:26.015061    5076 generic.go:356] "Generic (PLEG): container finished" podID="a1af5dd6-6577-4ee8-9f96-b2a5ce73258a" containerID="6d38c87631744783cc1fff73fb9a7ded17acdede0f078aeac6bf68791017b57e" exitCode=0
Nov 02 22:16:26.015688 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:26.015321    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt" event={"ID":"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a","Type":"ContainerDied","Data":"6d38c87631744783cc1fff73fb9a7ded17acdede0f078aeac6bf68791017b57e"}
Nov 02 22:16:26.017408 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:26.017291    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"
Nov 02 22:16:26.087245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:26.084729    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-kube-api-access-pfx8m\" (UniqueName: \"kubernetes.io/projected/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-kube-api-access-pfx8m\") pod \"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a\" (UID: \"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a\") "
Nov 02 22:16:26.087245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:26.084840    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-openshift-service-ca\") pod \"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a\" (UID: \"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a\") "
Nov 02 22:16:26.087245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:26.084910    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-metrics-certs\") pod \"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a\" (UID: \"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a\") "
Nov 02 22:16:26.087245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:26.085391    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-openshift-service-ca" pod "a1af5dd6-6577-4ee8-9f96-b2a5ce73258a" (UID: "a1af5dd6-6577-4ee8-9f96-b2a5ce73258a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:16:26.087245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:26.085792    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-maas-api-tls\") pod \"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a\" (UID: \"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a\") "
Nov 02 22:16:26.087245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:26.086487    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:16:26.100333 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:26.088281    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-maas-api-tls" pod "a1af5dd6-6577-4ee8-9f96-b2a5ce73258a" (UID: "a1af5dd6-6577-4ee8-9f96-b2a5ce73258a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:16:26.109437 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:26.108035    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-kube-api-access-pfx8m" pod "a1af5dd6-6577-4ee8-9f96-b2a5ce73258a" (UID: "a1af5dd6-6577-4ee8-9f96-b2a5ce73258a"). InnerVolumeSpecName "kube-api-access-pfx8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:16:26.109437 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:26.108644    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-metrics-certs" pod "a1af5dd6-6577-4ee8-9f96-b2a5ce73258a" (UID: "a1af5dd6-6577-4ee8-9f96-b2a5ce73258a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:16:26.188882 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:26.188840    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:16:26.188882 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:26.188878    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfx8m\" (UniqueName: \"kubernetes.io/projected/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-kube-api-access-pfx8m\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:16:26.189115 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:26.188896    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:16:26.200359 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:26.200318    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:26.707685 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:26.707649    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:27.024381 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:27.024303    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"
Nov 02 22:16:27.024381 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:27.024340    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt" event={"ID":"a1af5dd6-6577-4ee8-9f96-b2a5ce73258a","Type":"ContainerDied","Data":"c073730573c0ef3140ed9cd6207a89fbe47e3a34915948369c0b512dfadc28f4"}
Nov 02 22:16:27.024564 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:27.024402    5076 scope.go:122] "RemoveContainer" containerID="6d38c87631744783cc1fff73fb9a7ded17acdede0f078aeac6bf68791017b57e"
Nov 02 22:16:27.057250 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:27.057209    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"]
Nov 02 22:16:27.057369 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:27.057300    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-10852f9c-cdc9876d4-cfblt"]
Nov 02 22:16:27.378315 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:27.378280    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:28.083762 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:28.083729    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:28.669867 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:28.669833    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:29.055132 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:29.055056    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a1af5dd6-6577-4ee8-9f96-b2a5ce73258a" path="/var/lib/kubelet/pods/a1af5dd6-6577-4ee8-9f96-b2a5ce73258a/volumes"
Nov 02 22:16:29.366833 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:29.366799    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:29.889571 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:16:29.889537    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:16:30.046494 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:30.046456    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:30.589084 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:30.589045    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:30.689710 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:30.689677    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:31.014537 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:31.014494    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:31.345104 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:31.344989    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:31.581845 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:31.581813    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:32.426247 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:32.426200    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:32.794744 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:32.794658    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:32.913524 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:32.913483    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:33.130376 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:33.129994    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:33.640161 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:33.622740    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:33.805266 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:33.803470    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:33.901934 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:33.901786    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:34.038086 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:34.038054    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:34.879547 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:34.879507    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:35.398480 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:35.398429    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:35.485315 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:35.485277    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:35.992788 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:35.992755    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:36.764272 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:36.763007    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:36.941242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:36.932848    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:37.464254 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:37.459605    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:38.173689 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:38.173653    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:38.799737 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:38.799693    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:39.408212 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:39.408180    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:40.035103 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:40.035066    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:40.136049 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:40.136009    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:40.507938 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:40.507901    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:40.888127 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:40.888085    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:40.978886 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:40.978852    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:41.097242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:41.093946    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:41.686756 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:41.686718    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:42.468944 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:42.468907    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:43.078817 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:43.078785    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:44.027366 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.027330    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"]
Nov 02 22:16:44.028170 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.028148    5076 cpu_manager.go:414] "containerMap: removing container" podUID="a1af5dd6-6577-4ee8-9f96-b2a5ce73258a" containerName="maas-api"
Nov 02 22:16:44.028170 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.028170    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a1af5dd6-6577-4ee8-9f96-b2a5ce73258a" containerName="maas-api"
Nov 02 22:16:44.028415 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.028190    5076 cpu_manager.go:414] "containerMap: removing container" podUID="e243c9ca-e8a2-4a1d-820c-5f536cf3d722" containerName="cleanup"
Nov 02 22:16:44.028415 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.028197    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e243c9ca-e8a2-4a1d-820c-5f536cf3d722" containerName="cleanup"
Nov 02 22:16:44.028415 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.028209    5076 cpu_manager.go:414] "containerMap: removing container" podUID="e243c9ca-e8a2-4a1d-820c-5f536cf3d722" containerName="cleanup"
Nov 02 22:16:44.028415 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.028232    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e243c9ca-e8a2-4a1d-820c-5f536cf3d722" containerName="cleanup"
Nov 02 22:16:44.028415 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.028264    5076 cpu_manager.go:414] "containerMap: removing container" podUID="733f2d26-543f-4263-8eb3-c6c25ae61a54" containerName="cleanup"
Nov 02 22:16:44.028415 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.028271    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="733f2d26-543f-4263-8eb3-c6c25ae61a54" containerName="cleanup"
Nov 02 22:16:44.028415 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.028301    5076 cpu_manager.go:414] "containerMap: removing container" podUID="733f2d26-543f-4263-8eb3-c6c25ae61a54" containerName="cleanup"
Nov 02 22:16:44.028415 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.028308    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="733f2d26-543f-4263-8eb3-c6c25ae61a54" containerName="cleanup"
Nov 02 22:16:44.028415 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.028326    5076 cpu_manager.go:414] "containerMap: removing container" podUID="733f2d26-543f-4263-8eb3-c6c25ae61a54" containerName="cleanup"
Nov 02 22:16:44.028415 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.028333    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="733f2d26-543f-4263-8eb3-c6c25ae61a54" containerName="cleanup"
Nov 02 22:16:44.028882 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.028496    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="733f2d26-543f-4263-8eb3-c6c25ae61a54" containerName="cleanup"
Nov 02 22:16:44.028882 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.028509    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="a1af5dd6-6577-4ee8-9f96-b2a5ce73258a" containerName="maas-api"
Nov 02 22:16:44.028882 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.028519    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="e243c9ca-e8a2-4a1d-820c-5f536cf3d722" containerName="cleanup"
Nov 02 22:16:44.028882 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.028530    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="733f2d26-543f-4263-8eb3-c6c25ae61a54" containerName="cleanup"
Nov 02 22:16:44.028882 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.028543    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="e243c9ca-e8a2-4a1d-820c-5f536cf3d722" containerName="cleanup"
Nov 02 22:16:44.032798 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.032775    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"
Nov 02 22:16:44.039594 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.039371    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w5-ac0910-serving-cert\""
Nov 02 22:16:44.045367 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.045345    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"]
Nov 02 22:16:44.075092 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.075033    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:44.120286 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.120255    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b001b82-1101-4177-af42-7636d39d53be-maas-api-tls\") pod \"maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt\" (UID: \"6b001b82-1101-4177-af42-7636d39d53be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"
Nov 02 22:16:44.120555 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.120530    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b001b82-1101-4177-af42-7636d39d53be-metrics-certs\") pod \"maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt\" (UID: \"6b001b82-1101-4177-af42-7636d39d53be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"
Nov 02 22:16:44.120737 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.120717    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb429\" (UniqueName: \"kubernetes.io/projected/6b001b82-1101-4177-af42-7636d39d53be-kube-api-access-xb429\") pod \"maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt\" (UID: \"6b001b82-1101-4177-af42-7636d39d53be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"
Nov 02 22:16:44.120958 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.120938    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b001b82-1101-4177-af42-7636d39d53be-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt\" (UID: \"6b001b82-1101-4177-af42-7636d39d53be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"
Nov 02 22:16:44.154620 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.154587    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:44.225620 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.224609    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b001b82-1101-4177-af42-7636d39d53be-maas-api-tls\") pod \"maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt\" (UID: \"6b001b82-1101-4177-af42-7636d39d53be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"
Nov 02 22:16:44.225620 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.224696    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b001b82-1101-4177-af42-7636d39d53be-metrics-certs\") pod \"maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt\" (UID: \"6b001b82-1101-4177-af42-7636d39d53be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"
Nov 02 22:16:44.225620 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.224741    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb429\" (UniqueName: \"kubernetes.io/projected/6b001b82-1101-4177-af42-7636d39d53be-kube-api-access-xb429\") pod \"maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt\" (UID: \"6b001b82-1101-4177-af42-7636d39d53be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"
Nov 02 22:16:44.225620 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.224912    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b001b82-1101-4177-af42-7636d39d53be-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt\" (UID: \"6b001b82-1101-4177-af42-7636d39d53be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"
Nov 02 22:16:44.236509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.232998    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b001b82-1101-4177-af42-7636d39d53be-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt\" (UID: \"6b001b82-1101-4177-af42-7636d39d53be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"
Nov 02 22:16:44.246673 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.246644    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b001b82-1101-4177-af42-7636d39d53be-maas-api-tls\") pod \"maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt\" (UID: \"6b001b82-1101-4177-af42-7636d39d53be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"
Nov 02 22:16:44.246846 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.246824    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b001b82-1101-4177-af42-7636d39d53be-metrics-certs\") pod \"maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt\" (UID: \"6b001b82-1101-4177-af42-7636d39d53be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"
Nov 02 22:16:44.248741 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.248713    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb429\" (UniqueName: \"kubernetes.io/projected/6b001b82-1101-4177-af42-7636d39d53be-kube-api-access-xb429\") pod \"maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt\" (UID: \"6b001b82-1101-4177-af42-7636d39d53be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"
Nov 02 22:16:44.356678 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.356648    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"
Nov 02 22:16:44.685392 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.685313    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:44.706430 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.706405    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"]
Nov 02 22:16:44.707005 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:16:44.706976    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b001b82_1101_4177_af42_7636d39d53be.slice/crio-fa2cc8a8ac3d6dfde994b7cb89f2f4d6fadce8fab745fba88110c41333f371f8 WatchSource:0}: Error finding container fa2cc8a8ac3d6dfde994b7cb89f2f4d6fadce8fab745fba88110c41333f371f8: Status 404 returned error can't find the container with id fa2cc8a8ac3d6dfde994b7cb89f2f4d6fadce8fab745fba88110c41333f371f8
Nov 02 22:16:44.788068 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:44.788035    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:45.072341 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:45.072255    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:45.485685 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:45.485650    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt" event={"ID":"6b001b82-1101-4177-af42-7636d39d53be","Type":"ContainerStarted","Data":"a1460c38c21d2d84d76e5ac06518f5784a5810469d4d1c5336112ac52ae43043"}
Nov 02 22:16:45.485860 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:45.485705    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt" event={"ID":"6b001b82-1101-4177-af42-7636d39d53be","Type":"ContainerStarted","Data":"fa2cc8a8ac3d6dfde994b7cb89f2f4d6fadce8fab745fba88110c41333f371f8"}
Nov 02 22:16:45.485860 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:45.485728    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"
Nov 02 22:16:45.506742 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:45.506692    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt" podStartSLOduration=0.877218683 podStartE2EDuration="1.506677631s" totalImagesPullingTime="629.458948ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:16:45.502200052 +0000 UTC m=+1114.558534433" watchObservedRunningTime="2026-11-02 22:16:45.506677631 +0000 UTC m=+1114.563012010"
Nov 02 22:16:45.728876 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:45.728840    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:45.931361 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:45.931325    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:46.030128 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:46.030036    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:46.724043 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:46.724006    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:46.855472 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:46.855435    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:47.535828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:47.535794    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:48.163565 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:48.163530    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:48.796834 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:48.796795    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:49.495385 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:49.495335    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:50.091863 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:50.091833    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:50.696587 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:50.696542    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:51.294019 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:51.293983    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:51.501484 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:51.501457    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"
Nov 02 22:16:51.971161 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:51.971129    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:52.543048 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.543009    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"]
Nov 02 22:16:52.544107 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.544072    5076 cpu_manager.go:414] "containerMap: removing container" podUID="e243c9ca-e8a2-4a1d-820c-5f536cf3d722" containerName="cleanup"
Nov 02 22:16:52.544107 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.544105    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e243c9ca-e8a2-4a1d-820c-5f536cf3d722" containerName="cleanup"
Nov 02 22:16:52.544381 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.544273    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="e243c9ca-e8a2-4a1d-820c-5f536cf3d722" containerName="cleanup"
Nov 02 22:16:52.544381 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.544294    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="733f2d26-543f-4263-8eb3-c6c25ae61a54" containerName="cleanup"
Nov 02 22:16:52.548802 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.548781    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"
Nov 02 22:16:52.575427 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.575401    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"]
Nov 02 22:16:52.582138 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.582113    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-2fc3ce-serving-cert\""
Nov 02 22:16:52.591021 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.590958    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq699\" (UniqueName: \"kubernetes.io/projected/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-kube-api-access-fq699\") pod \"maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch\" (UID: \"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"
Nov 02 22:16:52.591141 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.591083    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-metrics-certs\") pod \"maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch\" (UID: \"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"
Nov 02 22:16:52.591208 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.591146    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-maas-api-tls\") pod \"maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch\" (UID: \"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"
Nov 02 22:16:52.591444 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.591417    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-openshift-service-ca\") pod \"maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch\" (UID: \"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"
Nov 02 22:16:52.615197 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.615040    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:52.693281 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.693203    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq699\" (UniqueName: \"kubernetes.io/projected/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-kube-api-access-fq699\") pod \"maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch\" (UID: \"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"
Nov 02 22:16:52.693456 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.693322    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-metrics-certs\") pod \"maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch\" (UID: \"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"
Nov 02 22:16:52.693456 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.693363    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-maas-api-tls\") pod \"maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch\" (UID: \"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"
Nov 02 22:16:52.693740 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.693468    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-openshift-service-ca\") pod \"maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch\" (UID: \"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"
Nov 02 22:16:52.694388 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.694362    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-openshift-service-ca\") pod \"maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch\" (UID: \"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"
Nov 02 22:16:52.695366 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.695340    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:52.696306 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.696271    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-metrics-certs\") pod \"maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch\" (UID: \"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"
Nov 02 22:16:52.696464 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.696443    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-maas-api-tls\") pod \"maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch\" (UID: \"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"
Nov 02 22:16:52.700819 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.700794    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq699\" (UniqueName: \"kubernetes.io/projected/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-kube-api-access-fq699\") pod \"maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch\" (UID: \"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"
Nov 02 22:16:52.876419 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:52.876391    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"
Nov 02 22:16:53.314307 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:53.298151    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"]
Nov 02 22:16:53.505178 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:53.505137    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:53.581704 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:53.580340    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch" event={"ID":"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb","Type":"ContainerStarted","Data":"0ccf6319c656d1786ec4e6cafeb1c2c6a5861372d900941e61d1b7a2b1bf62f6"}
Nov 02 22:16:54.319795 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:54.319760    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:54.593122 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:54.593021    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch" event={"ID":"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb","Type":"ContainerStarted","Data":"38fc164bd4b62d340b42ca00c1dfe3403226a73475d9e0ae63e3187b6cffde66"}
Nov 02 22:16:54.594250 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:54.594212    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"
Nov 02 22:16:54.612987 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:54.612939    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch" podStartSLOduration=2.16063728 podStartE2EDuration="2.612925028s" totalImagesPullingTime="452.287748ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:16:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:16:54.611021869 +0000 UTC m=+1123.667356247" watchObservedRunningTime="2026-11-02 22:16:54.612925028 +0000 UTC m=+1123.669259418"
Nov 02 22:16:55.086661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:55.086629    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:55.361675 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:55.361644    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:55.785921 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:55.785824    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:55.886147 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:55.886104    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:56.197089 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:56.197047    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:56.432895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:56.429764    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:56.712589 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:56.712557    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:57.372353 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:57.372321    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:57.999033 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:57.998993    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:58.613033 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:58.612998    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:59.360582 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:59.360537    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:16:59.898184 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:16:59.898145    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:16:59.921356 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:16:59.921321    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:00.021439 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:00.021401    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:00.198603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:00.198516    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:00.607427 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:00.607402    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"
Nov 02 22:17:01.070053 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:01.069965    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:01.176261 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:01.173476    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:01.873267 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:01.873191    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:02.659588 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:02.659551    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:02.739439 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:02.739396    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:03.482770 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:03.482728    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:04.174341 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:04.174308    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:04.661972 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:04.661929    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:04.779691 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:04.779657    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:05.275783 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:05.275753    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:05.593017 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:05.592938    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:05.713766 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:05.713725    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:05.813962 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:05.813923    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:06.484711 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:06.484669    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:07.201752 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:07.201700    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:08.159837 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:08.159801    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:08.935069 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:08.935033    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:09.402366 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.402331    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:09.528205 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.528170    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"]
Nov 02 22:17:09.534876 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.534853    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"
Nov 02 22:17:09.556963 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.556933    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"]
Nov 02 22:17:09.564852 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.564830    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w5-a3713a-serving-cert\""
Nov 02 22:17:09.578455 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.578422    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:09.656406 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.655964    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdfkk\" (UniqueName: \"kubernetes.io/projected/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-kube-api-access-rdfkk\") pod \"maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn\" (UID: \"2b47428d-5d2c-4d14-94dd-8f251e5b5e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"
Nov 02 22:17:09.669829 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.667688    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn\" (UID: \"2b47428d-5d2c-4d14-94dd-8f251e5b5e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"
Nov 02 22:17:09.669829 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.667793    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-metrics-certs\") pod \"maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn\" (UID: \"2b47428d-5d2c-4d14-94dd-8f251e5b5e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"
Nov 02 22:17:09.669829 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.667939    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-maas-api-tls\") pod \"maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn\" (UID: \"2b47428d-5d2c-4d14-94dd-8f251e5b5e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"
Nov 02 22:17:09.677721 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.677683    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:09.771168 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.771131    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdfkk\" (UniqueName: \"kubernetes.io/projected/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-kube-api-access-rdfkk\") pod \"maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn\" (UID: \"2b47428d-5d2c-4d14-94dd-8f251e5b5e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"
Nov 02 22:17:09.771438 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.771208    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn\" (UID: \"2b47428d-5d2c-4d14-94dd-8f251e5b5e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"
Nov 02 22:17:09.771438 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.771313    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-metrics-certs\") pod \"maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn\" (UID: \"2b47428d-5d2c-4d14-94dd-8f251e5b5e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"
Nov 02 22:17:09.771561 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.771442    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-maas-api-tls\") pod \"maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn\" (UID: \"2b47428d-5d2c-4d14-94dd-8f251e5b5e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"
Nov 02 22:17:09.772648 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.772531    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn\" (UID: \"2b47428d-5d2c-4d14-94dd-8f251e5b5e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"
Nov 02 22:17:09.777258 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.775162    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-metrics-certs\") pod \"maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn\" (UID: \"2b47428d-5d2c-4d14-94dd-8f251e5b5e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"
Nov 02 22:17:09.777258 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.775641    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-maas-api-tls\") pod \"maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn\" (UID: \"2b47428d-5d2c-4d14-94dd-8f251e5b5e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"
Nov 02 22:17:09.781123 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.780201    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdfkk\" (UniqueName: \"kubernetes.io/projected/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-kube-api-access-rdfkk\") pod \"maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn\" (UID: \"2b47428d-5d2c-4d14-94dd-8f251e5b5e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"
Nov 02 22:17:09.795747 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.795712    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:09.867408 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.867371    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"
Nov 02 22:17:09.918439 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:09.918300    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:10.133904 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:10.133574    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:10.334262 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:10.322696    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"]
Nov 02 22:17:10.784084 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:10.784042    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn" event={"ID":"2b47428d-5d2c-4d14-94dd-8f251e5b5e93","Type":"ContainerStarted","Data":"603bd86083aa139f7c9e02e4a270ebdcc1550023fbb8dfc61633072860072375"}
Nov 02 22:17:10.894721 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:10.894695    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:11.137653 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:11.137619    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:11.226203 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:11.226155    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:11.792781 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:11.792747    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn" event={"ID":"2b47428d-5d2c-4d14-94dd-8f251e5b5e93","Type":"ContainerStarted","Data":"6cc2d34e859aa13ebb9af663d8e1014bfc692122a9649457ead63435a598c8e0"}
Nov 02 22:17:11.792965 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:11.792883    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"
Nov 02 22:17:11.812359 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:11.812307    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn" podStartSLOduration=2.317029704 podStartE2EDuration="2.812292391s" totalImagesPullingTime="495.262687ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:17:11.811157682 +0000 UTC m=+1140.867492083" watchObservedRunningTime="2026-11-02 22:17:11.812292391 +0000 UTC m=+1140.868626775"
Nov 02 22:17:12.027114 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:12.027073    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:12.690087 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:12.690034    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:13.497447 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:13.497404    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:14.198512 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:14.198474    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:14.930618 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:14.930579    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:15.835079 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:15.835038    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:16.590476 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:16.590428    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:17.440586 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:17.440540    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:17.844292 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:17.843428    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"
Nov 02 22:17:18.451240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:18.450875    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:18.663243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:18.662799    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:19.307250 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:19.306316    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-rg7sh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:17:19.307250 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:19.306382    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh" podUID="15d4c979-5871-42fa-9cb4-10ca87638d95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:17:19.631687 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:19.631647    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:20.477549 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:20.477514    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:21.155050 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.155016    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"]
Nov 02 22:17:21.190677 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.190630    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:21.199437 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.199411    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"]
Nov 02 22:17:21.199621 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.199524    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"
Nov 02 22:17:21.204453 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.204423    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-0dd701-serving-cert\""
Nov 02 22:17:21.300010 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.299953    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:21.378771 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.378732    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/055a0337-7655-445b-9f0d-b3c9c8ba61cb-openshift-service-ca\") pod \"maas-api-e2e-api-b-0dd701-76d99cb-sn9tw\" (UID: \"055a0337-7655-445b-9f0d-b3c9c8ba61cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"
Nov 02 22:17:21.379006 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.378968    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/055a0337-7655-445b-9f0d-b3c9c8ba61cb-metrics-certs\") pod \"maas-api-e2e-api-b-0dd701-76d99cb-sn9tw\" (UID: \"055a0337-7655-445b-9f0d-b3c9c8ba61cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"
Nov 02 22:17:21.379079 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.379003    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dqj8\" (UniqueName: \"kubernetes.io/projected/055a0337-7655-445b-9f0d-b3c9c8ba61cb-kube-api-access-6dqj8\") pod \"maas-api-e2e-api-b-0dd701-76d99cb-sn9tw\" (UID: \"055a0337-7655-445b-9f0d-b3c9c8ba61cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"
Nov 02 22:17:21.379079 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.379049    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/055a0337-7655-445b-9f0d-b3c9c8ba61cb-maas-api-tls\") pod \"maas-api-e2e-api-b-0dd701-76d99cb-sn9tw\" (UID: \"055a0337-7655-445b-9f0d-b3c9c8ba61cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"
Nov 02 22:17:21.480613 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.480517    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/055a0337-7655-445b-9f0d-b3c9c8ba61cb-metrics-certs\") pod \"maas-api-e2e-api-b-0dd701-76d99cb-sn9tw\" (UID: \"055a0337-7655-445b-9f0d-b3c9c8ba61cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"
Nov 02 22:17:21.490660 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.490621    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dqj8\" (UniqueName: \"kubernetes.io/projected/055a0337-7655-445b-9f0d-b3c9c8ba61cb-kube-api-access-6dqj8\") pod \"maas-api-e2e-api-b-0dd701-76d99cb-sn9tw\" (UID: \"055a0337-7655-445b-9f0d-b3c9c8ba61cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"
Nov 02 22:17:21.493352 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.492819    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/055a0337-7655-445b-9f0d-b3c9c8ba61cb-maas-api-tls\") pod \"maas-api-e2e-api-b-0dd701-76d99cb-sn9tw\" (UID: \"055a0337-7655-445b-9f0d-b3c9c8ba61cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"
Nov 02 22:17:21.493352 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.493106    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/055a0337-7655-445b-9f0d-b3c9c8ba61cb-openshift-service-ca\") pod \"maas-api-e2e-api-b-0dd701-76d99cb-sn9tw\" (UID: \"055a0337-7655-445b-9f0d-b3c9c8ba61cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"
Nov 02 22:17:21.499266 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.494938    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/055a0337-7655-445b-9f0d-b3c9c8ba61cb-openshift-service-ca\") pod \"maas-api-e2e-api-b-0dd701-76d99cb-sn9tw\" (UID: \"055a0337-7655-445b-9f0d-b3c9c8ba61cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"
Nov 02 22:17:21.499266 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.496777    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/055a0337-7655-445b-9f0d-b3c9c8ba61cb-maas-api-tls\") pod \"maas-api-e2e-api-b-0dd701-76d99cb-sn9tw\" (UID: \"055a0337-7655-445b-9f0d-b3c9c8ba61cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"
Nov 02 22:17:21.504037 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.503830    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/055a0337-7655-445b-9f0d-b3c9c8ba61cb-metrics-certs\") pod \"maas-api-e2e-api-b-0dd701-76d99cb-sn9tw\" (UID: \"055a0337-7655-445b-9f0d-b3c9c8ba61cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"
Nov 02 22:17:21.506193 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.506163    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dqj8\" (UniqueName: \"kubernetes.io/projected/055a0337-7655-445b-9f0d-b3c9c8ba61cb-kube-api-access-6dqj8\") pod \"maas-api-e2e-api-b-0dd701-76d99cb-sn9tw\" (UID: \"055a0337-7655-445b-9f0d-b3c9c8ba61cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"
Nov 02 22:17:21.515688 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.515651    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:21.517123 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.517100    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"
Nov 02 22:17:21.823321 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.822655    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"]
Nov 02 22:17:21.924269 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:21.924208    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw" event={"ID":"055a0337-7655-445b-9f0d-b3c9c8ba61cb","Type":"ContainerStarted","Data":"858ae2526c4c710033bc9d934170da35f49caa74950de14e7141ad5c545b6519"}
Nov 02 22:17:22.178929 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:22.178897    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:22.938592 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:22.938550    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw" event={"ID":"055a0337-7655-445b-9f0d-b3c9c8ba61cb","Type":"ContainerStarted","Data":"72b7349f5ad1b773a26718a65aa86f8299bfaa77512a13427cde5490b68a225c"}
Nov 02 22:17:22.938776 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:22.938755    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"
Nov 02 22:17:22.955633 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:22.955583    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw" podStartSLOduration=1.528093286 podStartE2EDuration="1.955566769s" totalImagesPullingTime="427.473483ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:17:22.953819254 +0000 UTC m=+1152.010153637" watchObservedRunningTime="2026-11-02 22:17:22.955566769 +0000 UTC m=+1152.011901153"
Nov 02 22:17:23.174835 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:23.174798    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:23.956422 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:23.956387    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:24.785270 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:24.785179    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:25.107666 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:25.107632    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:25.491850 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:25.491761    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:25.931231 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:25.931186    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"]
Nov 02 22:17:25.936910 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:25.936886    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:25.946995 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:25.946962    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"]
Nov 02 22:17:25.958103 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:25.958078    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-2fc3ce-openshift-default-dockercfg-8vm4z\""
Nov 02 22:17:25.981666 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:25.981630    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-podinfo\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:25.981834 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:25.981682    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5w9m\" (UniqueName: \"kubernetes.io/projected/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-kube-api-access-b5w9m\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:25.981834 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:25.981737    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-workload-certs\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:25.981834 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:25.981789    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-data\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:25.981834 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:25.981828    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istiod-ca-cert\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:25.982046 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:25.981882    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-workload-socket\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:25.982046 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:25.981957    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-credential-socket\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:25.982046 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:25.982000    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-envoy\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:25.982367 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:25.982085    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-token\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:26.083725 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.083685    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-credential-socket\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:26.083913 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.083756    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-envoy\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:26.083913 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.083853    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-token\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:26.084060 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.084042    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-podinfo\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:26.084128 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.084074    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-credential-socket\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:26.084128 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.084078    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5w9m\" (UniqueName: \"kubernetes.io/projected/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-kube-api-access-b5w9m\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:26.084285 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.084185    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-workload-certs\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:26.084285 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.084275    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-data\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:26.084405 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.084320    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istiod-ca-cert\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:26.084405 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.084383    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-workload-socket\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:26.084521 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.084504    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-workload-certs\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:26.084626 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.084606    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-data\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:26.084807 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.084785    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-workload-socket\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:26.085038 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.085018    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istiod-ca-cert\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:26.086653 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.086627    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-envoy\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:26.086998 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.086979    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-podinfo\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:26.091759 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.091734    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-token\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:26.092272 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.092200    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5w9m\" (UniqueName: \"kubernetes.io/projected/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-kube-api-access-b5w9m\") pod \"e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") " pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:26.238672 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.238592    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:26.258102 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.258076    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:26.353164 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.353115    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:26.580519 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.580486    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"]
Nov 02 22:17:26.580901 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:17:26.580828    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c01d5e_a9e5_45a4_a6cf_a9343cf702f5.slice/crio-f84c8f45bc07a012e17d0a3add70c27a19e4e84eaa8fd8a0d2f85ebd8d61950a WatchSource:0}: Error finding container f84c8f45bc07a012e17d0a3add70c27a19e4e84eaa8fd8a0d2f85ebd8d61950a: Status 404 returned error can't find the container with id f84c8f45bc07a012e17d0a3add70c27a19e4e84eaa8fd8a0d2f85ebd8d61950a
Nov 02 22:17:26.584341 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.584303    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:17:26.584429 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.584373    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:17:26.584429 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.584409    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:17:26.806277 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.804666    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:26.905812 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:26.905773    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:27.016119 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:27.015160    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj" event={"ID":"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5","Type":"ContainerStarted","Data":"acf9685e17dae9080062962361c364a56cf9d2bbb0c81050b533f94ac4332895"}
Nov 02 22:17:27.016119 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:27.015256    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj" event={"ID":"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5","Type":"ContainerStarted","Data":"f84c8f45bc07a012e17d0a3add70c27a19e4e84eaa8fd8a0d2f85ebd8d61950a"}
Nov 02 22:17:27.167291 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:27.166468    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj" podStartSLOduration=2.166450802 podStartE2EDuration="2.166450802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:17:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:17:27.036935493 +0000 UTC m=+1156.093269874" watchObservedRunningTime="2026-11-02 22:17:27.166450802 +0000 UTC m=+1156.222785181"
Nov 02 22:17:27.244012 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:27.243960    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:27.260102 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:27.258611    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:27.260295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:27.260112    5076 patch_prober.go:29] interesting pod/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Nov 02 22:17:27.260295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:27.260198    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj" podUID="90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Nov 02 22:17:28.025856 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:28.025824    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:28.262762 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:28.262354    5076 patch_prober.go:29] interesting pod/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Nov 02 22:17:28.262762 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:28.262421    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj" podUID="90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Nov 02 22:17:28.710944 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:28.710913    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:28.951789 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:28.951766    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"
Nov 02 22:17:29.258581 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:29.258539    5076 patch_prober.go:29] interesting pod/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Nov 02 22:17:29.259396 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:29.258860    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj" podUID="90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Nov 02 22:17:29.659673 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:29.659635    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:29.919829 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:17:29.919720    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:17:30.259342 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:30.259257    5076 patch_prober.go:29] interesting pod/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Nov 02 22:17:30.259342 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:30.259326    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj" podUID="90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Nov 02 22:17:30.693239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:30.692808    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:31.259497 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:31.259465    5076 patch_prober.go:29] interesting pod/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Nov 02 22:17:31.259689 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:31.259537    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj" podUID="90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Nov 02 22:17:31.322704 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:31.322668    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:31.420990 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:31.420960    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:31.785244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:31.782950    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:32.259320 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:32.259281    5076 patch_prober.go:29] interesting pod/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Nov 02 22:17:32.259513 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:32.259343    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj" podUID="90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Nov 02 22:17:32.544560 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:32.544458    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:32.649140 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:32.649096    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:32.814887 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:32.814785    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:33.258759 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:33.258727    5076 patch_prober.go:29] interesting pod/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Nov 02 22:17:33.258953 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:33.258784    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj" podUID="90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Nov 02 22:17:33.469287 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:33.469240    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:34.004159 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:34.004125    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:34.235833 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:34.235797    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:34.285665 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:34.285579    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:34.290245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:34.286855    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:34.290245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:34.289004    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:17:34.442043 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:34.442009    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:35.147750 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:35.147712    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:35.250754 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:35.250722    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:35.980893 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:35.980855    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:36.599042 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:36.598998    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:37.187265 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:37.187200    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:38.069659 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:38.069621    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:38.685706 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:38.685673    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:39.294594 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:39.294560    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:39.987326 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:39.987198    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:40.674151 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:40.674105    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:40.804260 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:40.804211    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:41.250109 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.250075    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"]
Nov 02 22:17:41.256320 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.256296    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"
Nov 02 22:17:41.265545 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.265522    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-d9416f-serving-cert\""
Nov 02 22:17:41.274876 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.274851    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"]
Nov 02 22:17:41.284541 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.284507    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-metrics-certs\") pod \"maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc\" (UID: \"f2c1306a-dd49-4ea2-8306-c7017ecf97b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"
Nov 02 22:17:41.284667 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.284633    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-maas-api-tls\") pod \"maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc\" (UID: \"f2c1306a-dd49-4ea2-8306-c7017ecf97b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"
Nov 02 22:17:41.284721 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.284695    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckvr9\" (UniqueName: \"kubernetes.io/projected/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-kube-api-access-ckvr9\") pod \"maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc\" (UID: \"f2c1306a-dd49-4ea2-8306-c7017ecf97b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"
Nov 02 22:17:41.284905 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.284890    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-openshift-service-ca\") pod \"maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc\" (UID: \"f2c1306a-dd49-4ea2-8306-c7017ecf97b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"
Nov 02 22:17:41.302839 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.302814    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:41.385837 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.385806    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-openshift-service-ca\") pod \"maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc\" (UID: \"f2c1306a-dd49-4ea2-8306-c7017ecf97b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"
Nov 02 22:17:41.385991 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.385929    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-metrics-certs\") pod \"maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc\" (UID: \"f2c1306a-dd49-4ea2-8306-c7017ecf97b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"
Nov 02 22:17:41.386059 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.386040    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-maas-api-tls\") pod \"maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc\" (UID: \"f2c1306a-dd49-4ea2-8306-c7017ecf97b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"
Nov 02 22:17:41.386118 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.386102    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckvr9\" (UniqueName: \"kubernetes.io/projected/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-kube-api-access-ckvr9\") pod \"maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc\" (UID: \"f2c1306a-dd49-4ea2-8306-c7017ecf97b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"
Nov 02 22:17:41.386514 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.386491    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-openshift-service-ca\") pod \"maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc\" (UID: \"f2c1306a-dd49-4ea2-8306-c7017ecf97b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"
Nov 02 22:17:41.388361 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.388343    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-metrics-certs\") pod \"maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc\" (UID: \"f2c1306a-dd49-4ea2-8306-c7017ecf97b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"
Nov 02 22:17:41.388440 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.388418    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-maas-api-tls\") pod \"maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc\" (UID: \"f2c1306a-dd49-4ea2-8306-c7017ecf97b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"
Nov 02 22:17:41.394250 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.394192    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckvr9\" (UniqueName: \"kubernetes.io/projected/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-kube-api-access-ckvr9\") pod \"maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc\" (UID: \"f2c1306a-dd49-4ea2-8306-c7017ecf97b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"
Nov 02 22:17:41.397390 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.397365    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:41.592088 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.591990    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"
Nov 02 22:17:41.928654 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.928619    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"]
Nov 02 22:17:41.975721 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.975067    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"]
Nov 02 22:17:41.975721 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:41.975378    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg" podUID="beeb9085-15f2-42f7-8f76-6739e4b4cdc2" containerName="maas-api" containerID="cri-o://8f4e08c8c40d286d249ce4dcb8c971db827d9e278287803c1c2dede153e7daca" gracePeriod=30
Nov 02 22:17:42.026852 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:42.025247    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:42.130496 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:42.130191    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg" podUID="beeb9085-15f2-42f7-8f76-6739e4b4cdc2" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.101:8443/health\": dial tcp 10.132.0.101:8443: connect: connection refused"
Nov 02 22:17:42.406249 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:42.395095    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:42.468249 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:42.467989    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc" event={"ID":"f2c1306a-dd49-4ea2-8306-c7017ecf97b2","Type":"ContainerStarted","Data":"e198a5c48c47e90b74a8676d3328519a4d87e9a11e39250c48b91b6578ba7494"}
Nov 02 22:17:42.503620 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:42.503587    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:42.519278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:42.516495    5076 generic.go:356] "Generic (PLEG): container finished" podID="beeb9085-15f2-42f7-8f76-6739e4b4cdc2" containerID="8f4e08c8c40d286d249ce4dcb8c971db827d9e278287803c1c2dede153e7daca" exitCode=0
Nov 02 22:17:42.519278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:42.516598    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg" event={"ID":"beeb9085-15f2-42f7-8f76-6739e4b4cdc2","Type":"ContainerDied","Data":"8f4e08c8c40d286d249ce4dcb8c971db827d9e278287803c1c2dede153e7daca"}
Nov 02 22:17:42.673510 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:42.673430    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:42.921614 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:42.921587    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"
Nov 02 22:17:42.977911 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:42.977671    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-openshift-service-ca\") pod \"beeb9085-15f2-42f7-8f76-6739e4b4cdc2\" (UID: \"beeb9085-15f2-42f7-8f76-6739e4b4cdc2\") "
Nov 02 22:17:42.977911 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:42.977719    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-kube-api-access-rbxrn\" (UniqueName: \"kubernetes.io/projected/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-kube-api-access-rbxrn\") pod \"beeb9085-15f2-42f7-8f76-6739e4b4cdc2\" (UID: \"beeb9085-15f2-42f7-8f76-6739e4b4cdc2\") "
Nov 02 22:17:42.977911 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:42.977825    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-metrics-certs\" (UniqueName: \"kubernetes.io/secret/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-metrics-certs\") pod \"beeb9085-15f2-42f7-8f76-6739e4b4cdc2\" (UID: \"beeb9085-15f2-42f7-8f76-6739e4b4cdc2\") "
Nov 02 22:17:42.977911 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:42.977919    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-maas-api-tls\") pod \"beeb9085-15f2-42f7-8f76-6739e4b4cdc2\" (UID: \"beeb9085-15f2-42f7-8f76-6739e4b4cdc2\") "
Nov 02 22:17:42.981696 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:42.981482    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-maas-api-tls" pod "beeb9085-15f2-42f7-8f76-6739e4b4cdc2" (UID: "beeb9085-15f2-42f7-8f76-6739e4b4cdc2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:17:42.982330 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:42.982019    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-openshift-service-ca" pod "beeb9085-15f2-42f7-8f76-6739e4b4cdc2" (UID: "beeb9085-15f2-42f7-8f76-6739e4b4cdc2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:17:43.004345 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:43.004309    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-metrics-certs" pod "beeb9085-15f2-42f7-8f76-6739e4b4cdc2" (UID: "beeb9085-15f2-42f7-8f76-6739e4b4cdc2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:17:43.004535 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:43.004344    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-kube-api-access-rbxrn" pod "beeb9085-15f2-42f7-8f76-6739e4b4cdc2" (UID: "beeb9085-15f2-42f7-8f76-6739e4b4cdc2"). InnerVolumeSpecName "kube-api-access-rbxrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:17:43.080280 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:43.080244    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:17:43.080280 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:43.080282    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:17:43.080512 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:43.080299    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:17:43.080512 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:43.080314    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbxrn\" (UniqueName: \"kubernetes.io/projected/beeb9085-15f2-42f7-8f76-6739e4b4cdc2-kube-api-access-rbxrn\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:17:43.526505 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:43.526467    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc" event={"ID":"f2c1306a-dd49-4ea2-8306-c7017ecf97b2","Type":"ContainerStarted","Data":"d9ec9435589e35ccdf0d8fc4759b46ef5f2bac13a74ac11a3ec67340671a0dc4"}
Nov 02 22:17:43.526693 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:43.526540    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"
Nov 02 22:17:43.527958 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:43.527931    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"
Nov 02 22:17:43.528085 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:43.527973    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg" event={"ID":"beeb9085-15f2-42f7-8f76-6739e4b4cdc2","Type":"ContainerDied","Data":"42aadd89cccc0b2ca0526f0d497c60d1d03c991de8555c9ecbb8bfff24faa2c9"}
Nov 02 22:17:43.528085 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:43.528026    5076 scope.go:122] "RemoveContainer" containerID="8f4e08c8c40d286d249ce4dcb8c971db827d9e278287803c1c2dede153e7daca"
Nov 02 22:17:43.545934 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:43.545890    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc" podStartSLOduration=1.874669865 podStartE2EDuration="2.545877494s" totalImagesPullingTime="671.207629ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:17:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:17:43.541956073 +0000 UTC m=+1172.598290453" watchObservedRunningTime="2026-11-02 22:17:43.545877494 +0000 UTC m=+1172.602211873"
Nov 02 22:17:43.561148 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:43.561122    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"]
Nov 02 22:17:43.566352 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:43.566329    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-lfcbg"]
Nov 02 22:17:43.608784 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:43.608754    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:44.303187 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:44.303124    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:44.991566 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:44.991521    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:45.079455 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:45.079414    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="beeb9085-15f2-42f7-8f76-6739e4b4cdc2" path="/var/lib/kubelet/pods/beeb9085-15f2-42f7-8f76-6739e4b4cdc2/volumes"
Nov 02 22:17:45.885086 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:45.885046    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:46.438172 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:46.438138    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:46.678874 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:46.678842    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:47.148176 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:47.148137    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:47.291610 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:47.291570    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:47.634960 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:47.634920    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:47.727640 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:47.727584    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:47.991946 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:47.991757    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:48.787480 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:48.787442    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:49.444893 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:49.444863    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:49.545539 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:49.545512    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"
Nov 02 22:17:49.690774 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:49.690741    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:49.778156 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:49.778068    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:50.041407 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:50.041256    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:50.140149 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:50.140115    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:50.661641 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:50.661609    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:51.265625 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:51.265586    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:52.082924 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:52.082887    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:53.031445 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:53.031368    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:53.953070 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:53.953033    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"]
Nov 02 22:17:53.954191 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:53.954163    5076 cpu_manager.go:414] "containerMap: removing container" podUID="beeb9085-15f2-42f7-8f76-6739e4b4cdc2" containerName="maas-api"
Nov 02 22:17:53.954191 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:53.954191    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="beeb9085-15f2-42f7-8f76-6739e4b4cdc2" containerName="maas-api"
Nov 02 22:17:53.954381 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:53.954371    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="beeb9085-15f2-42f7-8f76-6739e4b4cdc2" containerName="maas-api"
Nov 02 22:17:53.960531 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:53.960508    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"
Nov 02 22:17:53.964744 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:53.964713    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-84a94060-serving-cert\""
Nov 02 22:17:53.964917 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:53.964887    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"]
Nov 02 22:17:54.070616 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:54.060624    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:54.131443 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:54.131406    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-openshift-service-ca\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp\" (UID: \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"
Nov 02 22:17:54.131729 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:54.131703    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sqrb\" (UniqueName: \"kubernetes.io/projected/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-kube-api-access-9sqrb\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp\" (UID: \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"
Nov 02 22:17:54.131890 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:54.131873    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-maas-api-tls\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp\" (UID: \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"
Nov 02 22:17:54.132519 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:54.132204    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-metrics-certs\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp\" (UID: \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"
Nov 02 22:17:54.209053 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:54.208974    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:54.241242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:54.236396    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-metrics-certs\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp\" (UID: \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"
Nov 02 22:17:54.241242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:54.236619    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-openshift-service-ca\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp\" (UID: \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"
Nov 02 22:17:54.241242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:54.236657    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sqrb\" (UniqueName: \"kubernetes.io/projected/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-kube-api-access-9sqrb\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp\" (UID: \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"
Nov 02 22:17:54.241242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:54.236691    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-maas-api-tls\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp\" (UID: \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"
Nov 02 22:17:54.241242 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:17:54.236935    5076 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-serving-cert: secret "maas-api-e2e-mt-84a94060-serving-cert" not found
Nov 02 22:17:54.241242 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:17:54.237001    5076 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-maas-api-tls podName:1dd5da05-cea6-44c8-b1e9-dbdc846fec07 nodeName:}" failed. No retries permitted until 2026-11-02 22:17:54.736980901 +0000 UTC m=+1183.793315264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-maas-api-tls") pod "maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp" (UID: "1dd5da05-cea6-44c8-b1e9-dbdc846fec07") : secret "maas-api-e2e-mt-84a94060-serving-cert" not found
Nov 02 22:17:54.267237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:54.257924    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-openshift-service-ca\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp\" (UID: \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"
Nov 02 22:17:54.267237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:54.266955    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sqrb\" (UniqueName: \"kubernetes.io/projected/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-kube-api-access-9sqrb\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp\" (UID: \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"
Nov 02 22:17:54.279648 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:54.277747    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-metrics-certs\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp\" (UID: \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"
Nov 02 22:17:54.364263 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:54.362331    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:54.748899 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:54.748858    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-maas-api-tls\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp\" (UID: \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"
Nov 02 22:17:54.783663 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:54.778889    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-maas-api-tls\") pod \"maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp\" (UID: \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"
Nov 02 22:17:54.888240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:54.887453    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"
Nov 02 22:17:55.688940 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:55.680258    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"]
Nov 02 22:17:55.688940 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:55.687370    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:56.442831 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:56.442803    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:56.656327 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:56.656292    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:56.728118 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:56.726379    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp" event={"ID":"1dd5da05-cea6-44c8-b1e9-dbdc846fec07","Type":"ContainerStarted","Data":"7fabf37b54168a1df576e794101c74c7d93b3c3c672501b95c5d573ab8fcb35e"}
Nov 02 22:17:56.728118 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:56.726449    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp" event={"ID":"1dd5da05-cea6-44c8-b1e9-dbdc846fec07","Type":"ContainerStarted","Data":"3232e9b57de96a49e2dfbf17f1c1fc7ee565cc416fb34b097aee5acc5f2f25c8"}
Nov 02 22:17:56.728118 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:56.727930    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"
Nov 02 22:17:56.796249 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:56.795854    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp" podStartSLOduration=3.239036561 podStartE2EDuration="3.795832214s" totalImagesPullingTime="556.795653ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:17:56.76283663 +0000 UTC m=+1185.819171011" watchObservedRunningTime="2026-11-02 22:17:56.795832214 +0000 UTC m=+1185.852166595"
Nov 02 22:17:56.929826 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:56.926937    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:57.148257 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:57.131808    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:57.584335 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:57.577207    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:58.071040 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:58.070782    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:58.386098 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:58.386016    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:59.202244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:17:59.202199    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:17:59.894715 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:17:59.894674    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:18:00.017951 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:00.017909    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:00.876283 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:00.876204    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:01.684329 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:01.684285    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:02.189770 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:02.189732    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:02.289456 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:02.289419    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:02.601153 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:02.601067    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:03.557043 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:03.557010    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:03.659322 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:03.659289    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:03.964694 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:03.964649    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:04.069687 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:04.069659    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"
Nov 02 22:18:04.423081 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:04.423047    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:04.686584 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:04.686494    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:05.160865 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:05.160825    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"]
Nov 02 22:18:05.161361 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:05.161330    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch" podUID="d9ae8d50-4cb1-4a1f-8454-08c747e63bdb" containerName="maas-api" containerID="cri-o://38fc164bd4b62d340b42ca00c1dfe3403226a73475d9e0ae63e3187b6cffde66" gracePeriod=30
Nov 02 22:18:05.204160 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:05.204115    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:05.335488 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:05.335444    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:05.425285 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:05.417771    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:05.656657 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:05.656620    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"
Nov 02 22:18:05.730881 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:05.730790    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-maas-api-tls\") pod \"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb\" (UID: \"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb\") "
Nov 02 22:18:05.731661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:05.731634    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-kube-api-access-fq699\" (UniqueName: \"kubernetes.io/projected/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-kube-api-access-fq699\") pod \"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb\" (UID: \"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb\") "
Nov 02 22:18:05.731918 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:05.731899    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-metrics-certs\") pod \"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb\" (UID: \"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb\") "
Nov 02 22:18:05.732161 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:05.732143    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-openshift-service-ca\") pod \"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb\" (UID: \"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb\") "
Nov 02 22:18:05.737385 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:05.737357    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-openshift-service-ca" pod "d9ae8d50-4cb1-4a1f-8454-08c747e63bdb" (UID: "d9ae8d50-4cb1-4a1f-8454-08c747e63bdb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:18:05.761174 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:05.761095    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-maas-api-tls" pod "d9ae8d50-4cb1-4a1f-8454-08c747e63bdb" (UID: "d9ae8d50-4cb1-4a1f-8454-08c747e63bdb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:18:05.761597 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:05.761563    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-metrics-certs" pod "d9ae8d50-4cb1-4a1f-8454-08c747e63bdb" (UID: "d9ae8d50-4cb1-4a1f-8454-08c747e63bdb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:18:05.763886 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:05.763862    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-kube-api-access-fq699" pod "d9ae8d50-4cb1-4a1f-8454-08c747e63bdb" (UID: "d9ae8d50-4cb1-4a1f-8454-08c747e63bdb"). InnerVolumeSpecName "kube-api-access-fq699". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:18:05.807013 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:05.806931    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:05.834481 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:05.834449    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fq699\" (UniqueName: \"kubernetes.io/projected/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-kube-api-access-fq699\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:05.834481 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:05.834481    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:05.834700 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:05.834493    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:05.834700 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:05.834502    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:05.907051 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:05.906984    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:06.173616 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:06.173581    5076 generic.go:356] "Generic (PLEG): container finished" podID="d9ae8d50-4cb1-4a1f-8454-08c747e63bdb" containerID="38fc164bd4b62d340b42ca00c1dfe3403226a73475d9e0ae63e3187b6cffde66" exitCode=0
Nov 02 22:18:06.173845 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:06.173661    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch" event={"ID":"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb","Type":"ContainerDied","Data":"38fc164bd4b62d340b42ca00c1dfe3403226a73475d9e0ae63e3187b6cffde66"}
Nov 02 22:18:06.173845 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:06.173779    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch" event={"ID":"d9ae8d50-4cb1-4a1f-8454-08c747e63bdb","Type":"ContainerDied","Data":"0ccf6319c656d1786ec4e6cafeb1c2c6a5861372d900941e61d1b7a2b1bf62f6"}
Nov 02 22:18:06.173845 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:06.173819    5076 scope.go:122] "RemoveContainer" containerID="38fc164bd4b62d340b42ca00c1dfe3403226a73475d9e0ae63e3187b6cffde66"
Nov 02 22:18:06.174033 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:06.174016    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"
Nov 02 22:18:06.203020 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:06.202994    5076 scope.go:122] "RemoveContainer" containerID="38fc164bd4b62d340b42ca00c1dfe3403226a73475d9e0ae63e3187b6cffde66"
Nov 02 22:18:06.203458 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:18:06.203435    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38fc164bd4b62d340b42ca00c1dfe3403226a73475d9e0ae63e3187b6cffde66\": container with ID starting with 38fc164bd4b62d340b42ca00c1dfe3403226a73475d9e0ae63e3187b6cffde66 not found: ID does not exist" containerID="38fc164bd4b62d340b42ca00c1dfe3403226a73475d9e0ae63e3187b6cffde66"
Nov 02 22:18:06.203560 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:06.203472    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38fc164bd4b62d340b42ca00c1dfe3403226a73475d9e0ae63e3187b6cffde66"} err="failed to get container status \"38fc164bd4b62d340b42ca00c1dfe3403226a73475d9e0ae63e3187b6cffde66\": rpc error: code = NotFound desc = could not find container \"38fc164bd4b62d340b42ca00c1dfe3403226a73475d9e0ae63e3187b6cffde66\": container with ID starting with 38fc164bd4b62d340b42ca00c1dfe3403226a73475d9e0ae63e3187b6cffde66 not found: ID does not exist"
Nov 02 22:18:06.219317 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:06.219291    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"]
Nov 02 22:18:06.233393 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:06.233326    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch"]
Nov 02 22:18:06.575558 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:06.575483    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:07.054987 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:07.054956    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d9ae8d50-4cb1-4a1f-8454-08c747e63bdb" path="/var/lib/kubelet/pods/d9ae8d50-4cb1-4a1f-8454-08c747e63bdb/volumes"
Nov 02 22:18:07.261252 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:07.261205    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:07.886959 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:07.886929    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:08.507368 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:08.507337    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:08.608133 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:08.605314    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2fc3ce-5c66bf9c5f-vbtch" podUID="d9ae8d50-4cb1-4a1f-8454-08c747e63bdb" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.103:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:18:09.612425 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:09.612390    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:10.383506 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:10.383469    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:11.069280 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:11.069243    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:11.863041 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:11.863002    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:12.135245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:12.135187    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:12.229564 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:12.229521    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:12.453905 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:12.453819    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"]
Nov 02 22:18:12.454125 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:12.454092    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj" podUID="90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" containerName="istio-proxy" containerID="cri-o://acf9685e17dae9080062962361c364a56cf9d2bbb0c81050b533f94ac4332895" gracePeriod=30
Nov 02 22:18:12.481004 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:12.480442    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:12.580380 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:12.580348    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:13.595099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:13.595069    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:14.144517 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.144484    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"]
Nov 02 22:18:14.145253 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.145201    5076 cpu_manager.go:414] "containerMap: removing container" podUID="d9ae8d50-4cb1-4a1f-8454-08c747e63bdb" containerName="maas-api"
Nov 02 22:18:14.145253 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.145231    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d9ae8d50-4cb1-4a1f-8454-08c747e63bdb" containerName="maas-api"
Nov 02 22:18:14.145420 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.145352    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="d9ae8d50-4cb1-4a1f-8454-08c747e63bdb" containerName="maas-api"
Nov 02 22:18:14.151145 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.151119    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"
Nov 02 22:18:14.164630 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.159657    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"]
Nov 02 22:18:14.171063 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.171027    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-14dae2-serving-cert\""
Nov 02 22:18:14.188731 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.188700    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:14.289143 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.289108    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:14.328884 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.328853    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-metrics-certs\") pod \"maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg\" (UID: \"a08c99df-f131-4c6e-9a15-c5ae142ca5c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"
Nov 02 22:18:14.329023 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.328908    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlfxf\" (UniqueName: \"kubernetes.io/projected/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-kube-api-access-mlfxf\") pod \"maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg\" (UID: \"a08c99df-f131-4c6e-9a15-c5ae142ca5c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"
Nov 02 22:18:14.329023 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.328973    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-openshift-service-ca\") pod \"maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg\" (UID: \"a08c99df-f131-4c6e-9a15-c5ae142ca5c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"
Nov 02 22:18:14.329277 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.329253    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-maas-api-tls\") pod \"maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg\" (UID: \"a08c99df-f131-4c6e-9a15-c5ae142ca5c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"
Nov 02 22:18:14.392913 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.391891    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:14.431370 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.431279    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlfxf\" (UniqueName: \"kubernetes.io/projected/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-kube-api-access-mlfxf\") pod \"maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg\" (UID: \"a08c99df-f131-4c6e-9a15-c5ae142ca5c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"
Nov 02 22:18:14.431672 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.431622    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-openshift-service-ca\") pod \"maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg\" (UID: \"a08c99df-f131-4c6e-9a15-c5ae142ca5c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"
Nov 02 22:18:14.431964 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.431939    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-maas-api-tls\") pod \"maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg\" (UID: \"a08c99df-f131-4c6e-9a15-c5ae142ca5c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"
Nov 02 22:18:14.432098 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.432053    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-metrics-certs\") pod \"maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg\" (UID: \"a08c99df-f131-4c6e-9a15-c5ae142ca5c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"
Nov 02 22:18:14.432722 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.432600    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-openshift-service-ca\") pod \"maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg\" (UID: \"a08c99df-f131-4c6e-9a15-c5ae142ca5c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"
Nov 02 22:18:14.435346 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.435319    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-maas-api-tls\") pod \"maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg\" (UID: \"a08c99df-f131-4c6e-9a15-c5ae142ca5c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"
Nov 02 22:18:14.435908 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.435882    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-metrics-certs\") pod \"maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg\" (UID: \"a08c99df-f131-4c6e-9a15-c5ae142ca5c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"
Nov 02 22:18:14.440462 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.440437    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlfxf\" (UniqueName: \"kubernetes.io/projected/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-kube-api-access-mlfxf\") pod \"maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg\" (UID: \"a08c99df-f131-4c6e-9a15-c5ae142ca5c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"
Nov 02 22:18:14.496553 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.496508    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"
Nov 02 22:18:14.925063 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:14.913745    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"]
Nov 02 22:18:15.114932 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:15.114901    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:15.349688 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:15.349614    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg" event={"ID":"a08c99df-f131-4c6e-9a15-c5ae142ca5c9","Type":"ContainerStarted","Data":"fc53dbf3fd20248d472d98c87eca843bea500fc5d797b3011c3c47ca622c333b"}
Nov 02 22:18:15.895901 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:15.895862    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:16.363304 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:16.363264    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg" event={"ID":"a08c99df-f131-4c6e-9a15-c5ae142ca5c9","Type":"ContainerStarted","Data":"c8e4a6467cbd9e686ebe09dd4eb9fe079a22860251c7dea108efe4221d286180"}
Nov 02 22:18:16.382981 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:16.382930    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg" podStartSLOduration=1.927838476 podStartE2EDuration="2.382913908s" totalImagesPullingTime="455.075432ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:18:16.379747482 +0000 UTC m=+1205.436081864" watchObservedRunningTime="2026-11-02 22:18:16.382913908 +0000 UTC m=+1205.439248289"
Nov 02 22:18:16.669700 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:16.669605    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:17.177981 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:17.177926    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:17.296782 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:17.296738    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:17.377066 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:17.377028    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"
Nov 02 22:18:17.630279 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:17.628100    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:18.078276 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.077531    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:18:18.226240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.225058    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-kube-api-access-b5w9m\" (UniqueName: \"kubernetes.io/projected/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-kube-api-access-b5w9m\") pod \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") "
Nov 02 22:18:18.226240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.225761    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-workload-socket\") pod \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") "
Nov 02 22:18:18.226240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.225827    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-podinfo\") pod \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") "
Nov 02 22:18:18.226240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.225950    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-data\") pod \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") "
Nov 02 22:18:18.226240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.226131    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istiod-ca-cert\") pod \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") "
Nov 02 22:18:18.226240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.226236    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-token\" (UniqueName: \"kubernetes.io/projected/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-token\") pod \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") "
Nov 02 22:18:18.226675 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.226288    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-envoy\") pod \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") "
Nov 02 22:18:18.226675 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.226359    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-credential-socket\") pod \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") "
Nov 02 22:18:18.226675 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.226410    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-workload-certs\") pod \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\" (UID: \"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5\") "
Nov 02 22:18:18.228569 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.228489    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-data" pod "90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" (UID: "90c01d5e-a9e5-45a4-a6cf-a9343cf702f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:18:18.233249 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.232279    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-podinfo" pod "90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" (UID: "90c01d5e-a9e5-45a4-a6cf-a9343cf702f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:18:18.238357 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.238325    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-workload-socket" pod "90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" (UID: "90c01d5e-a9e5-45a4-a6cf-a9343cf702f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:18:18.238554 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.238405    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-workload-certs" pod "90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" (UID: "90c01d5e-a9e5-45a4-a6cf-a9343cf702f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:18:18.238644 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.238624    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-credential-socket" pod "90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" (UID: "90c01d5e-a9e5-45a4-a6cf-a9343cf702f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:18:18.238799 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.238776    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istiod-ca-cert" pod "90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" (UID: "90c01d5e-a9e5-45a4-a6cf-a9343cf702f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:18:18.245788 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.245524    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-token" pod "90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" (UID: "90c01d5e-a9e5-45a4-a6cf-a9343cf702f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:18:18.245788 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.245691    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-envoy" pod "90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" (UID: "90c01d5e-a9e5-45a4-a6cf-a9343cf702f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:18:18.250355 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.248017    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-kube-api-access-b5w9m" pod "90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" (UID: "90c01d5e-a9e5-45a4-a6cf-a9343cf702f5"). InnerVolumeSpecName "kube-api-access-b5w9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:18:18.255295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.255192    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:18.330715 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.330620    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5w9m\" (UniqueName: \"kubernetes.io/projected/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-kube-api-access-b5w9m\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:18.330715 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.330657    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:18.330715 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.330673    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:18.330715 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.330686    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:18.330715 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.330702    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:18.330715 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.330716    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:18.331098 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.330729    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:18.331098 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.331028    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:18.331098 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.331057    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:18.350181 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.350128    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:18.405556 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.405517    5076 generic.go:356] "Generic (PLEG): container finished" podID="90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" containerID="acf9685e17dae9080062962361c364a56cf9d2bbb0c81050b533f94ac4332895" exitCode=0
Nov 02 22:18:18.406019 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.405563    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"
Nov 02 22:18:18.406019 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.405605    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj" event={"ID":"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5","Type":"ContainerDied","Data":"acf9685e17dae9080062962361c364a56cf9d2bbb0c81050b533f94ac4332895"}
Nov 02 22:18:18.406019 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.405670    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj" event={"ID":"90c01d5e-a9e5-45a4-a6cf-a9343cf702f5","Type":"ContainerDied","Data":"f84c8f45bc07a012e17d0a3add70c27a19e4e84eaa8fd8a0d2f85ebd8d61950a"}
Nov 02 22:18:18.406019 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.405704    5076 scope.go:122] "RemoveContainer" containerID="acf9685e17dae9080062962361c364a56cf9d2bbb0c81050b533f94ac4332895"
Nov 02 22:18:18.419962 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.419939    5076 scope.go:122] "RemoveContainer" containerID="acf9685e17dae9080062962361c364a56cf9d2bbb0c81050b533f94ac4332895"
Nov 02 22:18:18.420261 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:18:18.420243    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acf9685e17dae9080062962361c364a56cf9d2bbb0c81050b533f94ac4332895\": container with ID starting with acf9685e17dae9080062962361c364a56cf9d2bbb0c81050b533f94ac4332895 not found: ID does not exist" containerID="acf9685e17dae9080062962361c364a56cf9d2bbb0c81050b533f94ac4332895"
Nov 02 22:18:18.420330 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.420271    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acf9685e17dae9080062962361c364a56cf9d2bbb0c81050b533f94ac4332895"} err="failed to get container status \"acf9685e17dae9080062962361c364a56cf9d2bbb0c81050b533f94ac4332895\": rpc error: code = NotFound desc = could not find container \"acf9685e17dae9080062962361c364a56cf9d2bbb0c81050b533f94ac4332895\": container with ID starting with acf9685e17dae9080062962361c364a56cf9d2bbb0c81050b533f94ac4332895 not found: ID does not exist"
Nov 02 22:18:18.435505 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.435473    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"]
Nov 02 22:18:18.440450 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.440418    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-2fc3ce-openshift-default-7f9c65fbcc-tg8rj"]
Nov 02 22:18:18.971367 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:18.971334    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:19.064285 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:19.064252    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" path="/var/lib/kubelet/pods/90c01d5e-a9e5-45a4-a6cf-a9343cf702f5/volumes"
Nov 02 22:18:19.598042 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:19.598013    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:20.285692 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:20.285657    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:21.062653 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:21.062625    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:21.942410 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:21.942371    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:22.068332 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:22.068297    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:22.169180 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:22.169129    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:22.699530 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:22.699492    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:23.126671 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:23.126636    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:23.221980 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:23.221946    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:23.440952 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:23.440876    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"
Nov 02 22:18:23.624921 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:23.624888    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:23.741499 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:23.725694    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:24.473906 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:24.473876    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:25.228071 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:25.228033    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:25.848543 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:25.848513    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:26.826099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:26.826057    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:27.260106 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:27.260065    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:27.462818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:27.462773    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:28.070775 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:28.070745    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:28.683106 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:28.683068    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:29.282439 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:29.282405    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:29.890519 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:18:29.890473    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:18:30.189916 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:30.189825    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:30.784492 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:30.784455    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:31.376417 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:31.376379    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:31.871185 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:31.871152    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:31.971127 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:31.971089    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:32.042050 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.042015    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"]
Nov 02 22:18:32.043128 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.043098    5076 cpu_manager.go:414] "containerMap: removing container" podUID="90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" containerName="istio-proxy"
Nov 02 22:18:32.043128 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.043127    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" containerName="istio-proxy"
Nov 02 22:18:32.043418 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.043400    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="90c01d5e-a9e5-45a4-a6cf-a9343cf702f5" containerName="istio-proxy"
Nov 02 22:18:32.055548 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.055522    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"]
Nov 02 22:18:32.056189 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.056132    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"
Nov 02 22:18:32.062206 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.062187    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w0-df8835-serving-cert\""
Nov 02 22:18:32.080825 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.080795    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:32.192017 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.191932    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:32.239974 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.239944    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8wlm\" (UniqueName: \"kubernetes.io/projected/a3737eb7-9ed7-4193-a612-3fb38cade513-kube-api-access-k8wlm\") pod \"maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7\" (UID: \"a3737eb7-9ed7-4193-a612-3fb38cade513\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"
Nov 02 22:18:32.240143 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.239994    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3737eb7-9ed7-4193-a612-3fb38cade513-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7\" (UID: \"a3737eb7-9ed7-4193-a612-3fb38cade513\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"
Nov 02 22:18:32.240360 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.240340    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3737eb7-9ed7-4193-a612-3fb38cade513-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7\" (UID: \"a3737eb7-9ed7-4193-a612-3fb38cade513\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"
Nov 02 22:18:32.240434 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.240377    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3737eb7-9ed7-4193-a612-3fb38cade513-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7\" (UID: \"a3737eb7-9ed7-4193-a612-3fb38cade513\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"
Nov 02 22:18:32.320139 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.320110    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:32.345237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.344996    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3737eb7-9ed7-4193-a612-3fb38cade513-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7\" (UID: \"a3737eb7-9ed7-4193-a612-3fb38cade513\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"
Nov 02 22:18:32.345237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.345057    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3737eb7-9ed7-4193-a612-3fb38cade513-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7\" (UID: \"a3737eb7-9ed7-4193-a612-3fb38cade513\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"
Nov 02 22:18:32.345523 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.345317    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8wlm\" (UniqueName: \"kubernetes.io/projected/a3737eb7-9ed7-4193-a612-3fb38cade513-kube-api-access-k8wlm\") pod \"maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7\" (UID: \"a3737eb7-9ed7-4193-a612-3fb38cade513\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"
Nov 02 22:18:32.345523 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.345360    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3737eb7-9ed7-4193-a612-3fb38cade513-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7\" (UID: \"a3737eb7-9ed7-4193-a612-3fb38cade513\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"
Nov 02 22:18:32.369245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.367862    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3737eb7-9ed7-4193-a612-3fb38cade513-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7\" (UID: \"a3737eb7-9ed7-4193-a612-3fb38cade513\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"
Nov 02 22:18:32.376249 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.376171    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3737eb7-9ed7-4193-a612-3fb38cade513-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7\" (UID: \"a3737eb7-9ed7-4193-a612-3fb38cade513\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"
Nov 02 22:18:32.376407 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.376283    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3737eb7-9ed7-4193-a612-3fb38cade513-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7\" (UID: \"a3737eb7-9ed7-4193-a612-3fb38cade513\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"
Nov 02 22:18:32.395239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.378836    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8wlm\" (UniqueName: \"kubernetes.io/projected/a3737eb7-9ed7-4193-a612-3fb38cade513-kube-api-access-k8wlm\") pod \"maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7\" (UID: \"a3737eb7-9ed7-4193-a612-3fb38cade513\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"
Nov 02 22:18:32.681188 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.681152    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"
Nov 02 22:18:32.803979 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.803830    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:32.844247 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.821871    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"]
Nov 02 22:18:32.844247 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.822137    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp" podUID="1dd5da05-cea6-44c8-b1e9-dbdc846fec07" containerName="maas-api" containerID="cri-o://7fabf37b54168a1df576e794101c74c7d93b3c3c672501b95c5d573ab8fcb35e" gracePeriod=30
Nov 02 22:18:32.932547 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:32.930570    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:33.138460 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:33.084259    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:33.478521 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:33.477090    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"]
Nov 02 22:18:33.547055 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:33.547000    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7" event={"ID":"a3737eb7-9ed7-4193-a612-3fb38cade513","Type":"ContainerStarted","Data":"997bf2ea003e5444aa5d2f8f5dc204b433f677d2ea5456f6f91039d88e4f2411"}
Nov 02 22:18:33.549182 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:33.549154    5076 generic.go:356] "Generic (PLEG): container finished" podID="1dd5da05-cea6-44c8-b1e9-dbdc846fec07" containerID="7fabf37b54168a1df576e794101c74c7d93b3c3c672501b95c5d573ab8fcb35e" exitCode=0
Nov 02 22:18:33.549443 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:33.549418    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp" event={"ID":"1dd5da05-cea6-44c8-b1e9-dbdc846fec07","Type":"ContainerDied","Data":"7fabf37b54168a1df576e794101c74c7d93b3c3c672501b95c5d573ab8fcb35e"}
Nov 02 22:18:33.560103 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:33.560070    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:33.689288 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:33.688778    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:33.781242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:33.775496    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:33.883238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:33.881142    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"
Nov 02 22:18:33.966390 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:33.965182    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:34.067241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.059204    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-maas-api-tls\") pod \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\" (UID: \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\") "
Nov 02 22:18:34.067241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.059357    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-kube-api-access-9sqrb\" (UniqueName: \"kubernetes.io/projected/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-kube-api-access-9sqrb\") pod \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\" (UID: \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\") "
Nov 02 22:18:34.067241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.059535    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-openshift-service-ca\") pod \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\" (UID: \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\") "
Nov 02 22:18:34.067241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.059599    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-metrics-certs\") pod \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\" (UID: \"1dd5da05-cea6-44c8-b1e9-dbdc846fec07\") "
Nov 02 22:18:34.067241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.060966    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-openshift-service-ca" pod "1dd5da05-cea6-44c8-b1e9-dbdc846fec07" (UID: "1dd5da05-cea6-44c8-b1e9-dbdc846fec07"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:18:34.067241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.065383    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-maas-api-tls" pod "1dd5da05-cea6-44c8-b1e9-dbdc846fec07" (UID: "1dd5da05-cea6-44c8-b1e9-dbdc846fec07"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:18:34.068100 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.068061    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-kube-api-access-9sqrb" pod "1dd5da05-cea6-44c8-b1e9-dbdc846fec07" (UID: "1dd5da05-cea6-44c8-b1e9-dbdc846fec07"). InnerVolumeSpecName "kube-api-access-9sqrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:18:34.082199 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.081969    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-metrics-certs" pod "1dd5da05-cea6-44c8-b1e9-dbdc846fec07" (UID: "1dd5da05-cea6-44c8-b1e9-dbdc846fec07"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:18:34.164960 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.164870    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:34.164960 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.164902    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sqrb\" (UniqueName: \"kubernetes.io/projected/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-kube-api-access-9sqrb\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:34.164960 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.164919    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:34.164960 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.164933    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dd5da05-cea6-44c8-b1e9-dbdc846fec07-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:34.232627 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.226761    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:34.316883 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.316798    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:34.561201 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.561112    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7" event={"ID":"a3737eb7-9ed7-4193-a612-3fb38cade513","Type":"ContainerStarted","Data":"c99392105a08dbbcd8674d1ed8f5db485cc4471d77aeeba93af6238a0f62a4a4"}
Nov 02 22:18:34.561201 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.561187    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"
Nov 02 22:18:34.562841 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.562816    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"
Nov 02 22:18:34.563004 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.562834    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp" event={"ID":"1dd5da05-cea6-44c8-b1e9-dbdc846fec07","Type":"ContainerDied","Data":"3232e9b57de96a49e2dfbf17f1c1fc7ee565cc416fb34b097aee5acc5f2f25c8"}
Nov 02 22:18:34.563004 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.562897    5076 scope.go:122] "RemoveContainer" containerID="7fabf37b54168a1df576e794101c74c7d93b3c3c672501b95c5d573ab8fcb35e"
Nov 02 22:18:34.589207 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.589163    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7" podStartSLOduration=1.9031062680000002 podStartE2EDuration="2.589148936s" totalImagesPullingTime="686.042668ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:18:34.584762984 +0000 UTC m=+1223.641097407" watchObservedRunningTime="2026-11-02 22:18:34.589148936 +0000 UTC m=+1223.645483315"
Nov 02 22:18:34.606568 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.606537    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"]
Nov 02 22:18:34.612912 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.612886    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-84a94060-84764b9bcd-bj2rp"]
Nov 02 22:18:34.901617 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:34.901572    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:35.072754 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:35.070312    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1dd5da05-cea6-44c8-b1e9-dbdc846fec07" path="/var/lib/kubelet/pods/1dd5da05-cea6-44c8-b1e9-dbdc846fec07/volumes"
Nov 02 22:18:35.829762 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:35.829721    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:36.499819 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:36.499782    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"]
Nov 02 22:18:36.500051 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:36.500024    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw" podUID="055a0337-7655-445b-9f0d-b3c9c8ba61cb" containerName="maas-api" containerID="cri-o://72b7349f5ad1b773a26718a65aa86f8299bfaa77512a13427cde5490b68a225c" gracePeriod=30
Nov 02 22:18:36.591266 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:36.590342    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:36.943323 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:36.935582    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:37.042290 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.031157    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:37.042290 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.034654    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"
Nov 02 22:18:37.079712 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.079236    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/055a0337-7655-445b-9f0d-b3c9c8ba61cb-metrics-certs\" (UniqueName: \"kubernetes.io/secret/055a0337-7655-445b-9f0d-b3c9c8ba61cb-metrics-certs\") pod \"055a0337-7655-445b-9f0d-b3c9c8ba61cb\" (UID: \"055a0337-7655-445b-9f0d-b3c9c8ba61cb\") "
Nov 02 22:18:37.079712 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.079395    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/055a0337-7655-445b-9f0d-b3c9c8ba61cb-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/055a0337-7655-445b-9f0d-b3c9c8ba61cb-maas-api-tls\") pod \"055a0337-7655-445b-9f0d-b3c9c8ba61cb\" (UID: \"055a0337-7655-445b-9f0d-b3c9c8ba61cb\") "
Nov 02 22:18:37.079712 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.079545    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/055a0337-7655-445b-9f0d-b3c9c8ba61cb-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/055a0337-7655-445b-9f0d-b3c9c8ba61cb-openshift-service-ca\") pod \"055a0337-7655-445b-9f0d-b3c9c8ba61cb\" (UID: \"055a0337-7655-445b-9f0d-b3c9c8ba61cb\") "
Nov 02 22:18:37.079712 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.079631    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/055a0337-7655-445b-9f0d-b3c9c8ba61cb-kube-api-access-6dqj8\" (UniqueName: \"kubernetes.io/projected/055a0337-7655-445b-9f0d-b3c9c8ba61cb-kube-api-access-6dqj8\") pod \"055a0337-7655-445b-9f0d-b3c9c8ba61cb\" (UID: \"055a0337-7655-445b-9f0d-b3c9c8ba61cb\") "
Nov 02 22:18:37.080067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.079967    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/055a0337-7655-445b-9f0d-b3c9c8ba61cb-openshift-service-ca" pod "055a0337-7655-445b-9f0d-b3c9c8ba61cb" (UID: "055a0337-7655-445b-9f0d-b3c9c8ba61cb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:18:37.093386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.080255    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/055a0337-7655-445b-9f0d-b3c9c8ba61cb-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:37.093386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.086272    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055a0337-7655-445b-9f0d-b3c9c8ba61cb-maas-api-tls" pod "055a0337-7655-445b-9f0d-b3c9c8ba61cb" (UID: "055a0337-7655-445b-9f0d-b3c9c8ba61cb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:18:37.093386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.086443    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055a0337-7655-445b-9f0d-b3c9c8ba61cb-metrics-certs" pod "055a0337-7655-445b-9f0d-b3c9c8ba61cb" (UID: "055a0337-7655-445b-9f0d-b3c9c8ba61cb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:18:37.093386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.092324    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/055a0337-7655-445b-9f0d-b3c9c8ba61cb-kube-api-access-6dqj8" pod "055a0337-7655-445b-9f0d-b3c9c8ba61cb" (UID: "055a0337-7655-445b-9f0d-b3c9c8ba61cb"). InnerVolumeSpecName "kube-api-access-6dqj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:18:37.181866 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.181832    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/055a0337-7655-445b-9f0d-b3c9c8ba61cb-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:37.181866 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.181868    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/055a0337-7655-445b-9f0d-b3c9c8ba61cb-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:37.182064 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.181885    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dqj8\" (UniqueName: \"kubernetes.io/projected/055a0337-7655-445b-9f0d-b3c9c8ba61cb-kube-api-access-6dqj8\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:37.414354 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.414319    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:37.646242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.646077    5076 generic.go:356] "Generic (PLEG): container finished" podID="055a0337-7655-445b-9f0d-b3c9c8ba61cb" containerID="72b7349f5ad1b773a26718a65aa86f8299bfaa77512a13427cde5490b68a225c" exitCode=0
Nov 02 22:18:37.646444 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.646401    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw" event={"ID":"055a0337-7655-445b-9f0d-b3c9c8ba61cb","Type":"ContainerDied","Data":"72b7349f5ad1b773a26718a65aa86f8299bfaa77512a13427cde5490b68a225c"}
Nov 02 22:18:37.646524 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.646477    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw" event={"ID":"055a0337-7655-445b-9f0d-b3c9c8ba61cb","Type":"ContainerDied","Data":"858ae2526c4c710033bc9d934170da35f49caa74950de14e7141ad5c545b6519"}
Nov 02 22:18:37.646585 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.646526    5076 scope.go:122] "RemoveContainer" containerID="72b7349f5ad1b773a26718a65aa86f8299bfaa77512a13427cde5490b68a225c"
Nov 02 22:18:37.646725 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.646702    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"
Nov 02 22:18:37.709320 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.700962    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"]
Nov 02 22:18:37.720475 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.720424    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0dd701-76d99cb-sn9tw"]
Nov 02 22:18:37.744922 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.744559    5076 scope.go:122] "RemoveContainer" containerID="72b7349f5ad1b773a26718a65aa86f8299bfaa77512a13427cde5490b68a225c"
Nov 02 22:18:37.745329 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:18:37.745195    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72b7349f5ad1b773a26718a65aa86f8299bfaa77512a13427cde5490b68a225c\": container with ID starting with 72b7349f5ad1b773a26718a65aa86f8299bfaa77512a13427cde5490b68a225c not found: ID does not exist" containerID="72b7349f5ad1b773a26718a65aa86f8299bfaa77512a13427cde5490b68a225c"
Nov 02 22:18:37.745329 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:37.745253    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72b7349f5ad1b773a26718a65aa86f8299bfaa77512a13427cde5490b68a225c"} err="failed to get container status \"72b7349f5ad1b773a26718a65aa86f8299bfaa77512a13427cde5490b68a225c\": rpc error: code = NotFound desc = could not find container \"72b7349f5ad1b773a26718a65aa86f8299bfaa77512a13427cde5490b68a225c\": container with ID starting with 72b7349f5ad1b773a26718a65aa86f8299bfaa77512a13427cde5490b68a225c not found: ID does not exist"
Nov 02 22:18:38.365241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:38.339051    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:39.062076 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:39.062037    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="055a0337-7655-445b-9f0d-b3c9c8ba61cb" path="/var/lib/kubelet/pods/055a0337-7655-445b-9f0d-b3c9c8ba61cb/volumes"
Nov 02 22:18:39.290289 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:39.284825    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:39.625289 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:39.622281    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:40.010332 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:40.008203    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:40.104766 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:40.104730    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:40.489243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:40.488582    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:40.639239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:40.639155    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"
Nov 02 22:18:41.580624 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:41.580579    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:42.302900 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:42.302859    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:43.038766 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:43.038734    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:43.897877 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:43.897844    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:44.314616 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:44.314533    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:44.397156 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:44.397090    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:44.583698 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:44.583589    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:44.731329 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:44.731294    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:45.363239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:45.361187    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:45.569994 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:45.569957    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:46.400037 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:46.400004    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:46.505020 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:46.504983    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:46.639926 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:46.639895    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:47.534173 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:47.534132    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:48.292874 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:48.292838    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:48.989026 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:48.988996    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:49.730402 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:49.730367    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:50.473077 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:50.473040    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:51.058180 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:51.058143    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:51.152296 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:51.152251    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:51.268130 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:51.268094    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:52.089208 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.089165    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:52.334124 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.334072    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:52.438794 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.438753    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:52.775544 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.775453    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:52.854839 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.854801    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"]
Nov 02 22:18:52.855845 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.855821    5076 cpu_manager.go:414] "containerMap: removing container" podUID="055a0337-7655-445b-9f0d-b3c9c8ba61cb" containerName="maas-api"
Nov 02 22:18:52.855973 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.855846    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="055a0337-7655-445b-9f0d-b3c9c8ba61cb" containerName="maas-api"
Nov 02 22:18:52.855973 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.855909    5076 cpu_manager.go:414] "containerMap: removing container" podUID="1dd5da05-cea6-44c8-b1e9-dbdc846fec07" containerName="maas-api"
Nov 02 22:18:52.855973 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.855918    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1dd5da05-cea6-44c8-b1e9-dbdc846fec07" containerName="maas-api"
Nov 02 22:18:52.856148 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.856058    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="055a0337-7655-445b-9f0d-b3c9c8ba61cb" containerName="maas-api"
Nov 02 22:18:52.856148 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.856074    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="1dd5da05-cea6-44c8-b1e9-dbdc846fec07" containerName="maas-api"
Nov 02 22:18:52.862210 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.862181    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.875013 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.874986    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"]
Nov 02 22:18:52.876515 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.876494    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-84a94060-openshift-default-dockercfg-kccrv\""
Nov 02 22:18:52.890791 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.890762    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istiod-ca-cert\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.890926 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.890806    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-data\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.891004 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.890920    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-workload-certs\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.891067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.891015    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25kmf\" (UniqueName: \"kubernetes.io/projected/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-kube-api-access-25kmf\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.891128 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.891072    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-podinfo\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.891254 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.891232    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-workload-socket\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.891374 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.891291    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-envoy\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.891374 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.891317    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-credential-socket\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.891464 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.891421    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-token\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.992899 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.992866    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-token\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.993075 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.992979    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istiod-ca-cert\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.993075 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.993006    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-data\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.993075 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.993041    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-workload-certs\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.993341 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.993200    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25kmf\" (UniqueName: \"kubernetes.io/projected/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-kube-api-access-25kmf\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.993341 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.993324    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-podinfo\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.993503 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.993488    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-workload-socket\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.993562 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.993517    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-data\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.993562 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.993488    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-workload-certs\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.993666 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.993547    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-envoy\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.993666 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.993612    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-credential-socket\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.993666 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.993630    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istiod-ca-cert\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.993872 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.993740    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-workload-socket\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.993872 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.993848    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-credential-socket\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.995710 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.995678    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-envoy\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:52.995890 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:52.995870    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-podinfo\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:53.005749 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:53.005721    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-token\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:53.006332 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:53.006309    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25kmf\" (UniqueName: \"kubernetes.io/projected/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-kube-api-access-25kmf\") pod \"e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") " pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:53.109415 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:53.109375    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:53.193998 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:53.193948    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:53.224150 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:53.224120    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:53.368421 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:53.358197    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:53.663721 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:53.663682    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:18:53.663880 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:53.663766    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:18:53.663880 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:53.663810    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:18:53.665725 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:53.665698    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"]
Nov 02 22:18:54.102301 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:54.101191    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:54.149024 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:54.148605    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp" event={"ID":"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe","Type":"ContainerStarted","Data":"a94a5b2873ff11c54707ad0d3f6d3e5bba570d792d46faafbe6dd53b91beff6a"}
Nov 02 22:18:54.149024 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:54.148714    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp" event={"ID":"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe","Type":"ContainerStarted","Data":"a53219b25871194321d9506555e66e28001a25fd2b61fb4449a451bf557eafa2"}
Nov 02 22:18:54.176275 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:54.176028    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp" podStartSLOduration=2.176011152 podStartE2EDuration="2.176011152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:18:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:18:54.169821276 +0000 UTC m=+1243.226155658" watchObservedRunningTime="2026-11-02 22:18:54.176011152 +0000 UTC m=+1243.232345548"
Nov 02 22:18:54.196764 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:54.196734    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:18:54.199040 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:54.199010    5076 patch_prober.go:29] interesting pod/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Nov 02 22:18:54.199176 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:54.199060    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp" podUID="a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Nov 02 22:18:54.902239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:54.901555    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:55.196606 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:55.195627    5076 patch_prober.go:29] interesting pod/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Nov 02 22:18:55.196606 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:55.195697    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp" podUID="a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Nov 02 22:18:55.707786 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:55.707750    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:56.201478 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:56.201442    5076 patch_prober.go:29] interesting pod/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Nov 02 22:18:56.202057 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:56.201518    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp" podUID="a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Nov 02 22:18:56.695240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:56.694906    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:57.196542 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:57.194683    5076 patch_prober.go:29] interesting pod/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Nov 02 22:18:57.196542 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:57.194739    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp" podUID="a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Nov 02 22:18:57.258136 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:57.258103    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:57.357487 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:57.357454    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:57.692242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:57.688669    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:58.198451 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:58.197183    5076 patch_prober.go:29] interesting pod/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Nov 02 22:18:58.198674 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:58.198539    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp" podUID="a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Nov 02 22:18:58.312723 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:58.312689    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"]
Nov 02 22:18:58.313559 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:58.313486    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc" podUID="f2c1306a-dd49-4ea2-8306-c7017ecf97b2" containerName="maas-api" containerID="cri-o://d9ec9435589e35ccdf0d8fc4759b46ef5f2bac13a74ac11a3ec67340671a0dc4" gracePeriod=30
Nov 02 22:18:58.352346 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:58.350648    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:58.491242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:58.490232    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:58.606242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:58.596657    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:58.943240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:58.930389    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:59.042237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.040336    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:59.209360 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.201875    5076 patch_prober.go:29] interesting pod/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Nov 02 22:18:59.209360 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.201972    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp" podUID="a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Nov 02 22:18:59.225128 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.225095    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"
Nov 02 22:18:59.238049 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.235667    5076 generic.go:356] "Generic (PLEG): container finished" podID="f2c1306a-dd49-4ea2-8306-c7017ecf97b2" containerID="d9ec9435589e35ccdf0d8fc4759b46ef5f2bac13a74ac11a3ec67340671a0dc4" exitCode=0
Nov 02 22:18:59.238049 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.235714    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc" event={"ID":"f2c1306a-dd49-4ea2-8306-c7017ecf97b2","Type":"ContainerDied","Data":"d9ec9435589e35ccdf0d8fc4759b46ef5f2bac13a74ac11a3ec67340671a0dc4"}
Nov 02 22:18:59.238049 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.235761    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"
Nov 02 22:18:59.238049 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.235778    5076 scope.go:122] "RemoveContainer" containerID="d9ec9435589e35ccdf0d8fc4759b46ef5f2bac13a74ac11a3ec67340671a0dc4"
Nov 02 22:18:59.238049 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.235766    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc" event={"ID":"f2c1306a-dd49-4ea2-8306-c7017ecf97b2","Type":"ContainerDied","Data":"e198a5c48c47e90b74a8676d3328519a4d87e9a11e39250c48b91b6578ba7494"}
Nov 02 22:18:59.263325 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.263266    5076 scope.go:122] "RemoveContainer" containerID="d9ec9435589e35ccdf0d8fc4759b46ef5f2bac13a74ac11a3ec67340671a0dc4"
Nov 02 22:18:59.266672 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:18:59.266641    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9ec9435589e35ccdf0d8fc4759b46ef5f2bac13a74ac11a3ec67340671a0dc4\": container with ID starting with d9ec9435589e35ccdf0d8fc4759b46ef5f2bac13a74ac11a3ec67340671a0dc4 not found: ID does not exist" containerID="d9ec9435589e35ccdf0d8fc4759b46ef5f2bac13a74ac11a3ec67340671a0dc4"
Nov 02 22:18:59.266809 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.266677    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9ec9435589e35ccdf0d8fc4759b46ef5f2bac13a74ac11a3ec67340671a0dc4"} err="failed to get container status \"d9ec9435589e35ccdf0d8fc4759b46ef5f2bac13a74ac11a3ec67340671a0dc4\": rpc error: code = NotFound desc = could not find container \"d9ec9435589e35ccdf0d8fc4759b46ef5f2bac13a74ac11a3ec67340671a0dc4\": container with ID starting with d9ec9435589e35ccdf0d8fc4759b46ef5f2bac13a74ac11a3ec67340671a0dc4 not found: ID does not exist"
Nov 02 22:18:59.319412 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.319370    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-maas-api-tls\") pod \"f2c1306a-dd49-4ea2-8306-c7017ecf97b2\" (UID: \"f2c1306a-dd49-4ea2-8306-c7017ecf97b2\") "
Nov 02 22:18:59.319936 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.319453    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-openshift-service-ca\") pod \"f2c1306a-dd49-4ea2-8306-c7017ecf97b2\" (UID: \"f2c1306a-dd49-4ea2-8306-c7017ecf97b2\") "
Nov 02 22:18:59.319936 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.319546    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-kube-api-access-ckvr9\" (UniqueName: \"kubernetes.io/projected/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-kube-api-access-ckvr9\") pod \"f2c1306a-dd49-4ea2-8306-c7017ecf97b2\" (UID: \"f2c1306a-dd49-4ea2-8306-c7017ecf97b2\") "
Nov 02 22:18:59.319936 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.319600    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-metrics-certs\") pod \"f2c1306a-dd49-4ea2-8306-c7017ecf97b2\" (UID: \"f2c1306a-dd49-4ea2-8306-c7017ecf97b2\") "
Nov 02 22:18:59.320548 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.320518    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-openshift-service-ca" pod "f2c1306a-dd49-4ea2-8306-c7017ecf97b2" (UID: "f2c1306a-dd49-4ea2-8306-c7017ecf97b2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:18:59.324037 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.324011    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-maas-api-tls" pod "f2c1306a-dd49-4ea2-8306-c7017ecf97b2" (UID: "f2c1306a-dd49-4ea2-8306-c7017ecf97b2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:18:59.324157 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.324050    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-kube-api-access-ckvr9" pod "f2c1306a-dd49-4ea2-8306-c7017ecf97b2" (UID: "f2c1306a-dd49-4ea2-8306-c7017ecf97b2"). InnerVolumeSpecName "kube-api-access-ckvr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:18:59.325611 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.325583    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-metrics-certs" pod "f2c1306a-dd49-4ea2-8306-c7017ecf97b2" (UID: "f2c1306a-dd49-4ea2-8306-c7017ecf97b2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:18:59.394372 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.368427    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:59.421297 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.421204    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckvr9\" (UniqueName: \"kubernetes.io/projected/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-kube-api-access-ckvr9\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:59.421297 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.421250    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:59.421297 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.421261    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:59.421297 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.421271    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2c1306a-dd49-4ea2-8306-c7017ecf97b2-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:18:59.607163 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.607037    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:59.607787 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.607732    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"]
Nov 02 22:18:59.611370 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.610751    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d9416f-67f95d4fcc-89bqc"]
Nov 02 22:18:59.898563 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:18:59.898530    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:18:59.914001 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:18:59.913965    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:19:00.003287 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:00.001871    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:00.195292 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:00.195108    5076 patch_prober.go:29] interesting pod/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Nov 02 22:19:00.195292 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:00.195197    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp" podUID="a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Nov 02 22:19:00.608189 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:00.608151    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:01.055784 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:01.055707    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f2c1306a-dd49-4ea2-8306-c7017ecf97b2" path="/var/lib/kubelet/pods/f2c1306a-dd49-4ea2-8306-c7017ecf97b2/volumes"
Nov 02 22:19:01.199140 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:01.199110    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:19:01.199441 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:01.199415    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:19:01.200021 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:01.200006    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:19:01.283775 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:01.283742    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:01.935760 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:01.935729    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:02.571793 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.571763    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"]
Nov 02 22:19:02.572512 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.572441    5076 cpu_manager.go:414] "containerMap: removing container" podUID="f2c1306a-dd49-4ea2-8306-c7017ecf97b2" containerName="maas-api"
Nov 02 22:19:02.572512 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.572460    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f2c1306a-dd49-4ea2-8306-c7017ecf97b2" containerName="maas-api"
Nov 02 22:19:02.572707 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.572583    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="f2c1306a-dd49-4ea2-8306-c7017ecf97b2" containerName="maas-api"
Nov 02 22:19:02.601272 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.594617    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"]
Nov 02 22:19:02.601272 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.594737    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"
Nov 02 22:19:02.601272 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.599652    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-e30968-serving-cert\""
Nov 02 22:19:02.644044 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.644003    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:02.680982 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.680951    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs4gs\" (UniqueName: \"kubernetes.io/projected/065ff515-e8ec-4d5d-9bc4-161017ebc705-kube-api-access-fs4gs\") pod \"maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4\" (UID: \"065ff515-e8ec-4d5d-9bc4-161017ebc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"
Nov 02 22:19:02.681155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.681070    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/065ff515-e8ec-4d5d-9bc4-161017ebc705-maas-api-tls\") pod \"maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4\" (UID: \"065ff515-e8ec-4d5d-9bc4-161017ebc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"
Nov 02 22:19:02.681155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.681132    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/065ff515-e8ec-4d5d-9bc4-161017ebc705-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4\" (UID: \"065ff515-e8ec-4d5d-9bc4-161017ebc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"
Nov 02 22:19:02.681321 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.681307    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/065ff515-e8ec-4d5d-9bc4-161017ebc705-metrics-certs\") pod \"maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4\" (UID: \"065ff515-e8ec-4d5d-9bc4-161017ebc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"
Nov 02 22:19:02.752335 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.752143    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:02.785038 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.783360    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs4gs\" (UniqueName: \"kubernetes.io/projected/065ff515-e8ec-4d5d-9bc4-161017ebc705-kube-api-access-fs4gs\") pod \"maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4\" (UID: \"065ff515-e8ec-4d5d-9bc4-161017ebc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"
Nov 02 22:19:02.785038 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.783499    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/065ff515-e8ec-4d5d-9bc4-161017ebc705-maas-api-tls\") pod \"maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4\" (UID: \"065ff515-e8ec-4d5d-9bc4-161017ebc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"
Nov 02 22:19:02.785038 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.783581    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/065ff515-e8ec-4d5d-9bc4-161017ebc705-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4\" (UID: \"065ff515-e8ec-4d5d-9bc4-161017ebc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"
Nov 02 22:19:02.785038 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.783794    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/065ff515-e8ec-4d5d-9bc4-161017ebc705-metrics-certs\") pod \"maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4\" (UID: \"065ff515-e8ec-4d5d-9bc4-161017ebc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"
Nov 02 22:19:02.793855 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:19:02.793702    5076 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-serving-cert: secret "maas-api-e2e-inf-a-e30968-serving-cert" not found
Nov 02 22:19:02.794310 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:19:02.794277    5076 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/065ff515-e8ec-4d5d-9bc4-161017ebc705-maas-api-tls podName:065ff515-e8ec-4d5d-9bc4-161017ebc705 nodeName:}" failed. No retries permitted until 2026-11-02 22:19:03.294229934 +0000 UTC m=+1252.350564306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/065ff515-e8ec-4d5d-9bc4-161017ebc705-maas-api-tls") pod "maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4" (UID: "065ff515-e8ec-4d5d-9bc4-161017ebc705") : secret "maas-api-e2e-inf-a-e30968-serving-cert" not found
Nov 02 22:19:02.796416 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.796175    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/065ff515-e8ec-4d5d-9bc4-161017ebc705-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4\" (UID: \"065ff515-e8ec-4d5d-9bc4-161017ebc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"
Nov 02 22:19:02.799003 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.798969    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/065ff515-e8ec-4d5d-9bc4-161017ebc705-metrics-certs\") pod \"maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4\" (UID: \"065ff515-e8ec-4d5d-9bc4-161017ebc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"
Nov 02 22:19:02.804993 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.804969    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs4gs\" (UniqueName: \"kubernetes.io/projected/065ff515-e8ec-4d5d-9bc4-161017ebc705-kube-api-access-fs4gs\") pod \"maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4\" (UID: \"065ff515-e8ec-4d5d-9bc4-161017ebc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"
Nov 02 22:19:02.872515 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:02.872478    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:03.396243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:03.395521    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/065ff515-e8ec-4d5d-9bc4-161017ebc705-maas-api-tls\") pod \"maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4\" (UID: \"065ff515-e8ec-4d5d-9bc4-161017ebc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"
Nov 02 22:19:03.416362 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:03.415130    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/065ff515-e8ec-4d5d-9bc4-161017ebc705-maas-api-tls\") pod \"maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4\" (UID: \"065ff515-e8ec-4d5d-9bc4-161017ebc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"
Nov 02 22:19:03.514641 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:03.514602    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"
Nov 02 22:19:03.712133 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:03.712029    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:03.838718 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:03.838683    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"]
Nov 02 22:19:03.840066 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:03.840039    5076 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 22:19:04.279054 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:04.279015    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4" event={"ID":"065ff515-e8ec-4d5d-9bc4-161017ebc705","Type":"ContainerStarted","Data":"4193cd481948d81cb4a839546aa6bff266e438ba49aef8cd58a6caad886c098d"}
Nov 02 22:19:04.479537 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:04.479506    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:05.093974 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:05.093933    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:05.290916 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:05.290877    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4" event={"ID":"065ff515-e8ec-4d5d-9bc4-161017ebc705","Type":"ContainerStarted","Data":"3d5b9d30c00caca83a825233320f350e49a70dc5a7a973c0eb06ddfd3d32c693"}
Nov 02 22:19:05.291102 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:05.290945    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"
Nov 02 22:19:05.307899 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:05.307854    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4" podStartSLOduration=2.765944072 podStartE2EDuration="3.307840171s" totalImagesPullingTime="541.896099ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:19:05.306340723 +0000 UTC m=+1254.362675136" watchObservedRunningTime="2026-11-02 22:19:05.307840171 +0000 UTC m=+1254.364174550"
Nov 02 22:19:05.710195 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:05.710164    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:06.367243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:06.367176    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:06.467563 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:06.467531    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:06.567190 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:06.567158    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:06.745580 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:06.745498    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:07.216259 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:07.216188    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:08.093679 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:08.093644    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:08.742326 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:08.742295    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"]
Nov 02 22:19:08.747274 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:08.747248    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"
Nov 02 22:19:08.753579 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:08.753558    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w0-7bb56e-serving-cert\""
Nov 02 22:19:08.760403 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:08.760374    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"]
Nov 02 22:19:08.781843 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:08.781810    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:08.887458 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:08.887423    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:08.903388 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:08.902887    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9164f6d8-20d6-4051-af7a-ea57cafff9a2-metrics-certs\") pod \"maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m\" (UID: \"9164f6d8-20d6-4051-af7a-ea57cafff9a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"
Nov 02 22:19:08.903388 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:08.903048    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9164f6d8-20d6-4051-af7a-ea57cafff9a2-maas-api-tls\") pod \"maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m\" (UID: \"9164f6d8-20d6-4051-af7a-ea57cafff9a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"
Nov 02 22:19:08.903388 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:08.903108    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9164f6d8-20d6-4051-af7a-ea57cafff9a2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m\" (UID: \"9164f6d8-20d6-4051-af7a-ea57cafff9a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"
Nov 02 22:19:08.903388 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:08.903242    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6js9d\" (UniqueName: \"kubernetes.io/projected/9164f6d8-20d6-4051-af7a-ea57cafff9a2-kube-api-access-6js9d\") pod \"maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m\" (UID: \"9164f6d8-20d6-4051-af7a-ea57cafff9a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"
Nov 02 22:19:08.983464 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:08.983429    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:09.005267 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:09.005178    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9164f6d8-20d6-4051-af7a-ea57cafff9a2-maas-api-tls\") pod \"maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m\" (UID: \"9164f6d8-20d6-4051-af7a-ea57cafff9a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"
Nov 02 22:19:09.005409 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:09.005277    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9164f6d8-20d6-4051-af7a-ea57cafff9a2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m\" (UID: \"9164f6d8-20d6-4051-af7a-ea57cafff9a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"
Nov 02 22:19:09.005451 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:09.005417    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6js9d\" (UniqueName: \"kubernetes.io/projected/9164f6d8-20d6-4051-af7a-ea57cafff9a2-kube-api-access-6js9d\") pod \"maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m\" (UID: \"9164f6d8-20d6-4051-af7a-ea57cafff9a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"
Nov 02 22:19:09.005516 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:09.005498    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9164f6d8-20d6-4051-af7a-ea57cafff9a2-metrics-certs\") pod \"maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m\" (UID: \"9164f6d8-20d6-4051-af7a-ea57cafff9a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"
Nov 02 22:19:09.005985 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:09.005956    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9164f6d8-20d6-4051-af7a-ea57cafff9a2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m\" (UID: \"9164f6d8-20d6-4051-af7a-ea57cafff9a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"
Nov 02 22:19:09.007937 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:09.007907    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9164f6d8-20d6-4051-af7a-ea57cafff9a2-maas-api-tls\") pod \"maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m\" (UID: \"9164f6d8-20d6-4051-af7a-ea57cafff9a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"
Nov 02 22:19:09.008211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:09.008189    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9164f6d8-20d6-4051-af7a-ea57cafff9a2-metrics-certs\") pod \"maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m\" (UID: \"9164f6d8-20d6-4051-af7a-ea57cafff9a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"
Nov 02 22:19:09.013550 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:09.013526    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6js9d\" (UniqueName: \"kubernetes.io/projected/9164f6d8-20d6-4051-af7a-ea57cafff9a2-kube-api-access-6js9d\") pod \"maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m\" (UID: \"9164f6d8-20d6-4051-af7a-ea57cafff9a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"
Nov 02 22:19:09.071962 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:09.071931    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"
Nov 02 22:19:09.446755 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:09.446718    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"]
Nov 02 22:19:09.487263 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:19:09.487234    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9164f6d8_20d6_4051_af7a_ea57cafff9a2.slice/crio-ada16fc35242d52b2a37310376d37fffc0c463709215ff6f6bb375840cff2fb4 WatchSource:0}: Error finding container ada16fc35242d52b2a37310376d37fffc0c463709215ff6f6bb375840cff2fb4: Status 404 returned error can't find the container with id ada16fc35242d52b2a37310376d37fffc0c463709215ff6f6bb375840cff2fb4
Nov 02 22:19:09.724102 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:09.724004    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:10.348012 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:10.346701    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m" event={"ID":"9164f6d8-20d6-4051-af7a-ea57cafff9a2","Type":"ContainerStarted","Data":"7ee6d6b975175ce7042a4bf32a9e53d8213db79a689231cee2fa928ae61a7d55"}
Nov 02 22:19:10.348012 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:10.346767    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m" event={"ID":"9164f6d8-20d6-4051-af7a-ea57cafff9a2","Type":"ContainerStarted","Data":"ada16fc35242d52b2a37310376d37fffc0c463709215ff6f6bb375840cff2fb4"}
Nov 02 22:19:10.348012 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:10.346794    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"
Nov 02 22:19:10.364611 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:10.364552    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m" podStartSLOduration=1.8224802599999999 podStartE2EDuration="2.364533868s" totalImagesPullingTime="542.053608ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:19:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:19:10.363490022 +0000 UTC m=+1259.419824405" watchObservedRunningTime="2026-11-02 22:19:10.364533868 +0000 UTC m=+1259.420868248"
Nov 02 22:19:10.478982 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:10.478947    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:11.096363 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:11.096331    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:11.205031 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:11.204996    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:11.307117 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:11.307092    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"
Nov 02 22:19:11.777976 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:11.777935    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:12.392542 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:12.392509    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:13.117211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:13.117178    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:13.801747 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:13.801709    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:14.393473 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:14.393424    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:15.340580 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:15.339507    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:15.666944 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:15.666916    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:16.220240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:16.213642    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:16.360845 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:16.360739    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:16.364204 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:16.364181    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"
Nov 02 22:19:16.685606 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:16.685574    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:16.821829 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:16.820882    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:17.408397 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:17.408156    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:17.637031 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:17.636996    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:17.782304 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:17.771933    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:17.864259 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:17.864166    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:18.054534 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:18.054453    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:18.979025 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:18.978984    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:19.195980 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:19.193950    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:19.906088 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:19.906056    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:20.688982 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:20.688944    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:21.543663 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:21.543620    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:21.941772 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:21.941738    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:22.052873 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:22.052827    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:22.153742 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:22.153705    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:22.503821 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:22.503779    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:23.235205 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:23.235105    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:23.336646 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:23.336611    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:24.375828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:24.375793    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:24.837930 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:24.837850    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:24.927164 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:24.921865    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:25.148579 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:25.148542    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"]
Nov 02 22:19:25.149208 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:25.149178    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp" podUID="a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" containerName="istio-proxy" containerID="cri-o://a94a5b2873ff11c54707ad0d3f6d3e5bba570d792d46faafbe6dd53b91beff6a" gracePeriod=30
Nov 02 22:19:25.162502 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:25.162475    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:25.253899 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:25.253863    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:26.070492 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:26.070463    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:26.796248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:26.796181    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:27.023467 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:27.023421    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:27.124917 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:27.124885    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:27.683646 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:27.683608    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:27.839644 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:27.839613    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:28.482319 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:28.482292    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:28.833868 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:28.833782    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:29.222652 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:29.222591    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:29.307238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:29.307191    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:29.755252 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:29.753263    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:29.901292 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:19:29.901202    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:19:29.994546 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:29.994509    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:30.454402 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.454369    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:19:30.561867 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.561827    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-podinfo\") pod \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") "
Nov 02 22:19:30.562073 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.561877    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-credential-socket\") pod \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") "
Nov 02 22:19:30.562073 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.561923    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-kube-api-access-25kmf\" (UniqueName: \"kubernetes.io/projected/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-kube-api-access-25kmf\") pod \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") "
Nov 02 22:19:30.562073 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.562050    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-workload-certs\") pod \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") "
Nov 02 22:19:30.562294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.562086    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-token\" (UniqueName: \"kubernetes.io/projected/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-token\") pod \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") "
Nov 02 22:19:30.562294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.562181    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istiod-ca-cert\") pod \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") "
Nov 02 22:19:30.562294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.562250    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-envoy\") pod \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") "
Nov 02 22:19:30.562294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.562281    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-workload-socket\") pod \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") "
Nov 02 22:19:30.562527 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.562430    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-data\") pod \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\" (UID: \"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe\") "
Nov 02 22:19:30.562827 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.562586    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-workload-certs" pod "a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" (UID: "a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:19:30.562827 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.562775    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-credential-socket" pod "a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" (UID: "a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:19:30.563015 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.562953    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-data" pod "a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" (UID: "a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:19:30.563605 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.563263    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istiod-ca-cert" pod "a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" (UID: "a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:19:30.563605 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.563280    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:30.563605 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.563326    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:30.563605 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.563346    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:30.564029 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.563991    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-workload-socket" pod "a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" (UID: "a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:19:30.565683 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.565607    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-token" pod "a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" (UID: "a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:19:30.565683 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.565602    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-podinfo" pod "a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" (UID: "a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:19:30.567474 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.567436    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-kube-api-access-25kmf" pod "a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" (UID: "a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe"). InnerVolumeSpecName "kube-api-access-25kmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:19:30.567676 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.567652    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-envoy" pod "a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" (UID: "a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:19:30.599499 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.599465    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"]
Nov 02 22:19:30.599764 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.599737    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t" podUID="3b21b282-ae28-40c1-85f0-0edb6b1e40ec" containerName="istio-proxy" containerID="cri-o://8a49edfbf649328285d14dfd293dde086d6d1043f61618c3b7bbfe363c7264cf" gracePeriod=30
Nov 02 22:19:30.651152 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.651111    5076 generic.go:356] "Generic (PLEG): container finished" podID="a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" containerID="a94a5b2873ff11c54707ad0d3f6d3e5bba570d792d46faafbe6dd53b91beff6a" exitCode=0
Nov 02 22:19:30.651363 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.651167    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"
Nov 02 22:19:30.651363 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.651164    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp" event={"ID":"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe","Type":"ContainerDied","Data":"a94a5b2873ff11c54707ad0d3f6d3e5bba570d792d46faafbe6dd53b91beff6a"}
Nov 02 22:19:30.651363 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.651302    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp" event={"ID":"a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe","Type":"ContainerDied","Data":"a53219b25871194321d9506555e66e28001a25fd2b61fb4449a451bf557eafa2"}
Nov 02 22:19:30.651363 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.651336    5076 scope.go:122] "RemoveContainer" containerID="a94a5b2873ff11c54707ad0d3f6d3e5bba570d792d46faafbe6dd53b91beff6a"
Nov 02 22:19:30.663556 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.663536    5076 scope.go:122] "RemoveContainer" containerID="a94a5b2873ff11c54707ad0d3f6d3e5bba570d792d46faafbe6dd53b91beff6a"
Nov 02 22:19:30.663895 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:19:30.663865    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a94a5b2873ff11c54707ad0d3f6d3e5bba570d792d46faafbe6dd53b91beff6a\": container with ID starting with a94a5b2873ff11c54707ad0d3f6d3e5bba570d792d46faafbe6dd53b91beff6a not found: ID does not exist" containerID="a94a5b2873ff11c54707ad0d3f6d3e5bba570d792d46faafbe6dd53b91beff6a"
Nov 02 22:19:30.664047 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.663907    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a94a5b2873ff11c54707ad0d3f6d3e5bba570d792d46faafbe6dd53b91beff6a"} err="failed to get container status \"a94a5b2873ff11c54707ad0d3f6d3e5bba570d792d46faafbe6dd53b91beff6a\": rpc error: code = NotFound desc = could not find container \"a94a5b2873ff11c54707ad0d3f6d3e5bba570d792d46faafbe6dd53b91beff6a\": container with ID starting with a94a5b2873ff11c54707ad0d3f6d3e5bba570d792d46faafbe6dd53b91beff6a not found: ID does not exist"
Nov 02 22:19:30.664530 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.664505    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:30.664530 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.664530    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:30.664691 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.664540    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:30.664691 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.664548    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:30.664691 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.664557    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25kmf\" (UniqueName: \"kubernetes.io/projected/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-kube-api-access-25kmf\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:30.664691 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.664567    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:30.677142 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.677043    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"]
Nov 02 22:19:30.681811 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.681786    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-84a94060-openshift-default-846cfc5c5c-f2scp"]
Nov 02 22:19:30.804781 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:30.804747    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:31.068961 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:31.068859    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" path="/var/lib/kubelet/pods/a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe/volumes"
Nov 02 22:19:31.492740 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:31.492706    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:32.252330 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:32.252293    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:32.702850 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:32.702812    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:32.790480 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:32.790445    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:33.073194 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:33.073110    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:33.189474 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:33.189441    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:33.543069 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:33.543039    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:34.228385 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.228356    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"]
Nov 02 22:19:34.229082 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.229065    5076 cpu_manager.go:414] "containerMap: removing container" podUID="a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" containerName="istio-proxy"
Nov 02 22:19:34.229126 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.229085    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" containerName="istio-proxy"
Nov 02 22:19:34.229199 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.229189    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="a8df4cc8-2eb2-40f8-80e0-bad60d0b8afe" containerName="istio-proxy"
Nov 02 22:19:34.233283 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.233254    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"
Nov 02 22:19:34.242858 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.242834    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-00c72a-serving-cert\""
Nov 02 22:19:34.251977 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.251949    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"]
Nov 02 22:19:34.273858 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.273828    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:34.328043 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.328014    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0252ac19-8757-4b54-9d18-79342afbc0b7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6\" (UID: \"0252ac19-8757-4b54-9d18-79342afbc0b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"
Nov 02 22:19:34.328290 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.328267    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0252ac19-8757-4b54-9d18-79342afbc0b7-metrics-certs\") pod \"maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6\" (UID: \"0252ac19-8757-4b54-9d18-79342afbc0b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"
Nov 02 22:19:34.328356 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.328329    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0252ac19-8757-4b54-9d18-79342afbc0b7-maas-api-tls\") pod \"maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6\" (UID: \"0252ac19-8757-4b54-9d18-79342afbc0b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"
Nov 02 22:19:34.328401 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.328382    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4t8c\" (UniqueName: \"kubernetes.io/projected/0252ac19-8757-4b54-9d18-79342afbc0b7-kube-api-access-m4t8c\") pod \"maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6\" (UID: \"0252ac19-8757-4b54-9d18-79342afbc0b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"
Nov 02 22:19:34.384276 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.383816    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:34.429654 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.429581    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0252ac19-8757-4b54-9d18-79342afbc0b7-metrics-certs\") pod \"maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6\" (UID: \"0252ac19-8757-4b54-9d18-79342afbc0b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"
Nov 02 22:19:34.429941 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.429718    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0252ac19-8757-4b54-9d18-79342afbc0b7-maas-api-tls\") pod \"maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6\" (UID: \"0252ac19-8757-4b54-9d18-79342afbc0b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"
Nov 02 22:19:34.429941 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.429763    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4t8c\" (UniqueName: \"kubernetes.io/projected/0252ac19-8757-4b54-9d18-79342afbc0b7-kube-api-access-m4t8c\") pod \"maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6\" (UID: \"0252ac19-8757-4b54-9d18-79342afbc0b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"
Nov 02 22:19:34.430462 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.430422    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0252ac19-8757-4b54-9d18-79342afbc0b7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6\" (UID: \"0252ac19-8757-4b54-9d18-79342afbc0b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"
Nov 02 22:19:34.431135 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:19:34.431111    5076 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-serving-cert: secret "maas-api-e2e-inf-b-00c72a-serving-cert" not found
Nov 02 22:19:34.431282 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:19:34.431192    5076 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0252ac19-8757-4b54-9d18-79342afbc0b7-maas-api-tls podName:0252ac19-8757-4b54-9d18-79342afbc0b7 nodeName:}" failed. No retries permitted until 2026-11-02 22:19:34.931172425 +0000 UTC m=+1283.987506786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0252ac19-8757-4b54-9d18-79342afbc0b7-maas-api-tls") pod "maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6" (UID: "0252ac19-8757-4b54-9d18-79342afbc0b7") : secret "maas-api-e2e-inf-b-00c72a-serving-cert" not found
Nov 02 22:19:34.431425 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.431407    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0252ac19-8757-4b54-9d18-79342afbc0b7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6\" (UID: \"0252ac19-8757-4b54-9d18-79342afbc0b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"
Nov 02 22:19:34.433629 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.433609    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0252ac19-8757-4b54-9d18-79342afbc0b7-metrics-certs\") pod \"maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6\" (UID: \"0252ac19-8757-4b54-9d18-79342afbc0b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"
Nov 02 22:19:34.439664 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.439643    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4t8c\" (UniqueName: \"kubernetes.io/projected/0252ac19-8757-4b54-9d18-79342afbc0b7-kube-api-access-m4t8c\") pod \"maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6\" (UID: \"0252ac19-8757-4b54-9d18-79342afbc0b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"
Nov 02 22:19:34.527661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.527550    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:34.629620 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.629591    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:34.727607 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.727577    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:34.964838 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:34.964719    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0252ac19-8757-4b54-9d18-79342afbc0b7-maas-api-tls\") pod \"maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6\" (UID: \"0252ac19-8757-4b54-9d18-79342afbc0b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"
Nov 02 22:19:35.003276 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:35.001682    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0252ac19-8757-4b54-9d18-79342afbc0b7-maas-api-tls\") pod \"maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6\" (UID: \"0252ac19-8757-4b54-9d18-79342afbc0b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"
Nov 02 22:19:35.159297 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:35.159263    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"
Nov 02 22:19:35.525471 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:35.525375    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:35.565483 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:35.565451    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"]
Nov 02 22:19:35.566055 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:19:35.566030    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0252ac19_8757_4b54_9d18_79342afbc0b7.slice/crio-d8b9013f62de116f92fa5f17a505035cbb128211f448077b804e20fd8af1bc6c WatchSource:0}: Error finding container d8b9013f62de116f92fa5f17a505035cbb128211f448077b804e20fd8af1bc6c: Status 404 returned error can't find the container with id d8b9013f62de116f92fa5f17a505035cbb128211f448077b804e20fd8af1bc6c
Nov 02 22:19:35.713126 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:35.713086    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6" event={"ID":"0252ac19-8757-4b54-9d18-79342afbc0b7","Type":"ContainerStarted","Data":"d8b9013f62de116f92fa5f17a505035cbb128211f448077b804e20fd8af1bc6c"}
Nov 02 22:19:35.924412 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:35.924384    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:19:36.095597 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.095556    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-kube-api-access-42fsr\" (UniqueName: \"kubernetes.io/projected/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-kube-api-access-42fsr\") pod \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") "
Nov 02 22:19:36.095727 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.095602    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-token\" (UniqueName: \"kubernetes.io/projected/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-token\") pod \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") "
Nov 02 22:19:36.095727 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.095668    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-envoy\") pod \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") "
Nov 02 22:19:36.095981 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.095771    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-workload-socket\") pod \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") "
Nov 02 22:19:36.095981 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.095813    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-workload-certs\") pod \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") "
Nov 02 22:19:36.095981 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.095938    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-credential-socket\") pod \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") "
Nov 02 22:19:36.096197 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.096054    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-podinfo\") pod \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") "
Nov 02 22:19:36.096282 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.096198    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istiod-ca-cert\") pod \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") "
Nov 02 22:19:36.096346 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.096286    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-data\") pod \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\" (UID: \"3b21b282-ae28-40c1-85f0-0edb6b1e40ec\") "
Nov 02 22:19:36.096655 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.096627    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-workload-certs" pod "3b21b282-ae28-40c1-85f0-0edb6b1e40ec" (UID: "3b21b282-ae28-40c1-85f0-0edb6b1e40ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:19:36.097062 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.097037    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:36.097303 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.097279    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-credential-socket" pod "3b21b282-ae28-40c1-85f0-0edb6b1e40ec" (UID: "3b21b282-ae28-40c1-85f0-0edb6b1e40ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:19:36.097941 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.097721    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-workload-socket" pod "3b21b282-ae28-40c1-85f0-0edb6b1e40ec" (UID: "3b21b282-ae28-40c1-85f0-0edb6b1e40ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:19:36.097941 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.098030    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istiod-ca-cert" pod "3b21b282-ae28-40c1-85f0-0edb6b1e40ec" (UID: "3b21b282-ae28-40c1-85f0-0edb6b1e40ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:19:36.098327 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.098304    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-data" pod "3b21b282-ae28-40c1-85f0-0edb6b1e40ec" (UID: "3b21b282-ae28-40c1-85f0-0edb6b1e40ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:19:36.100162 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.100136    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-envoy" pod "3b21b282-ae28-40c1-85f0-0edb6b1e40ec" (UID: "3b21b282-ae28-40c1-85f0-0edb6b1e40ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:19:36.100932 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.100905    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-token" pod "3b21b282-ae28-40c1-85f0-0edb6b1e40ec" (UID: "3b21b282-ae28-40c1-85f0-0edb6b1e40ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:19:36.101280 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.101254    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-kube-api-access-42fsr" pod "3b21b282-ae28-40c1-85f0-0edb6b1e40ec" (UID: "3b21b282-ae28-40c1-85f0-0edb6b1e40ec"). InnerVolumeSpecName "kube-api-access-42fsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:19:36.102922 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.102890    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-podinfo" pod "3b21b282-ae28-40c1-85f0-0edb6b1e40ec" (UID: "3b21b282-ae28-40c1-85f0-0edb6b1e40ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:19:36.199485 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.199449    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:36.199485 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.199481    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:36.199485 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.199495    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:36.199927 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.199537    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:36.199927 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.199559    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:36.199927 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.199574    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:36.199927 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.199590    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42fsr\" (UniqueName: \"kubernetes.io/projected/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-kube-api-access-42fsr\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:36.199927 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.199604    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b21b282-ae28-40c1-85f0-0edb6b1e40ec-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:36.274134 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.274100    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:36.724979 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.724944    5076 generic.go:356] "Generic (PLEG): container finished" podID="3b21b282-ae28-40c1-85f0-0edb6b1e40ec" containerID="8a49edfbf649328285d14dfd293dde086d6d1043f61618c3b7bbfe363c7264cf" exitCode=0
Nov 02 22:19:36.725776 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.725737    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t" event={"ID":"3b21b282-ae28-40c1-85f0-0edb6b1e40ec","Type":"ContainerDied","Data":"8a49edfbf649328285d14dfd293dde086d6d1043f61618c3b7bbfe363c7264cf"}
Nov 02 22:19:36.725906 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.725830    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t" event={"ID":"3b21b282-ae28-40c1-85f0-0edb6b1e40ec","Type":"ContainerDied","Data":"f43a4c967aba4b8feb884c3fba7204e24df9f870ed727d264a014b5d37dc088d"}
Nov 02 22:19:36.725906 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.725862    5076 scope.go:122] "RemoveContainer" containerID="8a49edfbf649328285d14dfd293dde086d6d1043f61618c3b7bbfe363c7264cf"
Nov 02 22:19:36.726063 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.726046    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"
Nov 02 22:19:36.730699 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.730671    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6" event={"ID":"0252ac19-8757-4b54-9d18-79342afbc0b7","Type":"ContainerStarted","Data":"35cedfab14e73d796b1a22bfaaa5d4799cbbf55f3417dd0ac797cbf450c62a93"}
Nov 02 22:19:36.730889 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.730748    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"
Nov 02 22:19:36.741843 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.741144    5076 scope.go:122] "RemoveContainer" containerID="8a49edfbf649328285d14dfd293dde086d6d1043f61618c3b7bbfe363c7264cf"
Nov 02 22:19:36.741843 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:19:36.741546    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a49edfbf649328285d14dfd293dde086d6d1043f61618c3b7bbfe363c7264cf\": container with ID starting with 8a49edfbf649328285d14dfd293dde086d6d1043f61618c3b7bbfe363c7264cf not found: ID does not exist" containerID="8a49edfbf649328285d14dfd293dde086d6d1043f61618c3b7bbfe363c7264cf"
Nov 02 22:19:36.741843 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.741578    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a49edfbf649328285d14dfd293dde086d6d1043f61618c3b7bbfe363c7264cf"} err="failed to get container status \"8a49edfbf649328285d14dfd293dde086d6d1043f61618c3b7bbfe363c7264cf\": rpc error: code = NotFound desc = could not find container \"8a49edfbf649328285d14dfd293dde086d6d1043f61618c3b7bbfe363c7264cf\": container with ID starting with 8a49edfbf649328285d14dfd293dde086d6d1043f61618c3b7bbfe363c7264cf not found: ID does not exist"
Nov 02 22:19:36.774080 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.774017    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6" podStartSLOduration=2.297151469 podStartE2EDuration="2.773997858s" totalImagesPullingTime="476.846389ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:19:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:19:36.771480139 +0000 UTC m=+1285.827814520" watchObservedRunningTime="2026-11-02 22:19:36.773997858 +0000 UTC m=+1285.830332238"
Nov 02 22:19:36.803533 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.803497    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"]
Nov 02 22:19:36.822251 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.822205    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-2bz8t"]
Nov 02 22:19:36.886710 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:36.886682    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:37.059468 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:37.059433    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3b21b282-ae28-40c1-85f0-0edb6b1e40ec" path="/var/lib/kubelet/pods/3b21b282-ae28-40c1-85f0-0edb6b1e40ec/volumes"
Nov 02 22:19:37.342180 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:37.342105    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:37.815610 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:37.815573    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:38.112230 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:38.112194    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:38.269580 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:38.269547    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:38.895842 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:38.895813    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:39.660964 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:39.660918    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:40.268333 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:40.268300    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:40.995687 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:40.995651    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:41.627577 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:41.627532    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:41.861189 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:41.861135    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"]
Nov 02 22:19:41.940815 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:41.940726    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:42.631481 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:42.631440    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:42.746086 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:42.746058    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"
Nov 02 22:19:43.189832 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:43.189800    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:43.665841 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:43.665079    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"]
Nov 02 22:19:43.679550 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:43.679511    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg" podUID="a08c99df-f131-4c6e-9a15-c5ae142ca5c9" containerName="maas-api" containerID="cri-o://c8e4a6467cbd9e686ebe09dd4eb9fe079a22860251c7dea108efe4221d286180" gracePeriod=30
Nov 02 22:19:43.694264 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:43.694208    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:44.084661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.084571    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:44.289046 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.288895    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:44.407392 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.407364    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"
Nov 02 22:19:44.452700 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.452663    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:44.566883 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.566849    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-openshift-service-ca\") pod \"a08c99df-f131-4c6e-9a15-c5ae142ca5c9\" (UID: \"a08c99df-f131-4c6e-9a15-c5ae142ca5c9\") "
Nov 02 22:19:44.567097 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.566938    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-metrics-certs\") pod \"a08c99df-f131-4c6e-9a15-c5ae142ca5c9\" (UID: \"a08c99df-f131-4c6e-9a15-c5ae142ca5c9\") "
Nov 02 22:19:44.567184 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.567161    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-kube-api-access-mlfxf\" (UniqueName: \"kubernetes.io/projected/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-kube-api-access-mlfxf\") pod \"a08c99df-f131-4c6e-9a15-c5ae142ca5c9\" (UID: \"a08c99df-f131-4c6e-9a15-c5ae142ca5c9\") "
Nov 02 22:19:44.567320 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.567291    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-maas-api-tls\") pod \"a08c99df-f131-4c6e-9a15-c5ae142ca5c9\" (UID: \"a08c99df-f131-4c6e-9a15-c5ae142ca5c9\") "
Nov 02 22:19:44.567320 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.567295    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-openshift-service-ca" pod "a08c99df-f131-4c6e-9a15-c5ae142ca5c9" (UID: "a08c99df-f131-4c6e-9a15-c5ae142ca5c9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:19:44.568035 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.568008    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:44.570747 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.570712    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-maas-api-tls" pod "a08c99df-f131-4c6e-9a15-c5ae142ca5c9" (UID: "a08c99df-f131-4c6e-9a15-c5ae142ca5c9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:19:44.571345 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.571212    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-kube-api-access-mlfxf" pod "a08c99df-f131-4c6e-9a15-c5ae142ca5c9" (UID: "a08c99df-f131-4c6e-9a15-c5ae142ca5c9"). InnerVolumeSpecName "kube-api-access-mlfxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:19:44.571478 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.571369    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-metrics-certs" pod "a08c99df-f131-4c6e-9a15-c5ae142ca5c9" (UID: "a08c99df-f131-4c6e-9a15-c5ae142ca5c9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:19:44.670646 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.670504    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlfxf\" (UniqueName: \"kubernetes.io/projected/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-kube-api-access-mlfxf\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:44.670646 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.670547    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:44.670646 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.670564    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a08c99df-f131-4c6e-9a15-c5ae142ca5c9-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:44.777607 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.777575    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:44.809171 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.809141    5076 generic.go:356] "Generic (PLEG): container finished" podID="a08c99df-f131-4c6e-9a15-c5ae142ca5c9" containerID="c8e4a6467cbd9e686ebe09dd4eb9fe079a22860251c7dea108efe4221d286180" exitCode=0
Nov 02 22:19:44.809400 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.809195    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"
Nov 02 22:19:44.809400 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.809229    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg" event={"ID":"a08c99df-f131-4c6e-9a15-c5ae142ca5c9","Type":"ContainerDied","Data":"c8e4a6467cbd9e686ebe09dd4eb9fe079a22860251c7dea108efe4221d286180"}
Nov 02 22:19:44.809400 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.809284    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg" event={"ID":"a08c99df-f131-4c6e-9a15-c5ae142ca5c9","Type":"ContainerDied","Data":"fc53dbf3fd20248d472d98c87eca843bea500fc5d797b3011c3c47ca622c333b"}
Nov 02 22:19:44.809400 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.809316    5076 scope.go:122] "RemoveContainer" containerID="c8e4a6467cbd9e686ebe09dd4eb9fe079a22860251c7dea108efe4221d286180"
Nov 02 22:19:44.820187 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.820171    5076 scope.go:122] "RemoveContainer" containerID="c8e4a6467cbd9e686ebe09dd4eb9fe079a22860251c7dea108efe4221d286180"
Nov 02 22:19:44.820505 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:19:44.820486    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8e4a6467cbd9e686ebe09dd4eb9fe079a22860251c7dea108efe4221d286180\": container with ID starting with c8e4a6467cbd9e686ebe09dd4eb9fe079a22860251c7dea108efe4221d286180 not found: ID does not exist" containerID="c8e4a6467cbd9e686ebe09dd4eb9fe079a22860251c7dea108efe4221d286180"
Nov 02 22:19:44.820561 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.820514    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8e4a6467cbd9e686ebe09dd4eb9fe079a22860251c7dea108efe4221d286180"} err="failed to get container status \"c8e4a6467cbd9e686ebe09dd4eb9fe079a22860251c7dea108efe4221d286180\": rpc error: code = NotFound desc = could not find container \"c8e4a6467cbd9e686ebe09dd4eb9fe079a22860251c7dea108efe4221d286180\": container with ID starting with c8e4a6467cbd9e686ebe09dd4eb9fe079a22860251c7dea108efe4221d286180 not found: ID does not exist"
Nov 02 22:19:44.833846 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.833816    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"]
Nov 02 22:19:44.838270 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:44.838243    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-14dae2-6df655dcdc-tjdqg"]
Nov 02 22:19:45.055069 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.054995    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a08c99df-f131-4c6e-9a15-c5ae142ca5c9" path="/var/lib/kubelet/pods/a08c99df-f131-4c6e-9a15-c5ae142ca5c9/volumes"
Nov 02 22:19:45.256118 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.256079    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"]
Nov 02 22:19:45.257103 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.257079    5076 cpu_manager.go:414] "containerMap: removing container" podUID="a08c99df-f131-4c6e-9a15-c5ae142ca5c9" containerName="maas-api"
Nov 02 22:19:45.257227 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.257105    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a08c99df-f131-4c6e-9a15-c5ae142ca5c9" containerName="maas-api"
Nov 02 22:19:45.257227 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.257196    5076 cpu_manager.go:414] "containerMap: removing container" podUID="3b21b282-ae28-40c1-85f0-0edb6b1e40ec" containerName="istio-proxy"
Nov 02 22:19:45.257227 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.257205    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b21b282-ae28-40c1-85f0-0edb6b1e40ec" containerName="istio-proxy"
Nov 02 22:19:45.257401 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.257367    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="3b21b282-ae28-40c1-85f0-0edb6b1e40ec" containerName="istio-proxy"
Nov 02 22:19:45.257401 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.257386    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="a08c99df-f131-4c6e-9a15-c5ae142ca5c9" containerName="maas-api"
Nov 02 22:19:45.262994 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.262967    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"
Nov 02 22:19:45.272032 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.271106    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"]
Nov 02 22:19:45.272032 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.271958    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-419f68-serving-cert\""
Nov 02 22:19:45.278994 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.278962    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-metrics-certs\") pod \"maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8\" (UID: \"31c47ce5-da96-4582-a8e0-09c5e8aafd4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"
Nov 02 22:19:45.279127 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.279033    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-maas-api-tls\") pod \"maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8\" (UID: \"31c47ce5-da96-4582-a8e0-09c5e8aafd4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"
Nov 02 22:19:45.279205 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.279180    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8\" (UID: \"31c47ce5-da96-4582-a8e0-09c5e8aafd4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"
Nov 02 22:19:45.279351 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.279328    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr8zq\" (UniqueName: \"kubernetes.io/projected/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-kube-api-access-nr8zq\") pod \"maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8\" (UID: \"31c47ce5-da96-4582-a8e0-09c5e8aafd4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"
Nov 02 22:19:45.306825 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.306759    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:45.380992 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.380959    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-metrics-certs\") pod \"maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8\" (UID: \"31c47ce5-da96-4582-a8e0-09c5e8aafd4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"
Nov 02 22:19:45.381124 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.381089    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-maas-api-tls\") pod \"maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8\" (UID: \"31c47ce5-da96-4582-a8e0-09c5e8aafd4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"
Nov 02 22:19:45.381318 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.381298    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8\" (UID: \"31c47ce5-da96-4582-a8e0-09c5e8aafd4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"
Nov 02 22:19:45.381464 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.381444    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr8zq\" (UniqueName: \"kubernetes.io/projected/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-kube-api-access-nr8zq\") pod \"maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8\" (UID: \"31c47ce5-da96-4582-a8e0-09c5e8aafd4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"
Nov 02 22:19:45.381939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.381920    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8\" (UID: \"31c47ce5-da96-4582-a8e0-09c5e8aafd4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"
Nov 02 22:19:45.383390 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.383363    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-metrics-certs\") pod \"maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8\" (UID: \"31c47ce5-da96-4582-a8e0-09c5e8aafd4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"
Nov 02 22:19:45.383519 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.383501    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-maas-api-tls\") pod \"maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8\" (UID: \"31c47ce5-da96-4582-a8e0-09c5e8aafd4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"
Nov 02 22:19:45.391286 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.391265    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr8zq\" (UniqueName: \"kubernetes.io/projected/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-kube-api-access-nr8zq\") pod \"maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8\" (UID: \"31c47ce5-da96-4582-a8e0-09c5e8aafd4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"
Nov 02 22:19:45.417581 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.417553    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:45.507127 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.507095    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:45.584811 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:45.584677    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"
Nov 02 22:19:46.017550 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:46.013373    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"]
Nov 02 22:19:46.060211 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:19:46.060179    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c47ce5_da96_4582_a8e0_09c5e8aafd4f.slice/crio-04e67b1c00e717ba04b00fe3ee27ffe4d1b4a335e827d68ac69756bd4351a152 WatchSource:0}: Error finding container 04e67b1c00e717ba04b00fe3ee27ffe4d1b4a335e827d68ac69756bd4351a152: Status 404 returned error can't find the container with id 04e67b1c00e717ba04b00fe3ee27ffe4d1b4a335e827d68ac69756bd4351a152
Nov 02 22:19:46.281310 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:46.281226    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:46.829565 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:46.829532    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8" event={"ID":"31c47ce5-da96-4582-a8e0-09c5e8aafd4f","Type":"ContainerStarted","Data":"bb2d2c7ced3d61275af32718c8709ae0903c993efae5cc14cca9683b2bca1edd"}
Nov 02 22:19:46.829765 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:46.829591    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8" event={"ID":"31c47ce5-da96-4582-a8e0-09c5e8aafd4f","Type":"ContainerStarted","Data":"04e67b1c00e717ba04b00fe3ee27ffe4d1b4a335e827d68ac69756bd4351a152"}
Nov 02 22:19:46.829765 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:46.829661    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"
Nov 02 22:19:46.847541 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:46.847491    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8" podStartSLOduration=1.270862454 podStartE2EDuration="1.847476111s" totalImagesPullingTime="576.613657ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:19:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:19:46.845958614 +0000 UTC m=+1295.902293017" watchObservedRunningTime="2026-11-02 22:19:46.847476111 +0000 UTC m=+1295.903810492"
Nov 02 22:19:46.880864 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:46.880785    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:47.302287 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:47.296678    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:47.393871 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:47.393835    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:47.661101 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:47.660922    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:48.749023 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:48.748987    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:49.491080 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:49.491046    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:50.215713 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:50.215676    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:51.193293 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:51.193258    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:51.985700 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:51.985655    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:52.092277 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:52.091456    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:52.397201 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:52.387163    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:52.513242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:52.486902    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:52.877240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:52.876411    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"
Nov 02 22:19:53.168777 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:53.168694    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:53.367250 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:53.366927    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:53.831270 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:53.826912    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:54.202098 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:54.202062    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:54.567295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:54.566249    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:55.048286 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:55.046880    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:55.155567 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:55.155524    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:19:56.382265 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:56.380878    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:56.884623 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:56.884544    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main" containerID="cri-o://1c6cfe69ccb788a0723f8b3dd83b2a24068625cfa16fac608558e8180ea1a5d4" gracePeriod=45
Nov 02 22:19:57.235074 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.229664    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:19:57.282342 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.282306    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:57.324014 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.323976    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/54724ed9-1d96-4698-8e4c-f42d83f04b80-kube-api-access-f2q9c\" (UniqueName: \"kubernetes.io/projected/54724ed9-1d96-4698-8e4c-f42d83f04b80-kube-api-access-f2q9c\") pod \"54724ed9-1d96-4698-8e4c-f42d83f04b80\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") "
Nov 02 22:19:57.324303 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.324281    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-dshm\" (UniqueName: \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-dshm\") pod \"54724ed9-1d96-4698-8e4c-f42d83f04b80\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") "
Nov 02 22:19:57.324367 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.324353    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-home\" (UniqueName: \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-home\") pod \"54724ed9-1d96-4698-8e4c-f42d83f04b80\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") "
Nov 02 22:19:57.324482 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.324445    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/54724ed9-1d96-4698-8e4c-f42d83f04b80-tls-certs\" (UniqueName: \"kubernetes.io/secret/54724ed9-1d96-4698-8e4c-f42d83f04b80-tls-certs\") pod \"54724ed9-1d96-4698-8e4c-f42d83f04b80\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") "
Nov 02 22:19:57.324559 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.324520    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-model-cache\") pod \"54724ed9-1d96-4698-8e4c-f42d83f04b80\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") "
Nov 02 22:19:57.324617 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.324579    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-tmp-dir\") pod \"54724ed9-1d96-4698-8e4c-f42d83f04b80\" (UID: \"54724ed9-1d96-4698-8e4c-f42d83f04b80\") "
Nov 02 22:19:57.324696 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.324667    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-home" pod "54724ed9-1d96-4698-8e4c-f42d83f04b80" (UID: "54724ed9-1d96-4698-8e4c-f42d83f04b80"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:19:57.324909 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.324888    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-model-cache" pod "54724ed9-1d96-4698-8e4c-f42d83f04b80" (UID: "54724ed9-1d96-4698-8e4c-f42d83f04b80"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:19:57.325143 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.325121    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-tmp-dir" pod "54724ed9-1d96-4698-8e4c-f42d83f04b80" (UID: "54724ed9-1d96-4698-8e4c-f42d83f04b80"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:19:57.325391 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.325373    5076 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-tmp-dir\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:57.325437 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.325397    5076 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-home\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:57.325437 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.325410    5076 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-model-cache\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:57.326390 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.326369    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54724ed9-1d96-4698-8e4c-f42d83f04b80-kube-api-access-f2q9c" pod "54724ed9-1d96-4698-8e4c-f42d83f04b80" (UID: "54724ed9-1d96-4698-8e4c-f42d83f04b80"). InnerVolumeSpecName "kube-api-access-f2q9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:19:57.326717 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.326698    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-dshm" pod "54724ed9-1d96-4698-8e4c-f42d83f04b80" (UID: "54724ed9-1d96-4698-8e4c-f42d83f04b80"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:19:57.326794 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.326724    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54724ed9-1d96-4698-8e4c-f42d83f04b80-tls-certs" pod "54724ed9-1d96-4698-8e4c-f42d83f04b80" (UID: "54724ed9-1d96-4698-8e4c-f42d83f04b80"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:19:57.428158 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.426870    5076 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54724ed9-1d96-4698-8e4c-f42d83f04b80-dshm\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:57.428158 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.426910    5076 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54724ed9-1d96-4698-8e4c-f42d83f04b80-tls-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:57.428158 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.426926    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2q9c\" (UniqueName: \"kubernetes.io/projected/54724ed9-1d96-4698-8e4c-f42d83f04b80-kube-api-access-f2q9c\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:57.540278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.540164    5076 generic.go:356] "Generic (PLEG): container finished" podID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerID="1c6cfe69ccb788a0723f8b3dd83b2a24068625cfa16fac608558e8180ea1a5d4" exitCode=0
Nov 02 22:19:57.540278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.540240    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"
Nov 02 22:19:57.540500 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.540282    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" event={"ID":"54724ed9-1d96-4698-8e4c-f42d83f04b80","Type":"ContainerDied","Data":"1c6cfe69ccb788a0723f8b3dd83b2a24068625cfa16fac608558e8180ea1a5d4"}
Nov 02 22:19:57.540500 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.540329    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg" event={"ID":"54724ed9-1d96-4698-8e4c-f42d83f04b80","Type":"ContainerDied","Data":"68bfdf8062ab24a1eff28f2a3ef0f1289152f7ccc48d4e0f99d7a9f63657c427"}
Nov 02 22:19:57.540500 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.540352    5076 scope.go:122] "RemoveContainer" containerID="1c6cfe69ccb788a0723f8b3dd83b2a24068625cfa16fac608558e8180ea1a5d4"
Nov 02 22:19:57.552775 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.552756    5076 scope.go:122] "RemoveContainer" containerID="1c6cfe69ccb788a0723f8b3dd83b2a24068625cfa16fac608558e8180ea1a5d4"
Nov 02 22:19:57.553038 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:19:57.553017    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c6cfe69ccb788a0723f8b3dd83b2a24068625cfa16fac608558e8180ea1a5d4\": container with ID starting with 1c6cfe69ccb788a0723f8b3dd83b2a24068625cfa16fac608558e8180ea1a5d4 not found: ID does not exist" containerID="1c6cfe69ccb788a0723f8b3dd83b2a24068625cfa16fac608558e8180ea1a5d4"
Nov 02 22:19:57.553074 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.553049    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c6cfe69ccb788a0723f8b3dd83b2a24068625cfa16fac608558e8180ea1a5d4"} err="failed to get container status \"1c6cfe69ccb788a0723f8b3dd83b2a24068625cfa16fac608558e8180ea1a5d4\": rpc error: code = NotFound desc = could not find container \"1c6cfe69ccb788a0723f8b3dd83b2a24068625cfa16fac608558e8180ea1a5d4\": container with ID starting with 1c6cfe69ccb788a0723f8b3dd83b2a24068625cfa16fac608558e8180ea1a5d4 not found: ID does not exist"
Nov 02 22:19:57.565051 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.565026    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"]
Nov 02 22:19:57.568938 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:57.568919    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-a1d78c/premium-w6-a1d78c-kserve-55d87cdf5d-qkgsg"]
Nov 02 22:19:58.075679 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:58.075413    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:58.694508 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:58.694469    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"]
Nov 02 22:19:58.695098 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:58.694727    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc" podUID="101ad2fe-5a3f-4798-b598-e23e65e651f3" containerName="maas-api" containerID="cri-o://6f3b8f06314100b5025818a6e77c4b90a5cfb24094cc42a85054800a6d8abd12" gracePeriod=30
Nov 02 22:19:58.725771 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:58.725742    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:58.960049 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:58.959955    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:59.127515 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.124964    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" path="/var/lib/kubelet/pods/54724ed9-1d96-4698-8e4c-f42d83f04b80/volumes"
Nov 02 22:19:59.131882 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.131858    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"
Nov 02 22:19:59.132637 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.132572    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:59.336288 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.331886    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/101ad2fe-5a3f-4798-b598-e23e65e651f3-metrics-certs\" (UniqueName: \"kubernetes.io/secret/101ad2fe-5a3f-4798-b598-e23e65e651f3-metrics-certs\") pod \"101ad2fe-5a3f-4798-b598-e23e65e651f3\" (UID: \"101ad2fe-5a3f-4798-b598-e23e65e651f3\") "
Nov 02 22:19:59.336288 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.332132    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/101ad2fe-5a3f-4798-b598-e23e65e651f3-kube-api-access-dcpwm\" (UniqueName: \"kubernetes.io/projected/101ad2fe-5a3f-4798-b598-e23e65e651f3-kube-api-access-dcpwm\") pod \"101ad2fe-5a3f-4798-b598-e23e65e651f3\" (UID: \"101ad2fe-5a3f-4798-b598-e23e65e651f3\") "
Nov 02 22:19:59.336288 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.332185    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/101ad2fe-5a3f-4798-b598-e23e65e651f3-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/101ad2fe-5a3f-4798-b598-e23e65e651f3-openshift-service-ca\") pod \"101ad2fe-5a3f-4798-b598-e23e65e651f3\" (UID: \"101ad2fe-5a3f-4798-b598-e23e65e651f3\") "
Nov 02 22:19:59.336288 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.332256    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/101ad2fe-5a3f-4798-b598-e23e65e651f3-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/101ad2fe-5a3f-4798-b598-e23e65e651f3-maas-api-tls\") pod \"101ad2fe-5a3f-4798-b598-e23e65e651f3\" (UID: \"101ad2fe-5a3f-4798-b598-e23e65e651f3\") "
Nov 02 22:19:59.356483 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.351930    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:59.356483 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.356402    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/101ad2fe-5a3f-4798-b598-e23e65e651f3-openshift-service-ca" pod "101ad2fe-5a3f-4798-b598-e23e65e651f3" (UID: "101ad2fe-5a3f-4798-b598-e23e65e651f3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:19:59.432643 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.432571    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/101ad2fe-5a3f-4798-b598-e23e65e651f3-kube-api-access-dcpwm" pod "101ad2fe-5a3f-4798-b598-e23e65e651f3" (UID: "101ad2fe-5a3f-4798-b598-e23e65e651f3"). InnerVolumeSpecName "kube-api-access-dcpwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:19:59.434106 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.434071    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcpwm\" (UniqueName: \"kubernetes.io/projected/101ad2fe-5a3f-4798-b598-e23e65e651f3-kube-api-access-dcpwm\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:59.434278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.434112    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/101ad2fe-5a3f-4798-b598-e23e65e651f3-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:59.436291 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.435551    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/101ad2fe-5a3f-4798-b598-e23e65e651f3-maas-api-tls" pod "101ad2fe-5a3f-4798-b598-e23e65e651f3" (UID: "101ad2fe-5a3f-4798-b598-e23e65e651f3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:19:59.437363 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.437284    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:59.485242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.484968    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/101ad2fe-5a3f-4798-b598-e23e65e651f3-metrics-certs" pod "101ad2fe-5a3f-4798-b598-e23e65e651f3" (UID: "101ad2fe-5a3f-4798-b598-e23e65e651f3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:19:59.536478 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.535717    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/101ad2fe-5a3f-4798-b598-e23e65e651f3-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:59.536478 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.535757    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/101ad2fe-5a3f-4798-b598-e23e65e651f3-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:19:59.563244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.561754    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"
Nov 02 22:19:59.563244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.561786    5076 generic.go:356] "Generic (PLEG): container finished" podID="101ad2fe-5a3f-4798-b598-e23e65e651f3" containerID="6f3b8f06314100b5025818a6e77c4b90a5cfb24094cc42a85054800a6d8abd12" exitCode=0
Nov 02 22:19:59.563244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.561800    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc" event={"ID":"101ad2fe-5a3f-4798-b598-e23e65e651f3","Type":"ContainerDied","Data":"6f3b8f06314100b5025818a6e77c4b90a5cfb24094cc42a85054800a6d8abd12"}
Nov 02 22:19:59.563244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.562069    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc" event={"ID":"101ad2fe-5a3f-4798-b598-e23e65e651f3","Type":"ContainerDied","Data":"4d5dec0e073b4a7a3e3f59b9e6b0b31496b0abb8858fe9eedf6d903106149c3d"}
Nov 02 22:19:59.563244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.562181    5076 scope.go:122] "RemoveContainer" containerID="6f3b8f06314100b5025818a6e77c4b90a5cfb24094cc42a85054800a6d8abd12"
Nov 02 22:19:59.581728 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.581703    5076 scope.go:122] "RemoveContainer" containerID="6f3b8f06314100b5025818a6e77c4b90a5cfb24094cc42a85054800a6d8abd12"
Nov 02 22:19:59.582143 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:19:59.582109    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f3b8f06314100b5025818a6e77c4b90a5cfb24094cc42a85054800a6d8abd12\": container with ID starting with 6f3b8f06314100b5025818a6e77c4b90a5cfb24094cc42a85054800a6d8abd12 not found: ID does not exist" containerID="6f3b8f06314100b5025818a6e77c4b90a5cfb24094cc42a85054800a6d8abd12"
Nov 02 22:19:59.582357 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.582157    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f3b8f06314100b5025818a6e77c4b90a5cfb24094cc42a85054800a6d8abd12"} err="failed to get container status \"6f3b8f06314100b5025818a6e77c4b90a5cfb24094cc42a85054800a6d8abd12\": rpc error: code = NotFound desc = could not find container \"6f3b8f06314100b5025818a6e77c4b90a5cfb24094cc42a85054800a6d8abd12\": container with ID starting with 6f3b8f06314100b5025818a6e77c4b90a5cfb24094cc42a85054800a6d8abd12 not found: ID does not exist"
Nov 02 22:19:59.605286 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.604892    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"]
Nov 02 22:19:59.609841 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.609812    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-5f4a2f-84595ff596-4kgpc"]
Nov 02 22:19:59.631086 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:19:59.631050    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:19:59.892325 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:19:59.892203    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:20:00.477908 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:00.477876    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:01.059159 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:01.059123    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="101ad2fe-5a3f-4798-b598-e23e65e651f3" path="/var/lib/kubelet/pods/101ad2fe-5a3f-4798-b598-e23e65e651f3/volumes"
Nov 02 22:20:01.107472 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:01.107440    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:01.225271 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:01.215906    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:01.377238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:01.369132    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:02.327625 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:02.327586    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:02.441601 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:02.441557    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:02.530930 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:02.530892    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:03.392725 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:03.392689    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:03.498515 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:03.498376    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:03.821088 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:03.820985    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:04.247461 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:04.247258    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:04.352879 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:04.352847    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:04.802379 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:04.802343    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:04.898004 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:04.897970    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:05.692048 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:05.692011    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:06.366364 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:06.366328    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:06.467713 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:06.467667    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:06.567211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:06.567174    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:06.686597 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:06.686513    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:06.709627 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:06.709598    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"]
Nov 02 22:20:06.710092 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:06.710055    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks" podUID="be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" containerName="istio-proxy" containerID="cri-o://7f0787fd47f984715c9ac6b8412f2072288b54425463d8d816ea844a1d751359" gracePeriod=30
Nov 02 22:20:06.721419 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:06.721381    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"]
Nov 02 22:20:06.721660 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:06.721606    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm" podUID="4e04cfe4-512d-43a4-816f-35e123b876a4" containerName="istio-proxy" containerID="cri-o://ca321db335e47d049ae3f7708b9254bec5767d976b163b41d253f24b5288f6ad" gracePeriod=30
Nov 02 22:20:06.727324 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:06.726405    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"]
Nov 02 22:20:06.727324 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:06.726603    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj" podUID="0f0bc277-c9d9-4d7f-b8f6-272aafaed134" containerName="istio-proxy" containerID="cri-o://868362832e7229b788ca263588fe9484e003ae8d945f290d05806c49fd9d21cc" gracePeriod=30
Nov 02 22:20:06.884398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:06.884356    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 22:20:06.884744 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:06.884708    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj" podUID="0f0bc277-c9d9-4d7f-b8f6-272aafaed134" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 22:20:06.919186 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:06.919099    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:07.025171 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:07.025091    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:07.579452 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:07.579411    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:08.121207 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.121174    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:08.364333 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.364297    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"]
Nov 02 22:20:08.365697 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.365665    5076 cpu_manager.go:414] "containerMap: removing container" podUID="101ad2fe-5a3f-4798-b598-e23e65e651f3" containerName="maas-api"
Nov 02 22:20:08.365857 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.365844    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="101ad2fe-5a3f-4798-b598-e23e65e651f3" containerName="maas-api"
Nov 02 22:20:08.365966 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.365954    5076 cpu_manager.go:414] "containerMap: removing container" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main"
Nov 02 22:20:08.366043 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.366032    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main"
Nov 02 22:20:08.366330 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.366314    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="101ad2fe-5a3f-4798-b598-e23e65e651f3" containerName="maas-api"
Nov 02 22:20:08.366445 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.366435    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="54724ed9-1d96-4698-8e4c-f42d83f04b80" containerName="main"
Nov 02 22:20:08.400866 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.400783    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:08.427369 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.427338    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.431196 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.427571    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"]
Nov 02 22:20:08.453977 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.440342    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w0-7bb56e-openshift-default-dockercfg-jkclr\""
Nov 02 22:20:08.593737 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.593693    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flz8s\" (UniqueName: \"kubernetes.io/projected/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-kube-api-access-flz8s\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.605291 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.605167    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-token\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.605777 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.605739    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-workload-certs\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.606052 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.606028    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istiod-ca-cert\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.606408 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.606379    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-podinfo\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.606838 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.606815    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-envoy\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.607115 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.607088    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-credential-socket\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.607419 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.607315    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-workload-socket\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.607596 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.607577    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-data\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.864206 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.862897    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 22:20:08.864206 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.862973    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks" podUID="be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 22:20:08.866611 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.866519    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-token\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.866756 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.866680    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-workload-certs\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.866756 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.866731    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istiod-ca-cert\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.866886 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.866800    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-podinfo\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.866886 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.866855    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-envoy\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.866987 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.866949    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-credential-socket\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.867048 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.866990    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-workload-socket\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.867048 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.867027    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-data\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.867153 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.867141    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flz8s\" (UniqueName: \"kubernetes.io/projected/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-kube-api-access-flz8s\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.868249 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.868202    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-workload-certs\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.869110 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.869084    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-data\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.869389 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.869365    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-workload-socket\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.870453 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.870430    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-credential-socket\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.874651 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.874623    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istiod-ca-cert\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.886053 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.886026    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-podinfo\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.889353 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.889325    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-token\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.889630 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.889595    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flz8s\" (UniqueName: \"kubernetes.io/projected/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-kube-api-access-flz8s\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:08.894062 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:08.894010    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-envoy\") pod \"e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") " pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:09.103457 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:09.103422    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:09.402610 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:09.402528    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"]
Nov 02 22:20:09.406975 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:20:09.406932    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c3afa50_8fb1_44e5_ab90_d7c6a48a124c.slice/crio-6cf0858c0d34ba9aa66ed95ae9b4dfba4fbafb6bda2f340fe77c86f454d6850c WatchSource:0}: Error finding container 6cf0858c0d34ba9aa66ed95ae9b4dfba4fbafb6bda2f340fe77c86f454d6850c: Status 404 returned error can't find the container with id 6cf0858c0d34ba9aa66ed95ae9b4dfba4fbafb6bda2f340fe77c86f454d6850c
Nov 02 22:20:09.410102 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:09.410066    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:20:09.410199 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:09.410135    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:20:09.410199 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:09.410168    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:20:09.418503 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:09.418481    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:09.888043 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:09.888005    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt" event={"ID":"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c","Type":"ContainerStarted","Data":"518613a5641f3d189eb5a2ea39a277822563309e8c0377eb96d9272548f00920"}
Nov 02 22:20:09.888645 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:09.888621    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt" event={"ID":"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c","Type":"ContainerStarted","Data":"6cf0858c0d34ba9aa66ed95ae9b4dfba4fbafb6bda2f340fe77c86f454d6850c"}
Nov 02 22:20:09.924780 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:09.924713    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt" podStartSLOduration=1.924692371 podStartE2EDuration="1.924692371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:20:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:20:09.912768245 +0000 UTC m=+1318.969102629" watchObservedRunningTime="2026-11-02 22:20:09.924692371 +0000 UTC m=+1318.981026753"
Nov 02 22:20:10.104513 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:10.104479    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:10.105968 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:10.105940    5076 patch_prober.go:29] interesting pod/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused" start-of-body=
Nov 02 22:20:10.106095 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:10.105997    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt" podUID="7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused"
Nov 02 22:20:10.380200 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:10.380163    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:10.946770 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:10.946733    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:11.048778 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:11.048745    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:11.126234 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:11.124531    5076 patch_prober.go:29] interesting pod/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused" start-of-body=
Nov 02 22:20:11.126234 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:11.124592    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt" podUID="7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused"
Nov 02 22:20:11.158276 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:11.153868    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"]
Nov 02 22:20:11.158276 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:11.154084    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47" podUID="3529fe1f-6b60-4755-8dcd-eb2349e8f1d3" containerName="maas-api" containerID="cri-o://237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf" gracePeriod=30
Nov 02 22:20:11.498289 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:11.492266    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:11.866428 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:11.862961    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:11.945173 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:11.945130    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:12.002503 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.000753    5076 generic.go:356] "Generic (PLEG): container finished" podID="3529fe1f-6b60-4755-8dcd-eb2349e8f1d3" containerID="237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf" exitCode=0
Nov 02 22:20:12.002503 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.001751    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47" event={"ID":"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3","Type":"ContainerDied","Data":"237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf"}
Nov 02 22:20:12.027863 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.027505    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"
Nov 02 22:20:12.106391 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.105899    5076 patch_prober.go:29] interesting pod/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused" start-of-body=
Nov 02 22:20:12.106391 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.105959    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt" podUID="7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused"
Nov 02 22:20:12.208562 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.157921    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-metrics-certs\") pod \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\" (UID: \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\") "
Nov 02 22:20:12.208562 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.158054    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-kube-api-access-7lt6n\" (UniqueName: \"kubernetes.io/projected/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-kube-api-access-7lt6n\") pod \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\" (UID: \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\") "
Nov 02 22:20:12.208562 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.158135    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-openshift-service-ca\") pod \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\" (UID: \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\") "
Nov 02 22:20:12.208562 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.158196    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-maas-api-tls\") pod \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\" (UID: \"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3\") "
Nov 02 22:20:12.238373 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.222711    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-openshift-service-ca" pod "3529fe1f-6b60-4755-8dcd-eb2349e8f1d3" (UID: "3529fe1f-6b60-4755-8dcd-eb2349e8f1d3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:20:12.238373 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.236040    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-kube-api-access-7lt6n" pod "3529fe1f-6b60-4755-8dcd-eb2349e8f1d3" (UID: "3529fe1f-6b60-4755-8dcd-eb2349e8f1d3"). InnerVolumeSpecName "kube-api-access-7lt6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:20:12.246815 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.239889    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-maas-api-tls" pod "3529fe1f-6b60-4755-8dcd-eb2349e8f1d3" (UID: "3529fe1f-6b60-4755-8dcd-eb2349e8f1d3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:20:12.246815 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.239949    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-metrics-certs" pod "3529fe1f-6b60-4755-8dcd-eb2349e8f1d3" (UID: "3529fe1f-6b60-4755-8dcd-eb2349e8f1d3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:20:12.261192 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.260818    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:12.261192 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.260843    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lt6n\" (UniqueName: \"kubernetes.io/projected/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-kube-api-access-7lt6n\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:12.261192 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.260853    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:12.261192 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.260863    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:12.309841 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.309801    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:12.422256 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.416011    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:12.508905 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.508872    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:12.675284 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.670454    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:20:12.811278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.797111    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-workload-certs\") pod \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") "
Nov 02 22:20:12.811278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.797349    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-kube-api-access-pq64t\" (UniqueName: \"kubernetes.io/projected/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-kube-api-access-pq64t\") pod \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") "
Nov 02 22:20:12.811278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.797410    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-credential-socket\") pod \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") "
Nov 02 22:20:12.811278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.797478    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-envoy\") pod \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") "
Nov 02 22:20:12.811278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.797523    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-token\" (UniqueName: \"kubernetes.io/projected/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-token\") pod \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") "
Nov 02 22:20:12.811278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.797592    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istiod-ca-cert\") pod \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") "
Nov 02 22:20:12.811278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.797727    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-podinfo\") pod \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") "
Nov 02 22:20:12.811278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.797756    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-data\") pod \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") "
Nov 02 22:20:12.811278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.797788    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-workload-socket\") pod \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\" (UID: \"0f0bc277-c9d9-4d7f-b8f6-272aafaed134\") "
Nov 02 22:20:12.821654 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.821610    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-workload-socket" pod "0f0bc277-c9d9-4d7f-b8f6-272aafaed134" (UID: "0f0bc277-c9d9-4d7f-b8f6-272aafaed134"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:12.843115 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.822740    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:12.869347 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.851358    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-credential-socket" pod "0f0bc277-c9d9-4d7f-b8f6-272aafaed134" (UID: "0f0bc277-c9d9-4d7f-b8f6-272aafaed134"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:12.869347 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.851452    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-workload-certs" pod "0f0bc277-c9d9-4d7f-b8f6-272aafaed134" (UID: "0f0bc277-c9d9-4d7f-b8f6-272aafaed134"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:12.962775 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.916320    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-data" pod "0f0bc277-c9d9-4d7f-b8f6-272aafaed134" (UID: "0f0bc277-c9d9-4d7f-b8f6-272aafaed134"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:12.962775 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:12.916649    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istiod-ca-cert" pod "0f0bc277-c9d9-4d7f-b8f6-272aafaed134" (UID: "0f0bc277-c9d9-4d7f-b8f6-272aafaed134"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:20:13.013241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.010025    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.013241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.010065    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.013241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.010081    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.013241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.010094    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.063787 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.063578    5076 generic.go:356] "Generic (PLEG): container finished" podID="be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" containerID="7f0787fd47f984715c9ac6b8412f2072288b54425463d8d816ea844a1d751359" exitCode=0
Nov 02 22:20:13.068184 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.068154    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks" event={"ID":"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa","Type":"ContainerDied","Data":"7f0787fd47f984715c9ac6b8412f2072288b54425463d8d816ea844a1d751359"}
Nov 02 22:20:13.112365 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.112325    5076 patch_prober.go:29] interesting pod/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused" start-of-body=
Nov 02 22:20:13.112546 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.112403    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt" podUID="7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused"
Nov 02 22:20:13.112546 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.112460    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-kube-api-access-pq64t" pod "0f0bc277-c9d9-4d7f-b8f6-272aafaed134" (UID: "0f0bc277-c9d9-4d7f-b8f6-272aafaed134"). InnerVolumeSpecName "kube-api-access-pq64t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:20:13.115241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.114259    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-podinfo" pod "0f0bc277-c9d9-4d7f-b8f6-272aafaed134" (UID: "0f0bc277-c9d9-4d7f-b8f6-272aafaed134"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:20:13.115241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.114363    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-token" pod "0f0bc277-c9d9-4d7f-b8f6-272aafaed134" (UID: "0f0bc277-c9d9-4d7f-b8f6-272aafaed134"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:20:13.115241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.115004    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-envoy" pod "0f0bc277-c9d9-4d7f-b8f6-272aafaed134" (UID: "0f0bc277-c9d9-4d7f-b8f6-272aafaed134"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:13.139748 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.139722    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq64t\" (UniqueName: \"kubernetes.io/projected/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-kube-api-access-pq64t\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.140002 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.139985    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.140186 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.140172    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.140341 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.140319    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f0bc277-c9d9-4d7f-b8f6-272aafaed134-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.149772 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.149744    5076 generic.go:356] "Generic (PLEG): container finished" podID="0f0bc277-c9d9-4d7f-b8f6-272aafaed134" containerID="868362832e7229b788ca263588fe9484e003ae8d945f290d05806c49fd9d21cc" exitCode=0
Nov 02 22:20:13.150042 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.150020    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj" event={"ID":"0f0bc277-c9d9-4d7f-b8f6-272aafaed134","Type":"ContainerDied","Data":"868362832e7229b788ca263588fe9484e003ae8d945f290d05806c49fd9d21cc"}
Nov 02 22:20:13.176591 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.155511    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj" event={"ID":"0f0bc277-c9d9-4d7f-b8f6-272aafaed134","Type":"ContainerDied","Data":"17996470ecc82e3f0859f11ec589c41bbe4fd114011453e31ff263ac72b89081"}
Nov 02 22:20:13.176591 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.150696    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"
Nov 02 22:20:13.176591 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.155672    5076 scope.go:122] "RemoveContainer" containerID="868362832e7229b788ca263588fe9484e003ae8d945f290d05806c49fd9d21cc"
Nov 02 22:20:13.176591 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.161463    5076 generic.go:356] "Generic (PLEG): container finished" podID="4e04cfe4-512d-43a4-816f-35e123b876a4" containerID="ca321db335e47d049ae3f7708b9254bec5767d976b163b41d253f24b5288f6ad" exitCode=0
Nov 02 22:20:13.176591 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.161594    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm" event={"ID":"4e04cfe4-512d-43a4-816f-35e123b876a4","Type":"ContainerDied","Data":"ca321db335e47d049ae3f7708b9254bec5767d976b163b41d253f24b5288f6ad"}
Nov 02 22:20:13.176591 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.164956    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47" event={"ID":"3529fe1f-6b60-4755-8dcd-eb2349e8f1d3","Type":"ContainerDied","Data":"89387c260b769c8f659eb432a65becdef698f4f2b3e26ae7633f7411c793817c"}
Nov 02 22:20:13.176591 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.165089    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"
Nov 02 22:20:13.209181 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.209150    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:20:13.221941 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.221917    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:20:13.225165 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.225149    5076 scope.go:122] "RemoveContainer" containerID="868362832e7229b788ca263588fe9484e003ae8d945f290d05806c49fd9d21cc"
Nov 02 22:20:13.226023 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:20:13.225996    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"868362832e7229b788ca263588fe9484e003ae8d945f290d05806c49fd9d21cc\": container with ID starting with 868362832e7229b788ca263588fe9484e003ae8d945f290d05806c49fd9d21cc not found: ID does not exist" containerID="868362832e7229b788ca263588fe9484e003ae8d945f290d05806c49fd9d21cc"
Nov 02 22:20:13.226081 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.226041    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"868362832e7229b788ca263588fe9484e003ae8d945f290d05806c49fd9d21cc"} err="failed to get container status \"868362832e7229b788ca263588fe9484e003ae8d945f290d05806c49fd9d21cc\": rpc error: code = NotFound desc = could not find container \"868362832e7229b788ca263588fe9484e003ae8d945f290d05806c49fd9d21cc\": container with ID starting with 868362832e7229b788ca263588fe9484e003ae8d945f290d05806c49fd9d21cc not found: ID does not exist"
Nov 02 22:20:13.226081 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.226069    5076 scope.go:122] "RemoveContainer" containerID="237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf"
Nov 02 22:20:13.266350 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.266319    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"]
Nov 02 22:20:13.267295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.267274    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-a1d78c-656c84d9fc-xbf47"]
Nov 02 22:20:13.336209 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.336176    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"]
Nov 02 22:20:13.342670 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.342638    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-fcqvj"]
Nov 02 22:20:13.355021 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.354992    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4e04cfe4-512d-43a4-816f-35e123b876a4-kube-api-access-xdktf\" (UniqueName: \"kubernetes.io/projected/4e04cfe4-512d-43a4-816f-35e123b876a4-kube-api-access-xdktf\") pod \"4e04cfe4-512d-43a4-816f-35e123b876a4\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") "
Nov 02 22:20:13.355169 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.355083    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-credential-socket\") pod \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") "
Nov 02 22:20:13.355169 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.355144    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-workload-certs\") pod \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") "
Nov 02 22:20:13.355300 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.355183    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-podinfo\") pod \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") "
Nov 02 22:20:13.355300 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.355229    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-podinfo\") pod \"4e04cfe4-512d-43a4-816f-35e123b876a4\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") "
Nov 02 22:20:13.355398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.355299    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-credential-socket\") pod \"4e04cfe4-512d-43a4-816f-35e123b876a4\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") "
Nov 02 22:20:13.355398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.355336    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-envoy\") pod \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") "
Nov 02 22:20:13.355398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.355378    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-data\") pod \"4e04cfe4-512d-43a4-816f-35e123b876a4\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") "
Nov 02 22:20:13.355542 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.355406    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-envoy\") pod \"4e04cfe4-512d-43a4-816f-35e123b876a4\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") "
Nov 02 22:20:13.355542 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.355452    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-workload-certs" pod "be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" (UID: "be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:13.355542 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.355462    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-workload-socket\") pod \"4e04cfe4-512d-43a4-816f-35e123b876a4\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") "
Nov 02 22:20:13.355542 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.355509    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-data\") pod \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") "
Nov 02 22:20:13.355710 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.355568    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-token\" (UniqueName: \"kubernetes.io/projected/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-token\") pod \"4e04cfe4-512d-43a4-816f-35e123b876a4\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") "
Nov 02 22:20:13.355710 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.355683    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-data" pod "4e04cfe4-512d-43a4-816f-35e123b876a4" (UID: "4e04cfe4-512d-43a4-816f-35e123b876a4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:13.355710 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.355700    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4e04cfe4-512d-43a4-816f-35e123b876a4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e04cfe4-512d-43a4-816f-35e123b876a4-istiod-ca-cert\") pod \"4e04cfe4-512d-43a4-816f-35e123b876a4\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") "
Nov 02 22:20:13.355855 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.355705    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-credential-socket" pod "4e04cfe4-512d-43a4-816f-35e123b876a4" (UID: "4e04cfe4-512d-43a4-816f-35e123b876a4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:13.355855 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.355732    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istiod-ca-cert\") pod \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") "
Nov 02 22:20:13.355855 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.355779    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-kube-api-access-jjhnp\" (UniqueName: \"kubernetes.io/projected/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-kube-api-access-jjhnp\") pod \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") "
Nov 02 22:20:13.355855 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.355815    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-workload-socket\") pod \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") "
Nov 02 22:20:13.356058 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.355900    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-token\" (UniqueName: \"kubernetes.io/projected/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-token\") pod \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\" (UID: \"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa\") "
Nov 02 22:20:13.356058 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.355978    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-workload-certs\") pod \"4e04cfe4-512d-43a4-816f-35e123b876a4\" (UID: \"4e04cfe4-512d-43a4-816f-35e123b876a4\") "
Nov 02 22:20:13.356169 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.356135    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-credential-socket" pod "be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" (UID: "be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:13.356930 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.356653    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-workload-socket" pod "4e04cfe4-512d-43a4-816f-35e123b876a4" (UID: "4e04cfe4-512d-43a4-816f-35e123b876a4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:13.356930 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.356734    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e04cfe4-512d-43a4-816f-35e123b876a4-istiod-ca-cert" pod "4e04cfe4-512d-43a4-816f-35e123b876a4" (UID: "4e04cfe4-512d-43a4-816f-35e123b876a4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:20:13.357095 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.356990    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-data" pod "be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" (UID: "be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:13.357371 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.357348    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-workload-socket" pod "be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" (UID: "be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:13.360702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.358667    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e04cfe4-512d-43a4-816f-35e123b876a4-kube-api-access-xdktf" pod "4e04cfe4-512d-43a4-816f-35e123b876a4" (UID: "4e04cfe4-512d-43a4-816f-35e123b876a4"). InnerVolumeSpecName "kube-api-access-xdktf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:20:13.360702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.359014    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-workload-certs" pod "4e04cfe4-512d-43a4-816f-35e123b876a4" (UID: "4e04cfe4-512d-43a4-816f-35e123b876a4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:13.360702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.359495    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e04cfe4-512d-43a4-816f-35e123b876a4-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.360702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.359520    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.360702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.359535    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.360702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.359550    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdktf\" (UniqueName: \"kubernetes.io/projected/4e04cfe4-512d-43a4-816f-35e123b876a4-kube-api-access-xdktf\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.360702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.359565    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.360702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.359579    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.360702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.359592    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.360702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.359606    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.360702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.359619    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.360702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.359633    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.360702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.359530    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-kube-api-access-jjhnp" pod "be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" (UID: "be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa"). InnerVolumeSpecName "kube-api-access-jjhnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:20:13.360702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.359857    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istiod-ca-cert" pod "be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" (UID: "be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:20:13.360702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.360281    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-token" pod "4e04cfe4-512d-43a4-816f-35e123b876a4" (UID: "4e04cfe4-512d-43a4-816f-35e123b876a4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:20:13.361581 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.361074    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-podinfo" pod "be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" (UID: "be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:20:13.361581 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.361510    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-envoy" pod "be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" (UID: "be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:13.361828 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.361803    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-token" pod "be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" (UID: "be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:20:13.362065 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.362040    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-podinfo" pod "4e04cfe4-512d-43a4-816f-35e123b876a4" (UID: "4e04cfe4-512d-43a4-816f-35e123b876a4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:20:13.362201 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.362170    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-envoy" pod "4e04cfe4-512d-43a4-816f-35e123b876a4" (UID: "4e04cfe4-512d-43a4-816f-35e123b876a4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:13.461785 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.461694    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.461785 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.461745    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.461785 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.461762    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.461785 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.461774    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.461785 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.461786    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e04cfe4-512d-43a4-816f-35e123b876a4-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.462414 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.461798    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.462414 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.461828    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjhnp\" (UniqueName: \"kubernetes.io/projected/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-kube-api-access-jjhnp\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.462414 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.461842    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:13.526266 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.525033    5076 patch_prober.go:29] interesting pod/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:20:13.526266 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.525106    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm" podUID="4e04cfe4-512d-43a4-816f-35e123b876a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:20:13.804922 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:13.804793    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:14.105682 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:14.105640    5076 patch_prober.go:29] interesting pod/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused" start-of-body=
Nov 02 22:20:14.106157 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:14.105703    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt" podUID="7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused"
Nov 02 22:20:14.189251 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:14.188846    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks" event={"ID":"be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa","Type":"ContainerDied","Data":"7a837837b4402e3b782e687e3409c0b3492fe178bdce7d7d64e670512b3f50d0"}
Nov 02 22:20:14.189251 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:14.188917    5076 scope.go:122] "RemoveContainer" containerID="7f0787fd47f984715c9ac6b8412f2072288b54425463d8d816ea844a1d751359"
Nov 02 22:20:14.189251 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:14.189030    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"
Nov 02 22:20:14.211463 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:14.210617    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm" event={"ID":"4e04cfe4-512d-43a4-816f-35e123b876a4","Type":"ContainerDied","Data":"a791d6517f7d299e52ec5caf9b54d20ab146e01a76065de7a23246d4be025d0d"}
Nov 02 22:20:14.211463 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:14.210642    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"
Nov 02 22:20:14.227982 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:14.227951    5076 scope.go:122] "RemoveContainer" containerID="ca321db335e47d049ae3f7708b9254bec5767d976b163b41d253f24b5288f6ad"
Nov 02 22:20:14.239018 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:14.238966    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"]
Nov 02 22:20:14.244992 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:14.244968    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-ktzks"]
Nov 02 22:20:14.257598 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:14.257577    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"]
Nov 02 22:20:14.264492 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:14.264460    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-5f4a2f-openshift-default-9d5fc57c5-m9bgm"]
Nov 02 22:20:15.042430 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:15.042386    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:15.056182 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:15.056155    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0f0bc277-c9d9-4d7f-b8f6-272aafaed134" path="/var/lib/kubelet/pods/0f0bc277-c9d9-4d7f-b8f6-272aafaed134/volumes"
Nov 02 22:20:15.056783 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:15.056761    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3529fe1f-6b60-4755-8dcd-eb2349e8f1d3" path="/var/lib/kubelet/pods/3529fe1f-6b60-4755-8dcd-eb2349e8f1d3/volumes"
Nov 02 22:20:15.057312 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:15.057296    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4e04cfe4-512d-43a4-816f-35e123b876a4" path="/var/lib/kubelet/pods/4e04cfe4-512d-43a4-816f-35e123b876a4/volumes"
Nov 02 22:20:15.072366 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:15.072327    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" path="/var/lib/kubelet/pods/be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa/volumes"
Nov 02 22:20:15.105199 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:15.105165    5076 patch_prober.go:29] interesting pod/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused" start-of-body=
Nov 02 22:20:15.105690 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:15.105656    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt" podUID="7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused"
Nov 02 22:20:15.442106 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:15.442079    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"]
Nov 02 22:20:15.442332 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:15.442290    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf" podUID="057d031c-18be-4ccf-b126-4a67835d3a56" containerName="istio-proxy" containerID="cri-o://39a6f222032d3d5649e98ab5214a30439bf8824ce9a6986386c08a37e2bf8649" gracePeriod=30
Nov 02 22:20:15.515679 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:15.515644    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"]
Nov 02 22:20:15.516183 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:15.515880    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws" podUID="7531eb01-20ab-44cb-866a-8eb290c94383" containerName="istio-proxy" containerID="cri-o://c2639d4ca8b0aab79f118f81cfb793cb9820ca05cecb37a730c0b936f0e527dc" gracePeriod=30
Nov 02 22:20:16.000473 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:16.000425    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:16.109338 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:16.108687    5076 patch_prober.go:29] interesting pod/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused" start-of-body=
Nov 02 22:20:16.109338 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:16.108762    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt" podUID="7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused"
Nov 02 22:20:16.917979 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:16.917515    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:17.016266 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:17.016197    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:17.218793 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:17.218667    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:17.256340 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:17.256305    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:17.257996 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:17.257978    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:17.261539 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:17.261518    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:20:19.357562 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:19.357531    5076 generic.go:356] "Generic (PLEG): container finished" podID="db7c9431-656a-4ff5-9ee6-bbdf456ec5fa" containerID="324dbfef0855bfd9bb9972e75f4e66435ff2e16d73a1a141a87c50ee5b80186e" exitCode=2
Nov 02 22:20:19.357956 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:19.357574    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9" event={"ID":"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa","Type":"ContainerDied","Data":"324dbfef0855bfd9bb9972e75f4e66435ff2e16d73a1a141a87c50ee5b80186e"}
Nov 02 22:20:19.358115 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:19.358098    5076 scope.go:122] "RemoveContainer" containerID="324dbfef0855bfd9bb9972e75f4e66435ff2e16d73a1a141a87c50ee5b80186e"
Nov 02 22:20:19.360073 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:19.360035    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:20:19.360197 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:19.360116    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:20:19.578686 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:19.578653    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:19.683907 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:19.683831    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:20.239445 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:20.238308    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:20:20.373245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:20.371588    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9" event={"ID":"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa","Type":"ContainerStarted","Data":"ed36007005f7d0fd11ef269bb8b9f78542c1ca9f4da017b93f2ca8e083135031"}
Nov 02 22:20:20.373755 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:20.373310    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:20:20.376246 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:20.375995    5076 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-d5mx9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 22:20:20.376246 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:20.376055    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9" podUID="db7c9431-656a-4ff5-9ee6-bbdf456ec5fa" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 22:20:20.390237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:20.388530    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:20.498295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:20.494491    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:20.559528 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:20:20.559488    5076 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-conmon-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache]"
Nov 02 22:20:20.601247 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:20.601168    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:20.735178 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:20.732581    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"]
Nov 02 22:20:20.735178 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:20.732818    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc" podUID="cfdf90d5-cf69-43d7-9109-8920f600f3b2" containerName="istio-proxy" containerID="cri-o://5ac690a076113da0aeda5aee099798f32201935556ee81c08ace55a457f312b2" gracePeriod=30
Nov 02 22:20:20.764521 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:20.764422    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:20.838546 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:20.836988    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"]
Nov 02 22:20:20.838546 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:20.837268    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm" podUID="399e680c-1ff2-487e-867d-50d34732dec7" containerName="istio-proxy" containerID="cri-o://d5c76e755624361dbce49af0c2410e810e0a2b4b9c74ab4ce7e503d3ca9ed689" gracePeriod=30
Nov 02 22:20:20.911496 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:20:20.895084    5076 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-conmon-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache]"
Nov 02 22:20:21.704765 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:21.704730    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:21.705374 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:21.705164    5076 generic.go:356] "Generic (PLEG): container finished" podID="7531eb01-20ab-44cb-866a-8eb290c94383" containerID="c2639d4ca8b0aab79f118f81cfb793cb9820ca05cecb37a730c0b936f0e527dc" exitCode=0
Nov 02 22:20:21.705668 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:21.705266    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws" event={"ID":"7531eb01-20ab-44cb-866a-8eb290c94383","Type":"ContainerDied","Data":"c2639d4ca8b0aab79f118f81cfb793cb9820ca05cecb37a730c0b936f0e527dc"}
Nov 02 22:20:21.707821 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:21.707797    5076 generic.go:356] "Generic (PLEG): container finished" podID="057d031c-18be-4ccf-b126-4a67835d3a56" containerID="39a6f222032d3d5649e98ab5214a30439bf8824ce9a6986386c08a37e2bf8649" exitCode=0
Nov 02 22:20:21.708330 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:21.708298    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf" event={"ID":"057d031c-18be-4ccf-b126-4a67835d3a56","Type":"ContainerDied","Data":"39a6f222032d3d5649e98ab5214a30439bf8824ce9a6986386c08a37e2bf8649"}
Nov 02 22:20:21.736266 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:21.733463    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:20:22.019800 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.019263    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:20:22.180797 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.180747    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/057d031c-18be-4ccf-b126-4a67835d3a56-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/057d031c-18be-4ccf-b126-4a67835d3a56-istiod-ca-cert\") pod \"057d031c-18be-4ccf-b126-4a67835d3a56\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") "
Nov 02 22:20:22.180954 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.180813    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-workload-socket\") pod \"057d031c-18be-4ccf-b126-4a67835d3a56\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") "
Nov 02 22:20:22.180954 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.180926    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-workload-certs\") pod \"057d031c-18be-4ccf-b126-4a67835d3a56\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") "
Nov 02 22:20:22.181036 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.180964    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-credential-socket\") pod \"057d031c-18be-4ccf-b126-4a67835d3a56\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") "
Nov 02 22:20:22.181070 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.181037    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-istio-envoy\") pod \"057d031c-18be-4ccf-b126-4a67835d3a56\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") "
Nov 02 22:20:22.181154 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.181135    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/057d031c-18be-4ccf-b126-4a67835d3a56-istiod-ca-cert" pod "057d031c-18be-4ccf-b126-4a67835d3a56" (UID: "057d031c-18be-4ccf-b126-4a67835d3a56"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:20:22.181207 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.181191    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/057d031c-18be-4ccf-b126-4a67835d3a56-istio-token\" (UniqueName: \"kubernetes.io/projected/057d031c-18be-4ccf-b126-4a67835d3a56-istio-token\") pod \"057d031c-18be-4ccf-b126-4a67835d3a56\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") "
Nov 02 22:20:22.181323 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.181302    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-istio-data\") pod \"057d031c-18be-4ccf-b126-4a67835d3a56\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") "
Nov 02 22:20:22.181397 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.181352    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/057d031c-18be-4ccf-b126-4a67835d3a56-kube-api-access-ggfdc\" (UniqueName: \"kubernetes.io/projected/057d031c-18be-4ccf-b126-4a67835d3a56-kube-api-access-ggfdc\") pod \"057d031c-18be-4ccf-b126-4a67835d3a56\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") "
Nov 02 22:20:22.181464 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.181446    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-workload-certs" pod "057d031c-18be-4ccf-b126-4a67835d3a56" (UID: "057d031c-18be-4ccf-b126-4a67835d3a56"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:22.181505 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.181452    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/057d031c-18be-4ccf-b126-4a67835d3a56-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/057d031c-18be-4ccf-b126-4a67835d3a56-istio-podinfo\") pod \"057d031c-18be-4ccf-b126-4a67835d3a56\" (UID: \"057d031c-18be-4ccf-b126-4a67835d3a56\") "
Nov 02 22:20:22.182492 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.182453    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/057d031c-18be-4ccf-b126-4a67835d3a56-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:22.182492 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.182492    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:22.182729 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.182705    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:20:22.182868 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.182840    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-workload-socket" pod "057d031c-18be-4ccf-b126-4a67835d3a56" (UID: "057d031c-18be-4ccf-b126-4a67835d3a56"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:22.188367 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.183047    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-istio-data" pod "057d031c-18be-4ccf-b126-4a67835d3a56" (UID: "057d031c-18be-4ccf-b126-4a67835d3a56"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:22.188367 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.186699    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/057d031c-18be-4ccf-b126-4a67835d3a56-istio-token" pod "057d031c-18be-4ccf-b126-4a67835d3a56" (UID: "057d031c-18be-4ccf-b126-4a67835d3a56"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:20:22.188367 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.187637    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-istio-envoy" pod "057d031c-18be-4ccf-b126-4a67835d3a56" (UID: "057d031c-18be-4ccf-b126-4a67835d3a56"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:22.188367 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.188355    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/057d031c-18be-4ccf-b126-4a67835d3a56-kube-api-access-ggfdc" pod "057d031c-18be-4ccf-b126-4a67835d3a56" (UID: "057d031c-18be-4ccf-b126-4a67835d3a56"). InnerVolumeSpecName "kube-api-access-ggfdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:20:22.188670 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.188419    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/057d031c-18be-4ccf-b126-4a67835d3a56-istio-podinfo" pod "057d031c-18be-4ccf-b126-4a67835d3a56" (UID: "057d031c-18be-4ccf-b126-4a67835d3a56"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:20:22.188670 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.188639    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-credential-socket" pod "057d031c-18be-4ccf-b126-4a67835d3a56" (UID: "057d031c-18be-4ccf-b126-4a67835d3a56"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:22.284034 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.283946    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-istio-envoy\") pod \"7531eb01-20ab-44cb-866a-8eb290c94383\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") "
Nov 02 22:20:22.284034 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.284008    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-credential-socket\") pod \"7531eb01-20ab-44cb-866a-8eb290c94383\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") "
Nov 02 22:20:22.284280 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.284050    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7531eb01-20ab-44cb-866a-8eb290c94383-kube-api-access-c77bp\" (UniqueName: \"kubernetes.io/projected/7531eb01-20ab-44cb-866a-8eb290c94383-kube-api-access-c77bp\") pod \"7531eb01-20ab-44cb-866a-8eb290c94383\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") "
Nov 02 22:20:22.284280 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.284128    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-workload-certs\") pod \"7531eb01-20ab-44cb-866a-8eb290c94383\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") "
Nov 02 22:20:22.284280 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.284201    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7531eb01-20ab-44cb-866a-8eb290c94383-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7531eb01-20ab-44cb-866a-8eb290c94383-istio-podinfo\") pod \"7531eb01-20ab-44cb-866a-8eb290c94383\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") "
Nov 02 22:20:22.284446 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.284350    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-workload-socket\") pod \"7531eb01-20ab-44cb-866a-8eb290c94383\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") "
Nov 02 22:20:22.284446 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.284406    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7531eb01-20ab-44cb-866a-8eb290c94383-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7531eb01-20ab-44cb-866a-8eb290c94383-istiod-ca-cert\") pod \"7531eb01-20ab-44cb-866a-8eb290c94383\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") "
Nov 02 22:20:22.284577 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.284558    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7531eb01-20ab-44cb-866a-8eb290c94383-istio-token\" (UniqueName: \"kubernetes.io/projected/7531eb01-20ab-44cb-866a-8eb290c94383-istio-token\") pod \"7531eb01-20ab-44cb-866a-8eb290c94383\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") "
Nov 02 22:20:22.284629 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.284606    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-istio-data\") pod \"7531eb01-20ab-44cb-866a-8eb290c94383\" (UID: \"7531eb01-20ab-44cb-866a-8eb290c94383\") "
Nov 02 22:20:22.284988 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.284953    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-workload-certs" pod "7531eb01-20ab-44cb-866a-8eb290c94383" (UID: "7531eb01-20ab-44cb-866a-8eb290c94383"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:22.285346 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.285319    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:22.285483 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.285469    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:22.285574 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.285564    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/057d031c-18be-4ccf-b126-4a67835d3a56-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:22.285659 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.285647    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:22.285762 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.285750    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggfdc\" (UniqueName: \"kubernetes.io/projected/057d031c-18be-4ccf-b126-4a67835d3a56-kube-api-access-ggfdc\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:22.285855 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.285843    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/057d031c-18be-4ccf-b126-4a67835d3a56-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:22.285945 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.285932    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:22.286050 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.286035    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/057d031c-18be-4ccf-b126-4a67835d3a56-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:22.286762 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.286740    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-credential-socket" pod "7531eb01-20ab-44cb-866a-8eb290c94383" (UID: "7531eb01-20ab-44cb-866a-8eb290c94383"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:22.287098 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.287081    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-workload-socket" pod "7531eb01-20ab-44cb-866a-8eb290c94383" (UID: "7531eb01-20ab-44cb-866a-8eb290c94383"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:22.290576 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.290344    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7531eb01-20ab-44cb-866a-8eb290c94383-kube-api-access-c77bp" pod "7531eb01-20ab-44cb-866a-8eb290c94383" (UID: "7531eb01-20ab-44cb-866a-8eb290c94383"). InnerVolumeSpecName "kube-api-access-c77bp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:20:22.291025 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.290798    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7531eb01-20ab-44cb-866a-8eb290c94383-istiod-ca-cert" pod "7531eb01-20ab-44cb-866a-8eb290c94383" (UID: "7531eb01-20ab-44cb-866a-8eb290c94383"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:20:22.296038 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.296010    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-istio-data" pod "7531eb01-20ab-44cb-866a-8eb290c94383" (UID: "7531eb01-20ab-44cb-866a-8eb290c94383"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:22.306403 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.306364    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-istio-envoy" pod "7531eb01-20ab-44cb-866a-8eb290c94383" (UID: "7531eb01-20ab-44cb-866a-8eb290c94383"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:22.306403 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.306387    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7531eb01-20ab-44cb-866a-8eb290c94383-istio-token" pod "7531eb01-20ab-44cb-866a-8eb290c94383" (UID: "7531eb01-20ab-44cb-866a-8eb290c94383"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:20:22.306661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.306630    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7531eb01-20ab-44cb-866a-8eb290c94383-istio-podinfo" pod "7531eb01-20ab-44cb-866a-8eb290c94383" (UID: "7531eb01-20ab-44cb-866a-8eb290c94383"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:20:22.388152 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.387994    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7531eb01-20ab-44cb-866a-8eb290c94383-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:22.388152 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.388032    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:22.388152 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.388046    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:22.388152 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.388061    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:22.388152 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.388075    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c77bp\" (UniqueName: \"kubernetes.io/projected/7531eb01-20ab-44cb-866a-8eb290c94383-kube-api-access-c77bp\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:22.388152 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.388098    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7531eb01-20ab-44cb-866a-8eb290c94383-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:22.388152 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.388111    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7531eb01-20ab-44cb-866a-8eb290c94383-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:22.388152 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.388125    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7531eb01-20ab-44cb-866a-8eb290c94383-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:22.510242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.509769    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:22.781654 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.777890    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf" event={"ID":"057d031c-18be-4ccf-b126-4a67835d3a56","Type":"ContainerDied","Data":"cecbb677ab4e96d5a33b4b8b6a31acfdac1aaa0d407fed3c7e55ef671e4a83a7"}
Nov 02 22:20:22.781654 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.777976    5076 scope.go:122] "RemoveContainer" containerID="39a6f222032d3d5649e98ab5214a30439bf8824ce9a6986386c08a37e2bf8649"
Nov 02 22:20:22.781654 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.778106    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"
Nov 02 22:20:22.788635 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.788616    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"
Nov 02 22:20:22.788785 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.788769    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws" event={"ID":"7531eb01-20ab-44cb-866a-8eb290c94383","Type":"ContainerDied","Data":"50339d156d914da6767bcd1a23da58c03106ec3ad100808e92887165a54086f2"}
Nov 02 22:20:22.823201 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.823172    5076 scope.go:122] "RemoveContainer" containerID="c2639d4ca8b0aab79f118f81cfb793cb9820ca05cecb37a730c0b936f0e527dc"
Nov 02 22:20:22.848613 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.848585    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"]
Nov 02 22:20:22.853545 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.853513    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-jqzws"]
Nov 02 22:20:22.858980 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.858950    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"]
Nov 02 22:20:22.862066 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:22.862045    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-b5wjf"]
Nov 02 22:20:23.055943 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:23.055861    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="057d031c-18be-4ccf-b126-4a67835d3a56" path="/var/lib/kubelet/pods/057d031c-18be-4ccf-b126-4a67835d3a56/volumes"
Nov 02 22:20:23.056549 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:23.056529    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7531eb01-20ab-44cb-866a-8eb290c94383" path="/var/lib/kubelet/pods/7531eb01-20ab-44cb-866a-8eb290c94383/volumes"
Nov 02 22:20:23.461974 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:23.461936    5076 patch_prober.go:29] interesting pod/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 22:20:23.462133 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:23.462002    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm" podUID="399e680c-1ff2-487e-867d-50d34732dec7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 22:20:23.750597 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:23.750515    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:24.577384 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:24.577352    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:25.385213 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:25.385178    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:26.070247 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.069493    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:26.254995 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.254966    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:20:26.282850 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.282784    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-istio-envoy\") pod \"399e680c-1ff2-487e-867d-50d34732dec7\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") "
Nov 02 22:20:26.282850 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.282841    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-workload-socket\") pod \"399e680c-1ff2-487e-867d-50d34732dec7\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") "
Nov 02 22:20:26.283056 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.282878    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/399e680c-1ff2-487e-867d-50d34732dec7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/399e680c-1ff2-487e-867d-50d34732dec7-istio-podinfo\") pod \"399e680c-1ff2-487e-867d-50d34732dec7\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") "
Nov 02 22:20:26.283056 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.282974    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/399e680c-1ff2-487e-867d-50d34732dec7-istio-token\" (UniqueName: \"kubernetes.io/projected/399e680c-1ff2-487e-867d-50d34732dec7-istio-token\") pod \"399e680c-1ff2-487e-867d-50d34732dec7\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") "
Nov 02 22:20:26.283056 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.283003    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-workload-certs\") pod \"399e680c-1ff2-487e-867d-50d34732dec7\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") "
Nov 02 22:20:26.283236 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.283075    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/399e680c-1ff2-487e-867d-50d34732dec7-kube-api-access-gcgcm\" (UniqueName: \"kubernetes.io/projected/399e680c-1ff2-487e-867d-50d34732dec7-kube-api-access-gcgcm\") pod \"399e680c-1ff2-487e-867d-50d34732dec7\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") "
Nov 02 22:20:26.283236 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.283208    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/399e680c-1ff2-487e-867d-50d34732dec7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/399e680c-1ff2-487e-867d-50d34732dec7-istiod-ca-cert\") pod \"399e680c-1ff2-487e-867d-50d34732dec7\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") "
Nov 02 22:20:26.283325 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.283314    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-credential-socket\") pod \"399e680c-1ff2-487e-867d-50d34732dec7\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") "
Nov 02 22:20:26.283405 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.283385    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-istio-data\") pod \"399e680c-1ff2-487e-867d-50d34732dec7\" (UID: \"399e680c-1ff2-487e-867d-50d34732dec7\") "
Nov 02 22:20:26.284288 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.284263    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-istio-data" pod "399e680c-1ff2-487e-867d-50d34732dec7" (UID: "399e680c-1ff2-487e-867d-50d34732dec7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:26.284830 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.284806    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-workload-certs" pod "399e680c-1ff2-487e-867d-50d34732dec7" (UID: "399e680c-1ff2-487e-867d-50d34732dec7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:26.285192 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.285168    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-workload-socket" pod "399e680c-1ff2-487e-867d-50d34732dec7" (UID: "399e680c-1ff2-487e-867d-50d34732dec7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:26.285651 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.285628    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/399e680c-1ff2-487e-867d-50d34732dec7-istiod-ca-cert" pod "399e680c-1ff2-487e-867d-50d34732dec7" (UID: "399e680c-1ff2-487e-867d-50d34732dec7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:20:26.285930 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.285896    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-credential-socket" pod "399e680c-1ff2-487e-867d-50d34732dec7" (UID: "399e680c-1ff2-487e-867d-50d34732dec7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:26.287545 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.287518    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/399e680c-1ff2-487e-867d-50d34732dec7-kube-api-access-gcgcm" pod "399e680c-1ff2-487e-867d-50d34732dec7" (UID: "399e680c-1ff2-487e-867d-50d34732dec7"). InnerVolumeSpecName "kube-api-access-gcgcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:20:26.287781 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.287762    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-istio-envoy" pod "399e680c-1ff2-487e-867d-50d34732dec7" (UID: "399e680c-1ff2-487e-867d-50d34732dec7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:26.288698 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.288669    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/399e680c-1ff2-487e-867d-50d34732dec7-istio-token" pod "399e680c-1ff2-487e-867d-50d34732dec7" (UID: "399e680c-1ff2-487e-867d-50d34732dec7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:20:26.289198 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.289176    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/399e680c-1ff2-487e-867d-50d34732dec7-istio-podinfo" pod "399e680c-1ff2-487e-867d-50d34732dec7" (UID: "399e680c-1ff2-487e-867d-50d34732dec7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:20:26.320238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.320157    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:20:26.394770 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.394134    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istiod-ca-cert\") pod \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") "
Nov 02 22:20:26.394770 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.394283    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-podinfo\") pod \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") "
Nov 02 22:20:26.394770 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.394314    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-token\" (UniqueName: \"kubernetes.io/projected/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-token\") pod \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") "
Nov 02 22:20:26.394770 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.394347    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-credential-socket\") pod \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") "
Nov 02 22:20:26.394770 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.394403    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-workload-certs\") pod \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") "
Nov 02 22:20:26.394770 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.394439    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-data\") pod \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") "
Nov 02 22:20:26.395180 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.395061    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istiod-ca-cert" pod "cfdf90d5-cf69-43d7-9109-8920f600f3b2" (UID: "cfdf90d5-cf69-43d7-9109-8920f600f3b2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:20:26.395366 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.395320    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-credential-socket" pod "cfdf90d5-cf69-43d7-9109-8920f600f3b2" (UID: "cfdf90d5-cf69-43d7-9109-8920f600f3b2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:26.395486 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.395356    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-workload-certs" pod "cfdf90d5-cf69-43d7-9109-8920f600f3b2" (UID: "cfdf90d5-cf69-43d7-9109-8920f600f3b2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:26.396097 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.395604    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-workload-socket\") pod \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") "
Nov 02 22:20:26.396097 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.395662    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-envoy\") pod \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") "
Nov 02 22:20:26.396097 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.395763    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cfdf90d5-cf69-43d7-9109-8920f600f3b2-kube-api-access-df7tn\" (UniqueName: \"kubernetes.io/projected/cfdf90d5-cf69-43d7-9109-8920f600f3b2-kube-api-access-df7tn\") pod \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\" (UID: \"cfdf90d5-cf69-43d7-9109-8920f600f3b2\") "
Nov 02 22:20:26.396309 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.396146    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-workload-socket" pod "cfdf90d5-cf69-43d7-9109-8920f600f3b2" (UID: "cfdf90d5-cf69-43d7-9109-8920f600f3b2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:26.398119 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.396702    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-data" pod "cfdf90d5-cf69-43d7-9109-8920f600f3b2" (UID: "cfdf90d5-cf69-43d7-9109-8920f600f3b2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:26.398721 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.398698    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/399e680c-1ff2-487e-867d-50d34732dec7-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:26.399513 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.398836    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:26.399513 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.398858    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:26.399513 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.398878    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:26.399513 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.398894    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcgcm\" (UniqueName: \"kubernetes.io/projected/399e680c-1ff2-487e-867d-50d34732dec7-kube-api-access-gcgcm\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:26.399513 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.398907    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:26.399513 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.398923    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/399e680c-1ff2-487e-867d-50d34732dec7-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:26.399513 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.398941    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:26.399513 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.398955    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:26.399513 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.398969    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:26.399513 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.398982    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:26.399513 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.399001    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/399e680c-1ff2-487e-867d-50d34732dec7-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:26.399513 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.399016    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/399e680c-1ff2-487e-867d-50d34732dec7-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:26.399513 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.399031    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:26.402571 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.402544    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-podinfo" pod "cfdf90d5-cf69-43d7-9109-8920f600f3b2" (UID: "cfdf90d5-cf69-43d7-9109-8920f600f3b2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:20:26.402711 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.402570    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-token" pod "cfdf90d5-cf69-43d7-9109-8920f600f3b2" (UID: "cfdf90d5-cf69-43d7-9109-8920f600f3b2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:20:26.403561 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.403449    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-envoy" pod "cfdf90d5-cf69-43d7-9109-8920f600f3b2" (UID: "cfdf90d5-cf69-43d7-9109-8920f600f3b2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:20:26.404419 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.404382    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfdf90d5-cf69-43d7-9109-8920f600f3b2-kube-api-access-df7tn" pod "cfdf90d5-cf69-43d7-9109-8920f600f3b2" (UID: "cfdf90d5-cf69-43d7-9109-8920f600f3b2"). InnerVolumeSpecName "kube-api-access-df7tn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:20:26.500718 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.500620    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:26.500718 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.500655    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df7tn\" (UniqueName: \"kubernetes.io/projected/cfdf90d5-cf69-43d7-9109-8920f600f3b2-kube-api-access-df7tn\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:26.500718 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.500670    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:26.500718 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.500682    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfdf90d5-cf69-43d7-9109-8920f600f3b2-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:20:26.815690 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.815606    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:26.828649 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.828620    5076 generic.go:356] "Generic (PLEG): container finished" podID="cfdf90d5-cf69-43d7-9109-8920f600f3b2" containerID="5ac690a076113da0aeda5aee099798f32201935556ee81c08ace55a457f312b2" exitCode=0
Nov 02 22:20:26.828841 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.828698    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc" event={"ID":"cfdf90d5-cf69-43d7-9109-8920f600f3b2","Type":"ContainerDied","Data":"5ac690a076113da0aeda5aee099798f32201935556ee81c08ace55a457f312b2"}
Nov 02 22:20:26.828841 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.828704    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"
Nov 02 22:20:26.828841 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.828780    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc" event={"ID":"cfdf90d5-cf69-43d7-9109-8920f600f3b2","Type":"ContainerDied","Data":"22af357cc9fc11e16439eea413c96ee3de763e2249ca75774f54033bbfa928d5"}
Nov 02 22:20:26.828841 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.828828    5076 scope.go:122] "RemoveContainer" containerID="5ac690a076113da0aeda5aee099798f32201935556ee81c08ace55a457f312b2"
Nov 02 22:20:26.830337 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.830313    5076 generic.go:356] "Generic (PLEG): container finished" podID="399e680c-1ff2-487e-867d-50d34732dec7" containerID="d5c76e755624361dbce49af0c2410e810e0a2b4b9c74ab4ce7e503d3ca9ed689" exitCode=0
Nov 02 22:20:26.830465 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.830372    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"
Nov 02 22:20:26.830465 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.830414    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm" event={"ID":"399e680c-1ff2-487e-867d-50d34732dec7","Type":"ContainerDied","Data":"d5c76e755624361dbce49af0c2410e810e0a2b4b9c74ab4ce7e503d3ca9ed689"}
Nov 02 22:20:26.830549 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.830472    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm" event={"ID":"399e680c-1ff2-487e-867d-50d34732dec7","Type":"ContainerDied","Data":"3d9f08479385c97bfd2972a5c68dc548ec3494555577c8f7e9a7c20d3f098983"}
Nov 02 22:20:26.841150 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.841132    5076 scope.go:122] "RemoveContainer" containerID="5ac690a076113da0aeda5aee099798f32201935556ee81c08ace55a457f312b2"
Nov 02 22:20:26.841413 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:20:26.841395    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ac690a076113da0aeda5aee099798f32201935556ee81c08ace55a457f312b2\": container with ID starting with 5ac690a076113da0aeda5aee099798f32201935556ee81c08ace55a457f312b2 not found: ID does not exist" containerID="5ac690a076113da0aeda5aee099798f32201935556ee81c08ace55a457f312b2"
Nov 02 22:20:26.841496 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.841422    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ac690a076113da0aeda5aee099798f32201935556ee81c08ace55a457f312b2"} err="failed to get container status \"5ac690a076113da0aeda5aee099798f32201935556ee81c08ace55a457f312b2\": rpc error: code = NotFound desc = could not find container \"5ac690a076113da0aeda5aee099798f32201935556ee81c08ace55a457f312b2\": container with ID starting with 5ac690a076113da0aeda5aee099798f32201935556ee81c08ace55a457f312b2 not found: ID does not exist"
Nov 02 22:20:26.841496 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.841443    5076 scope.go:122] "RemoveContainer" containerID="d5c76e755624361dbce49af0c2410e810e0a2b4b9c74ab4ce7e503d3ca9ed689"
Nov 02 22:20:26.851483 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.851469    5076 scope.go:122] "RemoveContainer" containerID="d5c76e755624361dbce49af0c2410e810e0a2b4b9c74ab4ce7e503d3ca9ed689"
Nov 02 22:20:26.851770 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:20:26.851747    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5c76e755624361dbce49af0c2410e810e0a2b4b9c74ab4ce7e503d3ca9ed689\": container with ID starting with d5c76e755624361dbce49af0c2410e810e0a2b4b9c74ab4ce7e503d3ca9ed689 not found: ID does not exist" containerID="d5c76e755624361dbce49af0c2410e810e0a2b4b9c74ab4ce7e503d3ca9ed689"
Nov 02 22:20:26.851833 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.851781    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5c76e755624361dbce49af0c2410e810e0a2b4b9c74ab4ce7e503d3ca9ed689"} err="failed to get container status \"d5c76e755624361dbce49af0c2410e810e0a2b4b9c74ab4ce7e503d3ca9ed689\": rpc error: code = NotFound desc = could not find container \"d5c76e755624361dbce49af0c2410e810e0a2b4b9c74ab4ce7e503d3ca9ed689\": container with ID starting with d5c76e755624361dbce49af0c2410e810e0a2b4b9c74ab4ce7e503d3ca9ed689 not found: ID does not exist"
Nov 02 22:20:26.855144 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.855122    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"]
Nov 02 22:20:26.921300 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.918447    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-8kndc"]
Nov 02 22:20:26.926379 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.926341    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"]
Nov 02 22:20:26.930062 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:26.930037    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-a1d78c-openshift-default-69b647f777-gpnvm"]
Nov 02 22:20:27.055478 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:27.055448    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="399e680c-1ff2-487e-867d-50d34732dec7" path="/var/lib/kubelet/pods/399e680c-1ff2-487e-867d-50d34732dec7/volumes"
Nov 02 22:20:27.055958 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:27.055944    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cfdf90d5-cf69-43d7-9109-8920f600f3b2" path="/var/lib/kubelet/pods/cfdf90d5-cf69-43d7-9109-8920f600f3b2/volumes"
Nov 02 22:20:27.557485 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:27.557440    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:27.662734 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:27.662700    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:28.385883 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:28.385845    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:28.472240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:28.471837    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:28.607349 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:28.607316    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:29.295929 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:29.295895    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:29.889422 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:20:29.889386    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:20:30.051312 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:30.051282    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:30.157964 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:30.157872    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:30.497774 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:30.497686    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:30.647344 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:20:30.647296    5076 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-conmon-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache]"
Nov 02 22:20:30.678093 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:30.678052    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:31.058038 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:31.058001    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:31.877398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:31.877351    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:32.867668 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:32.867632    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:33.565848 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:33.565788    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:33.732238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:33.732009    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:33.826515 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:33.826440    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:34.361239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:34.360068    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:34.679952 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:34.679866    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:34.998677 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:34.998466    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:35.100960 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:35.099958    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:35.594598 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:35.594569    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:35.958727 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:20:35.958692    5076 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-conmon-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache]"
Nov 02 22:20:36.281447 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:36.281362    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:36.616501 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:36.616472    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:36.743535 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:20:36.743497    5076 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-conmon-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache]"
Nov 02 22:20:36.744208 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:20:36.744174    5076 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-conmon-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache]"
Nov 02 22:20:36.929715 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:36.929630    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:37.030275 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:37.030180    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:37.105234 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:37.105186    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:37.523599 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:37.523488    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:37.701010 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:37.700976    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:37.846299 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:37.838841    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:38.404769 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:38.404730    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:39.071377 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:39.071344    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:39.854071 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:39.854031    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:40.553718 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:40.553672    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:40.677401 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:20:40.677356    5076 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-conmon-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache]"
Nov 02 22:20:40.781229 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:40.781178    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:40.886051 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:40.886017    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:41.596835 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:41.596794    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:42.026004 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:42.025973    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:42.123605 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:42.123525    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:42.500760 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:42.500733    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:43.443815 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:43.443777    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:44.181758 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:44.181721    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:44.810182 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:44.810147    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:45.439022 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:45.438980    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:46.127610 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.127580    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"]
Nov 02 22:20:46.128378 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128356    5076 cpu_manager.go:414] "containerMap: removing container" podUID="cfdf90d5-cf69-43d7-9109-8920f600f3b2" containerName="istio-proxy"
Nov 02 22:20:46.128497 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128378    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cfdf90d5-cf69-43d7-9109-8920f600f3b2" containerName="istio-proxy"
Nov 02 22:20:46.128497 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128405    5076 cpu_manager.go:414] "containerMap: removing container" podUID="4e04cfe4-512d-43a4-816f-35e123b876a4" containerName="istio-proxy"
Nov 02 22:20:46.128497 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128413    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4e04cfe4-512d-43a4-816f-35e123b876a4" containerName="istio-proxy"
Nov 02 22:20:46.128497 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128449    5076 cpu_manager.go:414] "containerMap: removing container" podUID="7531eb01-20ab-44cb-866a-8eb290c94383" containerName="istio-proxy"
Nov 02 22:20:46.128497 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128457    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7531eb01-20ab-44cb-866a-8eb290c94383" containerName="istio-proxy"
Nov 02 22:20:46.128497 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128469    5076 cpu_manager.go:414] "containerMap: removing container" podUID="057d031c-18be-4ccf-b126-4a67835d3a56" containerName="istio-proxy"
Nov 02 22:20:46.128497 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128475    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="057d031c-18be-4ccf-b126-4a67835d3a56" containerName="istio-proxy"
Nov 02 22:20:46.128497 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128487    5076 cpu_manager.go:414] "containerMap: removing container" podUID="0f0bc277-c9d9-4d7f-b8f6-272aafaed134" containerName="istio-proxy"
Nov 02 22:20:46.128497 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128494    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0f0bc277-c9d9-4d7f-b8f6-272aafaed134" containerName="istio-proxy"
Nov 02 22:20:46.128939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128506    5076 cpu_manager.go:414] "containerMap: removing container" podUID="be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" containerName="istio-proxy"
Nov 02 22:20:46.128939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128514    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" containerName="istio-proxy"
Nov 02 22:20:46.128939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128525    5076 cpu_manager.go:414] "containerMap: removing container" podUID="399e680c-1ff2-487e-867d-50d34732dec7" containerName="istio-proxy"
Nov 02 22:20:46.128939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128534    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="399e680c-1ff2-487e-867d-50d34732dec7" containerName="istio-proxy"
Nov 02 22:20:46.128939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128545    5076 cpu_manager.go:414] "containerMap: removing container" podUID="3529fe1f-6b60-4755-8dcd-eb2349e8f1d3" containerName="maas-api"
Nov 02 22:20:46.128939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128554    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3529fe1f-6b60-4755-8dcd-eb2349e8f1d3" containerName="maas-api"
Nov 02 22:20:46.128939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128717    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="0f0bc277-c9d9-4d7f-b8f6-272aafaed134" containerName="istio-proxy"
Nov 02 22:20:46.128939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128731    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="be4b4d0f-bfd1-48f0-ab40-0c3304cb01aa" containerName="istio-proxy"
Nov 02 22:20:46.128939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128743    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="399e680c-1ff2-487e-867d-50d34732dec7" containerName="istio-proxy"
Nov 02 22:20:46.128939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128753    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="3529fe1f-6b60-4755-8dcd-eb2349e8f1d3" containerName="maas-api"
Nov 02 22:20:46.128939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128767    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="cfdf90d5-cf69-43d7-9109-8920f600f3b2" containerName="istio-proxy"
Nov 02 22:20:46.128939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128780    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="4e04cfe4-512d-43a4-816f-35e123b876a4" containerName="istio-proxy"
Nov 02 22:20:46.128939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128793    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="7531eb01-20ab-44cb-866a-8eb290c94383" containerName="istio-proxy"
Nov 02 22:20:46.128939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.128802    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="057d031c-18be-4ccf-b126-4a67835d3a56" containerName="istio-proxy"
Nov 02 22:20:46.133086 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.133066    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"
Nov 02 22:20:46.140358 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.140333    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"]
Nov 02 22:20:46.141314 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.141288    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-d28bd1-serving-cert\""
Nov 02 22:20:46.179491 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.179466    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:46.202605 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.202579    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-maas-api-tls\") pod \"maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd\" (UID: \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"
Nov 02 22:20:46.202743 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.202647    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g5kd\" (UniqueName: \"kubernetes.io/projected/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-kube-api-access-9g5kd\") pod \"maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd\" (UID: \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"
Nov 02 22:20:46.202792 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.202744    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd\" (UID: \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"
Nov 02 22:20:46.202835 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.202806    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-metrics-certs\") pod \"maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd\" (UID: \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"
Nov 02 22:20:46.289138 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.283664    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:46.317310 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.312285    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-maas-api-tls\") pod \"maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd\" (UID: \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"
Nov 02 22:20:46.317310 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.312384    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g5kd\" (UniqueName: \"kubernetes.io/projected/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-kube-api-access-9g5kd\") pod \"maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd\" (UID: \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"
Nov 02 22:20:46.317310 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.312460    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd\" (UID: \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"
Nov 02 22:20:46.317310 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.312549    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-metrics-certs\") pod \"maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd\" (UID: \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"
Nov 02 22:20:46.317310 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:20:46.313646    5076 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-serving-cert: secret "maas-api-e2e-inf-a-d28bd1-serving-cert" not found
Nov 02 22:20:46.317310 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:20:46.313712    5076 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-maas-api-tls podName:6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476 nodeName:}" failed. No retries permitted until 2026-11-02 22:20:46.813691976 +0000 UTC m=+1355.870026359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-maas-api-tls") pod "maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd" (UID: "6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476") : secret "maas-api-e2e-inf-a-d28bd1-serving-cert" not found
Nov 02 22:20:46.324479 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.324446    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-metrics-certs\") pod \"maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd\" (UID: \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"
Nov 02 22:20:46.330529 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.330490    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd\" (UID: \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"
Nov 02 22:20:46.335815 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.335789    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g5kd\" (UniqueName: \"kubernetes.io/projected/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-kube-api-access-9g5kd\") pod \"maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd\" (UID: \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"
Nov 02 22:20:46.381326 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.378472    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:46.583787 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.583749    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:46.829342 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.829255    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-maas-api-tls\") pod \"maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd\" (UID: \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"
Nov 02 22:20:46.835264 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:46.832518    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-maas-api-tls\") pod \"maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd\" (UID: \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"
Nov 02 22:20:47.059126 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.059095    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"
Nov 02 22:20:47.104244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.104002    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:47.363277 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:20:47.363246    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7ed6f8_f0de_48d6_9172_a0cdb3bc0476.slice/crio-a47d49411b2640846f03f577865268029367285e4a1e9d2695094627ad30ab66 WatchSource:0}: Error finding container a47d49411b2640846f03f577865268029367285e4a1e9d2695094627ad30ab66: Status 404 returned error can't find the container with id a47d49411b2640846f03f577865268029367285e4a1e9d2695094627ad30ab66
Nov 02 22:20:47.364526 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.364495    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"]
Nov 02 22:20:47.583277 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.578365    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"]
Nov 02 22:20:47.587111 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.586277    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:47.588531 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.588499    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"]
Nov 02 22:20:47.593925 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.593906    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-419f68\"/\"openshift-service-ca.crt\""
Nov 02 22:20:47.594157 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.594134    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-419f68\"/\"kube-root-ca.crt\""
Nov 02 22:20:47.594320 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.594250    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-419f68\"/\"test-model-419f68-kserve-self-signed-certs\""
Nov 02 22:20:47.594478 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.594460    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-419f68\"/\"default-dockercfg-c4r8f\""
Nov 02 22:20:47.614727 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.614653    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:47.673894 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.673853    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-dshm\") pod \"test-model-419f68-kserve-686bbc4695-w8mtk\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") " pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:47.674088 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.674011    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39e7bfaa-9013-4559-9e7e-d985fd896011-tls-certs\") pod \"test-model-419f68-kserve-686bbc4695-w8mtk\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") " pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:47.674088 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.674080    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-home\") pod \"test-model-419f68-kserve-686bbc4695-w8mtk\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") " pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:47.674232 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.674128    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-model-cache\") pod \"test-model-419f68-kserve-686bbc4695-w8mtk\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") " pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:47.674297 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.674282    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stfnp\" (UniqueName: \"kubernetes.io/projected/39e7bfaa-9013-4559-9e7e-d985fd896011-kube-api-access-stfnp\") pod \"test-model-419f68-kserve-686bbc4695-w8mtk\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") " pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:47.674354 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.674316    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-tmp-dir\") pod \"test-model-419f68-kserve-686bbc4695-w8mtk\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") " pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:47.787248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.777125    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39e7bfaa-9013-4559-9e7e-d985fd896011-tls-certs\") pod \"test-model-419f68-kserve-686bbc4695-w8mtk\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") " pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:47.787248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.777292    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-home\") pod \"test-model-419f68-kserve-686bbc4695-w8mtk\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") " pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:47.787248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.777361    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-model-cache\") pod \"test-model-419f68-kserve-686bbc4695-w8mtk\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") " pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:47.787248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.777424    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stfnp\" (UniqueName: \"kubernetes.io/projected/39e7bfaa-9013-4559-9e7e-d985fd896011-kube-api-access-stfnp\") pod \"test-model-419f68-kserve-686bbc4695-w8mtk\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") " pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:47.787248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.777460    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-tmp-dir\") pod \"test-model-419f68-kserve-686bbc4695-w8mtk\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") " pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:47.787248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.777552    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-dshm\") pod \"test-model-419f68-kserve-686bbc4695-w8mtk\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") " pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:47.787248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.781371    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-model-cache\") pod \"test-model-419f68-kserve-686bbc4695-w8mtk\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") " pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:47.787248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.781657    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-tmp-dir\") pod \"test-model-419f68-kserve-686bbc4695-w8mtk\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") " pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:47.787248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.782028    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-home\") pod \"test-model-419f68-kserve-686bbc4695-w8mtk\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") " pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:47.834853 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.834026    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-dshm\") pod \"test-model-419f68-kserve-686bbc4695-w8mtk\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") " pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:47.834853 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.834353    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39e7bfaa-9013-4559-9e7e-d985fd896011-tls-certs\") pod \"test-model-419f68-kserve-686bbc4695-w8mtk\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") " pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:47.890284 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.881927    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stfnp\" (UniqueName: \"kubernetes.io/projected/39e7bfaa-9013-4559-9e7e-d985fd896011-kube-api-access-stfnp\") pod \"test-model-419f68-kserve-686bbc4695-w8mtk\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") " pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:47.911560 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:47.907081    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:48.054818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:48.054046    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd" event={"ID":"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476","Type":"ContainerStarted","Data":"1985a17850d5bbac9d3a79eae150856ab110ec278a32020e5122346a8e0fd4c4"}
Nov 02 22:20:48.054818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:48.054100    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd" event={"ID":"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476","Type":"ContainerStarted","Data":"a47d49411b2640846f03f577865268029367285e4a1e9d2695094627ad30ab66"}
Nov 02 22:20:48.054818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:48.054639    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"
Nov 02 22:20:48.069002 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:48.068885    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:48.079518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:48.079468    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd" podStartSLOduration=1.541624455 podStartE2EDuration="2.079451091s" totalImagesPullingTime="537.826636ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:20:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:20:48.076440932 +0000 UTC m=+1357.132775313" watchObservedRunningTime="2026-11-02 22:20:48.079451091 +0000 UTC m=+1357.135785471"
Nov 02 22:20:48.263114 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:48.263055    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"]
Nov 02 22:20:48.928131 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:48.928095    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:49.068442 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:49.068409    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk" event={"ID":"39e7bfaa-9013-4559-9e7e-d985fd896011","Type":"ContainerStarted","Data":"bede950de728f92d47d1b1e111455ed33843247f364e18733791d4555de6ea1e"}
Nov 02 22:20:49.068626 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:49.068451    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk" event={"ID":"39e7bfaa-9013-4559-9e7e-d985fd896011","Type":"ContainerStarted","Data":"84c20081b41474243e9c48f1da3d485f7733f4fb611fcf47cbaabac2c2b8bc44"}
Nov 02 22:20:49.581850 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:49.581810    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:49.911795 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:49.911765    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:50.272684 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:50.272602    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:50.758139 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:20:50.758100    5076 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-conmon-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache]"
Nov 02 22:20:50.889254 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:20:50.889199    5076 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-conmon-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache]"
Nov 02 22:20:51.082975 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:51.082853    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:51.781539 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:51.781509    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:52.499391 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:52.499354    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:53.206186 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:53.206099    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:53.849555 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:53.849492    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk" podStartSLOduration=6.849470862 podStartE2EDuration="6.849470862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:20:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:20:49.087388377 +0000 UTC m=+1358.143722768" watchObservedRunningTime="2026-11-02 22:20:53.849470862 +0000 UTC m=+1362.905805246"
Nov 02 22:20:53.852411 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:53.852373    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"]
Nov 02 22:20:53.862735 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:53.862707    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"
Nov 02 22:20:53.867154 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:53.867123    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-a621f1-serving-cert\""
Nov 02 22:20:53.868192 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:53.868165    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"]
Nov 02 22:20:53.889450 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:53.889412    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:53.988939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:53.988908    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:53.995498 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:53.995467    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b57e9830-dbca-4612-b162-f7dbfafe7d3a-maas-api-tls\") pod \"maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj\" (UID: \"b57e9830-dbca-4612-b162-f7dbfafe7d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"
Nov 02 22:20:53.995625 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:53.995503    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9r4v\" (UniqueName: \"kubernetes.io/projected/b57e9830-dbca-4612-b162-f7dbfafe7d3a-kube-api-access-f9r4v\") pod \"maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj\" (UID: \"b57e9830-dbca-4612-b162-f7dbfafe7d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"
Nov 02 22:20:53.995625 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:53.995539    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b57e9830-dbca-4612-b162-f7dbfafe7d3a-metrics-certs\") pod \"maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj\" (UID: \"b57e9830-dbca-4612-b162-f7dbfafe7d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"
Nov 02 22:20:53.995775 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:53.995755    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b57e9830-dbca-4612-b162-f7dbfafe7d3a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj\" (UID: \"b57e9830-dbca-4612-b162-f7dbfafe7d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"
Nov 02 22:20:54.098081 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:54.097666    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:54.098783 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:54.098737    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b57e9830-dbca-4612-b162-f7dbfafe7d3a-metrics-certs\") pod \"maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj\" (UID: \"b57e9830-dbca-4612-b162-f7dbfafe7d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"
Nov 02 22:20:54.099008 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:54.098985    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b57e9830-dbca-4612-b162-f7dbfafe7d3a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj\" (UID: \"b57e9830-dbca-4612-b162-f7dbfafe7d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"
Nov 02 22:20:54.124068 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:54.124035    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b57e9830-dbca-4612-b162-f7dbfafe7d3a-maas-api-tls\") pod \"maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj\" (UID: \"b57e9830-dbca-4612-b162-f7dbfafe7d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"
Nov 02 22:20:54.130712 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:54.129965    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9r4v\" (UniqueName: \"kubernetes.io/projected/b57e9830-dbca-4612-b162-f7dbfafe7d3a-kube-api-access-f9r4v\") pod \"maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj\" (UID: \"b57e9830-dbca-4612-b162-f7dbfafe7d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"
Nov 02 22:20:54.130712 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:54.102425    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b57e9830-dbca-4612-b162-f7dbfafe7d3a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj\" (UID: \"b57e9830-dbca-4612-b162-f7dbfafe7d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"
Nov 02 22:20:54.130712 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:54.130636    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"
Nov 02 22:20:54.134494 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:54.134469    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b57e9830-dbca-4612-b162-f7dbfafe7d3a-maas-api-tls\") pod \"maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj\" (UID: \"b57e9830-dbca-4612-b162-f7dbfafe7d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"
Nov 02 22:20:54.137727 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:54.137700    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b57e9830-dbca-4612-b162-f7dbfafe7d3a-metrics-certs\") pod \"maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj\" (UID: \"b57e9830-dbca-4612-b162-f7dbfafe7d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"
Nov 02 22:20:54.141997 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:54.141969    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9r4v\" (UniqueName: \"kubernetes.io/projected/b57e9830-dbca-4612-b162-f7dbfafe7d3a-kube-api-access-f9r4v\") pod \"maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj\" (UID: \"b57e9830-dbca-4612-b162-f7dbfafe7d3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"
Nov 02 22:20:54.191158 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:54.191118    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"
Nov 02 22:20:54.565315 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:54.565289    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"]
Nov 02 22:20:54.782424 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:54.782395    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:55.145021 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:55.144988    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj" event={"ID":"b57e9830-dbca-4612-b162-f7dbfafe7d3a","Type":"ContainerStarted","Data":"5475c3c79b27796f1eefa1d1051bf8e3342e21cd934d8250a31b50505194ac45"}
Nov 02 22:20:55.145203 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:55.145055    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj" event={"ID":"b57e9830-dbca-4612-b162-f7dbfafe7d3a","Type":"ContainerStarted","Data":"f2331def3d1dba7b67294e63137b6765c666e31a39a251c46fec3fd6497e5a13"}
Nov 02 22:20:55.145203 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:55.145085    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"
Nov 02 22:20:55.166976 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:55.166931    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj" podStartSLOduration=1.707002873 podStartE2EDuration="2.166895379s" totalImagesPullingTime="459.892506ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:20:55.160854824 +0000 UTC m=+1364.217189206" watchObservedRunningTime="2026-11-02 22:20:55.166895379 +0000 UTC m=+1364.223229759"
Nov 02 22:20:55.569187 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:55.569143    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:56.429911 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:56.429871    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:57.584241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:57.581274    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:57.915728 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:57.915702    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:57.934447 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:57.934419    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:58.220434 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:58.220353    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:20:58.670241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:58.668951    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:58.752141 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:58.752065    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:59.499707 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:20:59.499667    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:20:59.892361 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:20:59.892321    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:21:00.194843 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:00.194750    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:00.832632 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:21:00.832591    5076 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-conmon-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache]"
Nov 02 22:21:00.862806 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:00.862764    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:01.198376 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:01.198344    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"
Nov 02 22:21:01.598731 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:01.598654    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:02.460569 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:02.460531    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:03.180859 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:03.180819    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:03.773646 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:03.773609    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:04.024815 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:04.024739    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:04.421493 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:04.421458    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:04.527408 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:04.526681    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:04.869786 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:04.869757    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:05.106576 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:05.106466    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:05.391026 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:05.390988    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:05.962600 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:21:05.962558    5076 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-conmon-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache]"
Nov 02 22:21:06.073767 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.073723    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:06.712263 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.709345    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"]
Nov 02 22:21:06.712645 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.712616    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:06.715560 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.715526    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.726389 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.726305    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"]
Nov 02 22:21:06.831925 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.831888    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-e49edd-openshift-default-dockercfg-qk94g\""
Nov 02 22:21:06.832971 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.832936    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-token\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.833185 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.833168    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-workload-socket\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.833332 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.833316    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-envoy\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.833470 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.833455    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-workload-certs\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.833588 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.833573    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-data\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.833695 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.833682    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-podinfo\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.833891 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.833876    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35ee896c-9d7e-4b87-aaf7-c000622f208e-istiod-ca-cert\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.834041 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.834025    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftfln\" (UniqueName: \"kubernetes.io/projected/35ee896c-9d7e-4b87-aaf7-c000622f208e-kube-api-access-ftfln\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.834287 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.834266    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-credential-socket\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.935643 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.935611    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftfln\" (UniqueName: \"kubernetes.io/projected/35ee896c-9d7e-4b87-aaf7-c000622f208e-kube-api-access-ftfln\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.935806 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.935683    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-credential-socket\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.935844 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.935819    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-token\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.935884 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.935854    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-workload-socket\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.935918 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.935900    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-envoy\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.935950 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.935932    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-workload-certs\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.936018 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.935975    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-data\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.936105 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.936051    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-podinfo\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.936183 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.936158    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-credential-socket\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.936183 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.936176    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-workload-socket\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.936329 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.936199    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35ee896c-9d7e-4b87-aaf7-c000622f208e-istiod-ca-cert\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.936415 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.936388    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-workload-certs\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.936593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.936569    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-data\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.937003 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.936979    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35ee896c-9d7e-4b87-aaf7-c000622f208e-istiod-ca-cert\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.938307 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.938281    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-envoy\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.938626 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.938610    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-podinfo\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.943190 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.943161    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-token\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:06.943336 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:06.943282    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftfln\" (UniqueName: \"kubernetes.io/projected/35ee896c-9d7e-4b87-aaf7-c000622f208e-kube-api-access-ftfln\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:07.075448 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:07.075371    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:07.365089 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:07.365057    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"]
Nov 02 22:21:07.368749 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:21:07.368717    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35ee896c_9d7e_4b87_aaf7_c000622f208e.slice/crio-2254f5288f27844eed55f5f3b538c98daec97bffb97d3759169450a31fdf6c33 WatchSource:0}: Error finding container 2254f5288f27844eed55f5f3b538c98daec97bffb97d3759169450a31fdf6c33: Status 404 returned error can't find the container with id 2254f5288f27844eed55f5f3b538c98daec97bffb97d3759169450a31fdf6c33
Nov 02 22:21:07.372584 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:07.372546    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:21:07.372702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:07.372632    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:21:07.372702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:07.372682    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:21:07.411176 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:07.411137    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:08.327973 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:08.327927    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v" event={"ID":"35ee896c-9d7e-4b87-aaf7-c000622f208e","Type":"ContainerStarted","Data":"7d983c87ec5c15a8cb437d24a297d67b255a033d1f376539e0eaaabb64877aa9"}
Nov 02 22:21:08.328479 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:08.328033    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v" event={"ID":"35ee896c-9d7e-4b87-aaf7-c000622f208e","Type":"ContainerStarted","Data":"2254f5288f27844eed55f5f3b538c98daec97bffb97d3759169450a31fdf6c33"}
Nov 02 22:21:08.348595 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:08.348538    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v" podStartSLOduration=2.3485256039999998 podStartE2EDuration="2.348525604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:21:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:21:08.345929595 +0000 UTC m=+1377.402263977" watchObservedRunningTime="2026-11-02 22:21:08.348525604 +0000 UTC m=+1377.404859984"
Nov 02 22:21:08.454244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:08.454194    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:08.897904 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:08.897866    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:08.995829 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:08.995792    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:09.091239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:09.089518    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:09.094154 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:09.094113    5076 patch_prober.go:29] interesting pod/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Nov 02 22:21:09.094395 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:09.094355    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v" podUID="35ee896c-9d7e-4b87-aaf7-c000622f208e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Nov 02 22:21:09.407790 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:09.407759    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:10.077701 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:10.077662    5076 patch_prober.go:29] interesting pod/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Nov 02 22:21:10.077974 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:10.077946    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v" podUID="35ee896c-9d7e-4b87-aaf7-c000622f208e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Nov 02 22:21:10.118942 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:10.118901    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:10.247238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:10.221875    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:10.340062 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:10.339852    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:10.848963 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:21:10.848921    5076 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-conmon-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529fe1f_6b60_4755_8dcd_eb2349e8f1d3.slice/crio-237831189b275bc8e1357aba8b7ffc81246baba7541b06573e6f97512ec405bf.scope\": RecentStats: unable to find data in memory cache]"
Nov 02 22:21:11.090240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:11.089787    5076 patch_prober.go:29] interesting pod/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Nov 02 22:21:11.090240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:11.089846    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v" podUID="35ee896c-9d7e-4b87-aaf7-c000622f208e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Nov 02 22:21:11.133880 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:11.133845    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:11.550173 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:11.550073    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:12.088242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:12.083525    5076 scope.go:122] "RemoveContainer" containerID="757e7986585b3278be4fc8c4b464c492811b5c5f854a5ba3b90b0e41c45307e8"
Nov 02 22:21:12.097239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:12.092337    5076 patch_prober.go:29] interesting pod/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Nov 02 22:21:12.097239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:12.092397    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v" podUID="35ee896c-9d7e-4b87-aaf7-c000622f208e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Nov 02 22:21:12.387889 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:12.387850    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:12.487419 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:12.487387    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:13.084342 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:13.077682    5076 patch_prober.go:29] interesting pod/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Nov 02 22:21:13.084342 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:13.077756    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v" podUID="35ee896c-9d7e-4b87-aaf7-c000622f208e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Nov 02 22:21:13.310092 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:13.310044    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:14.080756 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:14.080727    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:14.081147 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:14.081130    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:14.081884 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:14.081864    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:21:14.105810 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:14.105778    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:14.899663 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:14.899628    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:15.671100 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:15.671071    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:16.264548 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:16.264513    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:16.900813 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:16.900777    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:17.563681 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:17.563649    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:18.183446 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:18.183402    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:18.274826 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:18.274794    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:19.044421 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:19.044384    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:19.985938 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:19.985886    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:20.713982 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:20.713943    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:21.380975 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:21.380930    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:22.147142 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:22.147107    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:22.673549 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:22.673509    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:23.342261 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:23.342193    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"]
Nov 02 22:21:23.360362 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:23.360326    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"]
Nov 02 22:21:23.360716 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:23.360692    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"
Nov 02 22:21:23.378301 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:23.376422    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-5eba37-serving-cert\""
Nov 02 22:21:23.396592 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:23.395191    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:23.517647 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:23.517603    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5eba37-f467b859d-nckxs\" (UID: \"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"
Nov 02 22:21:23.566849 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:23.556331    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-metrics-certs\") pod \"maas-api-e2e-inf-b-5eba37-f467b859d-nckxs\" (UID: \"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"
Nov 02 22:21:23.566849 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:23.556560    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m948m\" (UniqueName: \"kubernetes.io/projected/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-kube-api-access-m948m\") pod \"maas-api-e2e-inf-b-5eba37-f467b859d-nckxs\" (UID: \"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"
Nov 02 22:21:23.566849 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:23.556603    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-maas-api-tls\") pod \"maas-api-e2e-inf-b-5eba37-f467b859d-nckxs\" (UID: \"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"
Nov 02 22:21:23.566849 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:23.530635    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:23.642702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:23.642669    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:23.659364 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:23.659328    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m948m\" (UniqueName: \"kubernetes.io/projected/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-kube-api-access-m948m\") pod \"maas-api-e2e-inf-b-5eba37-f467b859d-nckxs\" (UID: \"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"
Nov 02 22:21:23.659649 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:23.659621    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-maas-api-tls\") pod \"maas-api-e2e-inf-b-5eba37-f467b859d-nckxs\" (UID: \"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"
Nov 02 22:21:23.660119 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:23.660093    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5eba37-f467b859d-nckxs\" (UID: \"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"
Nov 02 22:21:23.660286 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:23.660270    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-metrics-certs\") pod \"maas-api-e2e-inf-b-5eba37-f467b859d-nckxs\" (UID: \"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"
Nov 02 22:21:23.662329 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:23.662308    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5eba37-f467b859d-nckxs\" (UID: \"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"
Nov 02 22:21:23.673820 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:23.673791    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-maas-api-tls\") pod \"maas-api-e2e-inf-b-5eba37-f467b859d-nckxs\" (UID: \"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"
Nov 02 22:21:23.692482 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:23.674494    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-metrics-certs\") pod \"maas-api-e2e-inf-b-5eba37-f467b859d-nckxs\" (UID: \"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"
Nov 02 22:21:23.702675 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:23.700393    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m948m\" (UniqueName: \"kubernetes.io/projected/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-kube-api-access-m948m\") pod \"maas-api-e2e-inf-b-5eba37-f467b859d-nckxs\" (UID: \"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"
Nov 02 22:21:23.702675 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:23.702147    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"
Nov 02 22:21:24.059091 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:24.059033    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"]
Nov 02 22:21:24.065237 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:21:24.060279    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc90a5e2d_6ada_450f_b930_5ba0fe60b1c5.slice/crio-753d723ba668ebd06098c996a38bf43876f0ee2cf1d94ea42f4fe9e1ee10f4c2 WatchSource:0}: Error finding container 753d723ba668ebd06098c996a38bf43876f0ee2cf1d94ea42f4fe9e1ee10f4c2: Status 404 returned error can't find the container with id 753d723ba668ebd06098c996a38bf43876f0ee2cf1d94ea42f4fe9e1ee10f4c2
Nov 02 22:21:24.596931 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:24.596898    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:24.737123 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:24.737090    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs" event={"ID":"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5","Type":"ContainerStarted","Data":"753d723ba668ebd06098c996a38bf43876f0ee2cf1d94ea42f4fe9e1ee10f4c2"}
Nov 02 22:21:25.750242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:25.749682    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs" event={"ID":"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5","Type":"ContainerStarted","Data":"06136650ab36061b4e11860c884f0c59e9dafdb73d8f6d20e753dc6a39bef76c"}
Nov 02 22:21:25.750242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:25.749762    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"
Nov 02 22:21:25.770955 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:25.770892    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs" podStartSLOduration=2.133313673 podStartE2EDuration="2.770872171s" totalImagesPullingTime="637.558498ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:21:25.766493935 +0000 UTC m=+1394.822828315" watchObservedRunningTime="2026-11-02 22:21:25.770872171 +0000 UTC m=+1394.827206555"
Nov 02 22:21:25.778644 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:25.778610    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:26.671526 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:26.671486    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:27.458022 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:27.457988    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:28.249238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:28.249090    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:29.296842 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:29.296632    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:29.895421 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:21:29.895362    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:21:29.975172 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:29.975132    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:30.998367 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:30.998336    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:31.608439 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:31.608397    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:31.793349 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:31.793319    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"
Nov 02 22:21:32.382356 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:32.382320    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:32.991503 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:32.991470    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:33.663590 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:33.663555    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:34.271143 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:34.271115    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:34.501543 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:34.501510    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:34.898269 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:34.898200    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:35.584885 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:35.584852    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:36.199335 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.199303    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:36.766485 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.766451    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"]
Nov 02 22:21:36.772446 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.772419    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.795715 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.795685    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"]
Nov 02 22:21:36.800363 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.799571    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9896887-2ff5-4567-a650-6de8c5f25135-istio-token\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.800363 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.799627    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9896887-2ff5-4567-a650-6de8c5f25135-istio-podinfo\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.800363 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.799705    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-workload-socket\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.800363 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.799721    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-istio-envoy\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.800363 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.799745    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9896887-2ff5-4567-a650-6de8c5f25135-istiod-ca-cert\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.800363 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.799791    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlsl6\" (UniqueName: \"kubernetes.io/projected/c9896887-2ff5-4567-a650-6de8c5f25135-kube-api-access-zlsl6\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.800363 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.799845    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-workload-certs\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.800363 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.799892    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-istio-data\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.800363 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.799910    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-credential-socket\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.830930 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.830895    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:36.914818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.910352    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-istio-data\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.914818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.910413    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-credential-socket\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.914818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.910512    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9896887-2ff5-4567-a650-6de8c5f25135-istio-token\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.914818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.910584    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9896887-2ff5-4567-a650-6de8c5f25135-istio-podinfo\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.914818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.910711    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-workload-socket\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.914818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.910742    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-istio-envoy\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.914818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.910831    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9896887-2ff5-4567-a650-6de8c5f25135-istiod-ca-cert\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.914818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.910967    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlsl6\" (UniqueName: \"kubernetes.io/projected/c9896887-2ff5-4567-a650-6de8c5f25135-kube-api-access-zlsl6\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.914818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.911050    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-workload-certs\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.919859 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.919385    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-istio-data\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.920295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.920273    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-credential-socket\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.938360 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.921094    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9896887-2ff5-4567-a650-6de8c5f25135-istiod-ca-cert\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.938655 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.924510    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-workload-socket\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.939488 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.939457    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-workload-certs\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.944814 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.944784    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9896887-2ff5-4567-a650-6de8c5f25135-istio-token\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.948755 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.948702    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-istio-envoy\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.958561 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.949404    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9896887-2ff5-4567-a650-6de8c5f25135-istio-podinfo\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:36.960980 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:36.960931    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlsl6\" (UniqueName: \"kubernetes.io/projected/c9896887-2ff5-4567-a650-6de8c5f25135-kube-api-access-zlsl6\") pod \"e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") " pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:37.103603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:37.103574    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:37.388018 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:37.387985    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"]
Nov 02 22:21:37.388782 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:21:37.388757    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9896887_2ff5_4567_a650_6de8c5f25135.slice/crio-06e0d28a48ade01678a5fef6c397e183b6d886bc5efcc1955617e3b2a5543cf0 WatchSource:0}: Error finding container 06e0d28a48ade01678a5fef6c397e183b6d886bc5efcc1955617e3b2a5543cf0: Status 404 returned error can't find the container with id 06e0d28a48ade01678a5fef6c397e183b6d886bc5efcc1955617e3b2a5543cf0
Nov 02 22:21:37.396677 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:37.396638    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:21:37.396782 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:37.396715    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:21:37.396782 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:37.396748    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:21:37.511285 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:37.511211    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:37.940922 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:37.940891    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm" event={"ID":"c9896887-2ff5-4567-a650-6de8c5f25135","Type":"ContainerStarted","Data":"9a8a06493d2df85184c08c830ed49d4e0e35f8a02781406db93779584a25116d"}
Nov 02 22:21:37.941121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:37.940952    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm" event={"ID":"c9896887-2ff5-4567-a650-6de8c5f25135","Type":"ContainerStarted","Data":"06e0d28a48ade01678a5fef6c397e183b6d886bc5efcc1955617e3b2a5543cf0"}
Nov 02 22:21:37.963403 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:37.963344    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm" podStartSLOduration=1.963330311 podStartE2EDuration="1.963330311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:21:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:21:37.961969116 +0000 UTC m=+1407.018303498" watchObservedRunningTime="2026-11-02 22:21:37.963330311 +0000 UTC m=+1407.019664762"
Nov 02 22:21:38.104404 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:38.104361    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:38.106618 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:38.106588    5076 patch_prober.go:29] interesting pod/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Nov 02 22:21:38.106778 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:38.106640    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm" podUID="c9896887-2ff5-4567-a650-6de8c5f25135" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Nov 02 22:21:38.291305 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:38.289950    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:39.104265 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:39.103931    5076 patch_prober.go:29] interesting pod/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Nov 02 22:21:39.104265 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:39.103984    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm" podUID="c9896887-2ff5-4567-a650-6de8c5f25135" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Nov 02 22:21:39.198616 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:39.194918    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:39.810611 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:39.809557    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:39.900912 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:39.900880    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:40.047050 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:40.047010    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:40.106697 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:40.106661    5076 patch_prober.go:29] interesting pod/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Nov 02 22:21:40.107335 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:40.107302    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm" podUID="c9896887-2ff5-4567-a650-6de8c5f25135" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Nov 02 22:21:41.104290 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:41.104250    5076 patch_prober.go:29] interesting pod/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Nov 02 22:21:41.104504 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:41.104306    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm" podUID="c9896887-2ff5-4567-a650-6de8c5f25135" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Nov 02 22:21:41.192240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:41.192187    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:41.919035 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:41.919001    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:42.104258 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:42.104193    5076 patch_prober.go:29] interesting pod/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Nov 02 22:21:42.104430 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:42.104257    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm" podUID="c9896887-2ff5-4567-a650-6de8c5f25135" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Nov 02 22:21:42.777772 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:42.777737    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:43.104099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:43.104061    5076 patch_prober.go:29] interesting pod/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Nov 02 22:21:43.104307 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:43.104126    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm" podUID="c9896887-2ff5-4567-a650-6de8c5f25135" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Nov 02 22:21:43.553620 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:43.553542    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:44.191424 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:44.191310    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:44.248175 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:44.248144    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:44.248688 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:44.248668    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:44.249421 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:44.249404    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:21:44.276173 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:44.276132    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:44.881095 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:44.881063    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:45.497161 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.497123    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"]
Nov 02 22:21:45.515473 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.515445    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"]
Nov 02 22:21:45.515632 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.515536    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:45.526519 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.526485    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d28bd1\"/\"openshift-service-ca.crt\""
Nov 02 22:21:45.526964 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.526942    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d28bd1\"/\"test-model-d28bd1-kserve-self-signed-certs\""
Nov 02 22:21:45.527277 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.527257    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d28bd1\"/\"default-dockercfg-nv7l6\""
Nov 02 22:21:45.528074 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.528053    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d28bd1\"/\"kube-root-ca.crt\""
Nov 02 22:21:45.539646 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.539591    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:45.594892 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.594860    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a35fda59-30bb-45f0-b723-a917027ad697-tls-certs\") pod \"test-model-d28bd1-kserve-55598f9cd5-hddqn\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") " pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:45.595150 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.594914    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-tmp-dir\") pod \"test-model-d28bd1-kserve-55598f9cd5-hddqn\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") " pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:45.595150 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.595001    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-model-cache\") pod \"test-model-d28bd1-kserve-55598f9cd5-hddqn\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") " pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:45.595150 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.595138    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjzjp\" (UniqueName: \"kubernetes.io/projected/a35fda59-30bb-45f0-b723-a917027ad697-kube-api-access-sjzjp\") pod \"test-model-d28bd1-kserve-55598f9cd5-hddqn\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") " pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:45.595356 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.595183    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-home\") pod \"test-model-d28bd1-kserve-55598f9cd5-hddqn\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") " pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:45.595419 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.595388    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-dshm\") pod \"test-model-d28bd1-kserve-55598f9cd5-hddqn\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") " pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:45.632399 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.632363    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:45.702241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.701288    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjzjp\" (UniqueName: \"kubernetes.io/projected/a35fda59-30bb-45f0-b723-a917027ad697-kube-api-access-sjzjp\") pod \"test-model-d28bd1-kserve-55598f9cd5-hddqn\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") " pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:45.702241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.701347    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-home\") pod \"test-model-d28bd1-kserve-55598f9cd5-hddqn\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") " pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:45.702241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.701527    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-dshm\") pod \"test-model-d28bd1-kserve-55598f9cd5-hddqn\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") " pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:45.702241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.701632    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a35fda59-30bb-45f0-b723-a917027ad697-tls-certs\") pod \"test-model-d28bd1-kserve-55598f9cd5-hddqn\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") " pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:45.702241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.701669    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-tmp-dir\") pod \"test-model-d28bd1-kserve-55598f9cd5-hddqn\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") " pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:45.702241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.701724    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-model-cache\") pod \"test-model-d28bd1-kserve-55598f9cd5-hddqn\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") " pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:45.702786 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.702254    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-model-cache\") pod \"test-model-d28bd1-kserve-55598f9cd5-hddqn\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") " pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:45.702852 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.702811    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-home\") pod \"test-model-d28bd1-kserve-55598f9cd5-hddqn\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") " pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:45.710645 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.710610    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-tmp-dir\") pod \"test-model-d28bd1-kserve-55598f9cd5-hddqn\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") " pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:45.715234 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.713910    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjzjp\" (UniqueName: \"kubernetes.io/projected/a35fda59-30bb-45f0-b723-a917027ad697-kube-api-access-sjzjp\") pod \"test-model-d28bd1-kserve-55598f9cd5-hddqn\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") " pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:45.715234 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.714383    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a35fda59-30bb-45f0-b723-a917027ad697-tls-certs\") pod \"test-model-d28bd1-kserve-55598f9cd5-hddqn\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") " pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:45.715234 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.714600    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-dshm\") pod \"test-model-d28bd1-kserve-55598f9cd5-hddqn\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") " pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:45.851619 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:45.851520    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:46.166149 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:21:46.166116    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda35fda59_30bb_45f0_b723_a917027ad697.slice/crio-70a2f24a7ba01be919344686f1b5d57dd034dc686e6f0a3e09763f9da06356f2 WatchSource:0}: Error finding container 70a2f24a7ba01be919344686f1b5d57dd034dc686e6f0a3e09763f9da06356f2: Status 404 returned error can't find the container with id 70a2f24a7ba01be919344686f1b5d57dd034dc686e6f0a3e09763f9da06356f2
Nov 02 22:21:46.166790 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:46.166765    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"]
Nov 02 22:21:46.593291 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:46.587758    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:47.093153 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:47.093115    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn" event={"ID":"a35fda59-30bb-45f0-b723-a917027ad697","Type":"ContainerStarted","Data":"b700c6012b7616ca57f154632706035b5dbc03edc8141281460fa49c41e02d9c"}
Nov 02 22:21:47.093153 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:47.093158    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn" event={"ID":"a35fda59-30bb-45f0-b723-a917027ad697","Type":"ContainerStarted","Data":"70a2f24a7ba01be919344686f1b5d57dd034dc686e6f0a3e09763f9da06356f2"}
Nov 02 22:21:47.115846 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:47.115798    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn" podStartSLOduration=2.115783558 podStartE2EDuration="2.115783558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:21:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:21:47.111331005 +0000 UTC m=+1416.167665384" watchObservedRunningTime="2026-11-02 22:21:47.115783558 +0000 UTC m=+1416.172117939"
Nov 02 22:21:47.303140 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:47.302978    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:47.852862 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:47.852826    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:47.996604 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:47.996565    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:48.685415 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:48.685376    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:49.341299 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:49.341256    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:49.999161 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:49.999129    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:50.559943 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:50.559906    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:50.689818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:50.689727    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:50.805403 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:50.805371    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:51.224709 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:51.224677    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:51.437192 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:51.437161    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:51.866322 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:51.866285    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:52.698331 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:52.698300    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:53.588151 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:53.588099    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:54.277459 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:54.277426    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:54.991200 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:54.991167    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:55.692945 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:55.692911    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:55.853000 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:55.852962    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:55.865889 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:55.865866    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:56.191587 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:56.191554    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:21:56.499627 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:56.499539    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:56.648779 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:56.648743    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:57.373610 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:57.373578    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:58.027949 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:58.027912    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:58.610866 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:58.610823    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:58.710096 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:58.710053    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:58.815059 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:58.815028    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:58.928603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:58.928524    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:59.857185 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:21:59.857152    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:21:59.894136 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:21:59.894096    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:22:00.581336 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:00.581299    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:01.383888 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:01.383856    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:02.111439 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:02.111400    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:02.790809 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:02.790770    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:03.697330 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:03.697285    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:04.600416 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:04.600360    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:05.490718 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:05.490677    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:06.167961 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:06.167920    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:06.912935 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:06.912888    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:07.689577 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:07.689535    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:08.390665 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:08.390626    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:09.085899 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:09.085850    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:09.555049 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:09.555013    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:09.654932 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:09.654900    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:09.755749 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:09.755714    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:10.411323 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:10.411286    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:11.149136 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:11.149102    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:11.787551 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:11.787522    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:12.475757 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:12.475722    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:13.163380 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:13.163347    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:13.674203 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:13.674168    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:14.300349 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:14.300317    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:15.066846 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:15.066813    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:15.727585 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:15.727554    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:16.376507 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:16.376468    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:17.061588 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:17.061553    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:17.669602 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:17.669567    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:18.409995 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:18.409956    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:19.021157 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:19.021105    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:19.141064 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:19.141020    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:19.231326 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:19.231207    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:19.393972 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:19.393942    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:19.749754 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:19.749670    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:20.379549 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:20.379514    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:21.094251 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:21.092160    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:21.695034 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:21.694996    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:22.478826 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:22.478795    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:23.082143 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:23.082047    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:23.678397 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:23.678361    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:24.374819 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:24.374788    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:25.006808 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:25.006771    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:25.574427 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:25.574397    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:26.368157 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:26.368123    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:26.893727 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:26.893694    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:27.125248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:27.114962    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:27.254955 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:27.254880    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:27.715679 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:27.715636    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:27.960515 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:27.960478    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:28.789899 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:28.789864    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:29.444728 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:29.444695    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:29.890294 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:22:29.890258    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:22:30.044836 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:30.044806    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:30.779241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:30.771619    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:31.406328 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:31.406267    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:32.186425 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:32.186390    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:32.704570 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:32.704450    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"]
Nov 02 22:22:32.789200 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:32.789137    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:32.927241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:32.925103    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:33.531888 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:33.531852    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:34.135421 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:34.135389    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:34.531106 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:34.531023    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:34.801930 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:34.801840    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:35.468261 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:35.468196    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:36.072266 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:36.072200    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:36.683024 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:36.682988    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:37.280919 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:37.280876    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:37.882642 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:37.882605    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:38.231400 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:38.231201    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:38.325347 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:38.325315    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:38.847042 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:38.847010    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:39.476900 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:39.476871    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:40.306662 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:40.306623    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:41.242768 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:41.242735    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:41.872535 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:41.872503    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:42.590489 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:42.590450    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:43.333680 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:43.333650    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:44.190795 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:44.190761    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:44.788530 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:44.788497    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:45.390662 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:45.390630    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:45.994698 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:45.994668    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:46.648569 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:46.648537    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:47.502777 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:47.502736    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:47.728887 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:47.728844    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" containerID="cri-o://b621b77a101a713cc1cb45c1fa63f23bc8a412151097bc57163c55bb518f6bb3" gracePeriod=45
Nov 02 22:22:47.893845 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:47.893806    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": dial tcp 10.132.0.64:8000: connect: connection refused"
Nov 02 22:22:47.921806 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:47.921772    5076 generic.go:356] "Generic (PLEG): container finished" podID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerID="b621b77a101a713cc1cb45c1fa63f23bc8a412151097bc57163c55bb518f6bb3" exitCode=0
Nov 02 22:22:47.921973 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:47.921958    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" event={"ID":"d608bfbf-7412-42a9-9fb7-52c2309ab511","Type":"ContainerDied","Data":"b621b77a101a713cc1cb45c1fa63f23bc8a412151097bc57163c55bb518f6bb3"}
Nov 02 22:22:48.018155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.018130    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:22:48.048414 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.048384    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-home\" (UniqueName: \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-home\") pod \"d608bfbf-7412-42a9-9fb7-52c2309ab511\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") "
Nov 02 22:22:48.052278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.048432    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-model-cache\") pod \"d608bfbf-7412-42a9-9fb7-52c2309ab511\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") "
Nov 02 22:22:48.052278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.048941    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-home" pod "d608bfbf-7412-42a9-9fb7-52c2309ab511" (UID: "d608bfbf-7412-42a9-9fb7-52c2309ab511"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:22:48.052278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.049364    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-model-cache" pod "d608bfbf-7412-42a9-9fb7-52c2309ab511" (UID: "d608bfbf-7412-42a9-9fb7-52c2309ab511"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:22:48.052278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.049776    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-tmp-dir\") pod \"d608bfbf-7412-42a9-9fb7-52c2309ab511\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") "
Nov 02 22:22:48.052278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.049901    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-dshm\" (UniqueName: \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-dshm\") pod \"d608bfbf-7412-42a9-9fb7-52c2309ab511\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") "
Nov 02 22:22:48.052278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.049949    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d608bfbf-7412-42a9-9fb7-52c2309ab511-tls-certs\" (UniqueName: \"kubernetes.io/secret/d608bfbf-7412-42a9-9fb7-52c2309ab511-tls-certs\") pod \"d608bfbf-7412-42a9-9fb7-52c2309ab511\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") "
Nov 02 22:22:48.052278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.050051    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-tmp-dir" pod "d608bfbf-7412-42a9-9fb7-52c2309ab511" (UID: "d608bfbf-7412-42a9-9fb7-52c2309ab511"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:22:48.052278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.050205    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d608bfbf-7412-42a9-9fb7-52c2309ab511-kube-api-access-v6fmr\" (UniqueName: \"kubernetes.io/projected/d608bfbf-7412-42a9-9fb7-52c2309ab511-kube-api-access-v6fmr\") pod \"d608bfbf-7412-42a9-9fb7-52c2309ab511\" (UID: \"d608bfbf-7412-42a9-9fb7-52c2309ab511\") "
Nov 02 22:22:48.052278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.050964    5076 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-home\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:22:48.052278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.050987    5076 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-model-cache\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:22:48.052278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.051001    5076 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-tmp-dir\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:22:48.056723 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.053336    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d608bfbf-7412-42a9-9fb7-52c2309ab511-tls-certs" pod "d608bfbf-7412-42a9-9fb7-52c2309ab511" (UID: "d608bfbf-7412-42a9-9fb7-52c2309ab511"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:22:48.056723 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.053924    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d608bfbf-7412-42a9-9fb7-52c2309ab511-kube-api-access-v6fmr" pod "d608bfbf-7412-42a9-9fb7-52c2309ab511" (UID: "d608bfbf-7412-42a9-9fb7-52c2309ab511"). InnerVolumeSpecName "kube-api-access-v6fmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:22:48.060417 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.060389    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-dshm" pod "d608bfbf-7412-42a9-9fb7-52c2309ab511" (UID: "d608bfbf-7412-42a9-9fb7-52c2309ab511"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:22:48.153422 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.153385    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6fmr\" (UniqueName: \"kubernetes.io/projected/d608bfbf-7412-42a9-9fb7-52c2309ab511-kube-api-access-v6fmr\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:22:48.153422 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.153423    5076 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d608bfbf-7412-42a9-9fb7-52c2309ab511-dshm\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:22:48.153667 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.153440    5076 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d608bfbf-7412-42a9-9fb7-52c2309ab511-tls-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:22:48.185672 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.185607    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:48.789045 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.789011    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:48.931317 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.931284    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"
Nov 02 22:22:48.931513 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.931330    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7" event={"ID":"d608bfbf-7412-42a9-9fb7-52c2309ab511","Type":"ContainerDied","Data":"b905c6e089baebee73677f730231afb66542ad3f61035ed9966e80a277ab7450"}
Nov 02 22:22:48.931513 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.931383    5076 scope.go:122] "RemoveContainer" containerID="b621b77a101a713cc1cb45c1fa63f23bc8a412151097bc57163c55bb518f6bb3"
Nov 02 22:22:48.957836 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.957807    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"]
Nov 02 22:22:48.961407 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:48.961372    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-c302b6/premium-w4-c302b6-kserve-85844f6d4b-vrsh7"]
Nov 02 22:22:49.055064 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:49.054994    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" path="/var/lib/kubelet/pods/d608bfbf-7412-42a9-9fb7-52c2309ab511/volumes"
Nov 02 22:22:49.500480 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:49.500446    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:50.343820 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:50.343783    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:50.971290 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:50.971249    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:51.594181 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:51.594145    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:52.451812 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:52.450961    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:52.981702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:52.981669    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:53.568741 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:53.568705    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:54.204264 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:54.204228    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:54.866863 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:54.866821    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:55.488353 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:55.488325    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:56.128649 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:56.128619    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:56.882480 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:56.882446    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:57.477887 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:57.477840    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:58.188139 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:58.188079    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:58.739610 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:58.739578    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:59.468408 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:22:59.468377    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:22:59.889634 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:22:59.889598    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:23:00.084759 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:00.084722    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:00.809212 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:00.809170    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:01.403244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:01.403176    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:02.178480 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:02.178436    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:02.901440 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:02.901405    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:03.598031 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:03.597989    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:04.393651 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:04.393613    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:04.988764 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:04.988191    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:05.604898 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:05.604863    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:05.705259 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:05.702423    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:05.996534 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:05.996442    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:06.335531 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:06.335457    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:06.837735 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:06.837703    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:07.466744 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:07.466711    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"]
Nov 02 22:23:07.467617 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:07.467581    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn" podUID="ec87244f-5ca4-4986-b922-a02136cb4164" containerName="maas-api" containerID="cri-o://e2825babe41f8ae3eb0cfd17fd73fa89e1a42b0d92e05ebc37e6879f7cb7d325" gracePeriod=30
Nov 02 22:23:07.497171 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:07.496548    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:07.975238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:07.974280    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:08.093316 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.092447    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"
Nov 02 22:23:08.121890 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.121849    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:08.167675 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.167643    5076 generic.go:356] "Generic (PLEG): container finished" podID="ec87244f-5ca4-4986-b922-a02136cb4164" containerID="e2825babe41f8ae3eb0cfd17fd73fa89e1a42b0d92e05ebc37e6879f7cb7d325" exitCode=0
Nov 02 22:23:08.167875 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.167707    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"
Nov 02 22:23:08.167875 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.167743    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn" event={"ID":"ec87244f-5ca4-4986-b922-a02136cb4164","Type":"ContainerDied","Data":"e2825babe41f8ae3eb0cfd17fd73fa89e1a42b0d92e05ebc37e6879f7cb7d325"}
Nov 02 22:23:08.167875 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.167800    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn" event={"ID":"ec87244f-5ca4-4986-b922-a02136cb4164","Type":"ContainerDied","Data":"d5c57e631d23dc8e2a8cc8c86d7631325ffaa72b4250191026761b0e75d7d422"}
Nov 02 22:23:08.167875 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.167827    5076 scope.go:122] "RemoveContainer" containerID="e2825babe41f8ae3eb0cfd17fd73fa89e1a42b0d92e05ebc37e6879f7cb7d325"
Nov 02 22:23:08.179805 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.179780    5076 scope.go:122] "RemoveContainer" containerID="e2825babe41f8ae3eb0cfd17fd73fa89e1a42b0d92e05ebc37e6879f7cb7d325"
Nov 02 22:23:08.180085 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:23:08.180061    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2825babe41f8ae3eb0cfd17fd73fa89e1a42b0d92e05ebc37e6879f7cb7d325\": container with ID starting with e2825babe41f8ae3eb0cfd17fd73fa89e1a42b0d92e05ebc37e6879f7cb7d325 not found: ID does not exist" containerID="e2825babe41f8ae3eb0cfd17fd73fa89e1a42b0d92e05ebc37e6879f7cb7d325"
Nov 02 22:23:08.180172 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.180106    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2825babe41f8ae3eb0cfd17fd73fa89e1a42b0d92e05ebc37e6879f7cb7d325"} err="failed to get container status \"e2825babe41f8ae3eb0cfd17fd73fa89e1a42b0d92e05ebc37e6879f7cb7d325\": rpc error: code = NotFound desc = could not find container \"e2825babe41f8ae3eb0cfd17fd73fa89e1a42b0d92e05ebc37e6879f7cb7d325\": container with ID starting with e2825babe41f8ae3eb0cfd17fd73fa89e1a42b0d92e05ebc37e6879f7cb7d325 not found: ID does not exist"
Nov 02 22:23:08.201187 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.201161    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:08.262352 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.257846    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ec87244f-5ca4-4986-b922-a02136cb4164-kube-api-access-w6mgr\" (UniqueName: \"kubernetes.io/projected/ec87244f-5ca4-4986-b922-a02136cb4164-kube-api-access-w6mgr\") pod \"ec87244f-5ca4-4986-b922-a02136cb4164\" (UID: \"ec87244f-5ca4-4986-b922-a02136cb4164\") "
Nov 02 22:23:08.262352 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.257904    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ec87244f-5ca4-4986-b922-a02136cb4164-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec87244f-5ca4-4986-b922-a02136cb4164-openshift-service-ca\") pod \"ec87244f-5ca4-4986-b922-a02136cb4164\" (UID: \"ec87244f-5ca4-4986-b922-a02136cb4164\") "
Nov 02 22:23:08.262352 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.257978    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ec87244f-5ca4-4986-b922-a02136cb4164-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec87244f-5ca4-4986-b922-a02136cb4164-maas-api-tls\") pod \"ec87244f-5ca4-4986-b922-a02136cb4164\" (UID: \"ec87244f-5ca4-4986-b922-a02136cb4164\") "
Nov 02 22:23:08.262352 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.258086    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ec87244f-5ca4-4986-b922-a02136cb4164-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec87244f-5ca4-4986-b922-a02136cb4164-metrics-certs\") pod \"ec87244f-5ca4-4986-b922-a02136cb4164\" (UID: \"ec87244f-5ca4-4986-b922-a02136cb4164\") "
Nov 02 22:23:08.284242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.263412    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec87244f-5ca4-4986-b922-a02136cb4164-openshift-service-ca" pod "ec87244f-5ca4-4986-b922-a02136cb4164" (UID: "ec87244f-5ca4-4986-b922-a02136cb4164"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:23:08.284242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.270669    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec87244f-5ca4-4986-b922-a02136cb4164-metrics-certs" pod "ec87244f-5ca4-4986-b922-a02136cb4164" (UID: "ec87244f-5ca4-4986-b922-a02136cb4164"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:23:08.284242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.282319    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec87244f-5ca4-4986-b922-a02136cb4164-kube-api-access-w6mgr" pod "ec87244f-5ca4-4986-b922-a02136cb4164" (UID: "ec87244f-5ca4-4986-b922-a02136cb4164"). InnerVolumeSpecName "kube-api-access-w6mgr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:23:08.284678 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.284352    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec87244f-5ca4-4986-b922-a02136cb4164-maas-api-tls" pod "ec87244f-5ca4-4986-b922-a02136cb4164" (UID: "ec87244f-5ca4-4986-b922-a02136cb4164"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:23:08.360469 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.360435    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6mgr\" (UniqueName: \"kubernetes.io/projected/ec87244f-5ca4-4986-b922-a02136cb4164-kube-api-access-w6mgr\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:08.360469 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.360466    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec87244f-5ca4-4986-b922-a02136cb4164-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:08.360672 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.360479    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec87244f-5ca4-4986-b922-a02136cb4164-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:08.360672 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.360489    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec87244f-5ca4-4986-b922-a02136cb4164-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:08.499524 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.499484    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"]
Nov 02 22:23:08.503238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.503203    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-c302b6-564f8464fc-4ckzn"]
Nov 02 22:23:08.611407 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.611377    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:08.967690 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:08.967605    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:09.083830 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:09.083787    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ec87244f-5ca4-4986-b922-a02136cb4164" path="/var/lib/kubelet/pods/ec87244f-5ca4-4986-b922-a02136cb4164/volumes"
Nov 02 22:23:09.687311 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:09.687274    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:10.507882 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:10.507849    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:11.270588 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:11.268909    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:11.818621 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:11.818582    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:12.491609 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:12.491571    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:12.956070 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:12.956037    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:13.067250 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:13.064785    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:13.288994 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:13.288914    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:14.111099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:14.111061    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:14.877455 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:14.877414    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:15.159993 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:15.159907    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:15.261384 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:15.261350    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:15.482348 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:15.482153    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"]
Nov 02 22:23:15.482779 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:15.482750    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8" podUID="3f07035a-2595-4005-8d5b-bfebe3775611" containerName="istio-proxy" containerID="cri-o://97f73362687d9b2ce3e4d4ce7b4a1cac9568dccae86f1e443795a210c86bad9b" gracePeriod=30
Nov 02 22:23:15.492258 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:15.491341    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"]
Nov 02 22:23:15.492258 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:15.491546    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4" podUID="529b113f-33b4-437c-80e2-6ce54f2ad4be" containerName="istio-proxy" containerID="cri-o://c3dd5c5866105e4831098b9a5e4294ecdfed2d515d9edd906ac86557eee82fdc" gracePeriod=30
Nov 02 22:23:15.499081 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:15.499060    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:15.714237 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:15.712756    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:16.681770 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:16.680545    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:17.289191 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:17.289148    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:17.898026 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:17.897989    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:18.564941 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:18.564905    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:19.181517 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:19.181487    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:19.797320 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:19.797284    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:20.468357 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.468319    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:20.780231 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.780197    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:23:20.850594 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.850565    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:23:20.889540 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.889158    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-credential-socket\") pod \"3f07035a-2595-4005-8d5b-bfebe3775611\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") "
Nov 02 22:23:20.889710 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.889589    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3f07035a-2595-4005-8d5b-bfebe3775611-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f07035a-2595-4005-8d5b-bfebe3775611-istiod-ca-cert\") pod \"3f07035a-2595-4005-8d5b-bfebe3775611\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") "
Nov 02 22:23:20.889710 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.889501    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-credential-socket" pod "3f07035a-2595-4005-8d5b-bfebe3775611" (UID: "3f07035a-2595-4005-8d5b-bfebe3775611"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:23:20.889710 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.889665    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-istio-envoy\") pod \"3f07035a-2595-4005-8d5b-bfebe3775611\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") "
Nov 02 22:23:20.889893 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.889760    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3f07035a-2595-4005-8d5b-bfebe3775611-kube-api-access-dp727\" (UniqueName: \"kubernetes.io/projected/3f07035a-2595-4005-8d5b-bfebe3775611-kube-api-access-dp727\") pod \"3f07035a-2595-4005-8d5b-bfebe3775611\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") "
Nov 02 22:23:20.889893 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.889809    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-istio-data\") pod \"3f07035a-2595-4005-8d5b-bfebe3775611\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") "
Nov 02 22:23:20.889985 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.889971    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3f07035a-2595-4005-8d5b-bfebe3775611-istio-token\" (UniqueName: \"kubernetes.io/projected/3f07035a-2595-4005-8d5b-bfebe3775611-istio-token\") pod \"3f07035a-2595-4005-8d5b-bfebe3775611\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") "
Nov 02 22:23:20.890019 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.889999    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3f07035a-2595-4005-8d5b-bfebe3775611-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f07035a-2595-4005-8d5b-bfebe3775611-istio-podinfo\") pod \"3f07035a-2595-4005-8d5b-bfebe3775611\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") "
Nov 02 22:23:20.890068 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.890023    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-workload-socket\") pod \"3f07035a-2595-4005-8d5b-bfebe3775611\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") "
Nov 02 22:23:20.890124 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.890116    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-workload-certs\") pod \"3f07035a-2595-4005-8d5b-bfebe3775611\" (UID: \"3f07035a-2595-4005-8d5b-bfebe3775611\") "
Nov 02 22:23:20.890787 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.890762    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f07035a-2595-4005-8d5b-bfebe3775611-istiod-ca-cert" pod "3f07035a-2595-4005-8d5b-bfebe3775611" (UID: "3f07035a-2595-4005-8d5b-bfebe3775611"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:23:20.890922 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.890892    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:20.891007 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.890984    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-istio-data" pod "3f07035a-2595-4005-8d5b-bfebe3775611" (UID: "3f07035a-2595-4005-8d5b-bfebe3775611"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:23:20.891388 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.891363    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-workload-socket" pod "3f07035a-2595-4005-8d5b-bfebe3775611" (UID: "3f07035a-2595-4005-8d5b-bfebe3775611"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:23:20.891742 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.891719    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-workload-certs" pod "3f07035a-2595-4005-8d5b-bfebe3775611" (UID: "3f07035a-2595-4005-8d5b-bfebe3775611"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:23:20.893878 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.893855    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-istio-envoy" pod "3f07035a-2595-4005-8d5b-bfebe3775611" (UID: "3f07035a-2595-4005-8d5b-bfebe3775611"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:23:20.895534 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.895510    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f07035a-2595-4005-8d5b-bfebe3775611-istio-podinfo" pod "3f07035a-2595-4005-8d5b-bfebe3775611" (UID: "3f07035a-2595-4005-8d5b-bfebe3775611"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:23:20.895642 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.895544    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f07035a-2595-4005-8d5b-bfebe3775611-istio-token" pod "3f07035a-2595-4005-8d5b-bfebe3775611" (UID: "3f07035a-2595-4005-8d5b-bfebe3775611"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:23:20.896830 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.896811    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f07035a-2595-4005-8d5b-bfebe3775611-kube-api-access-dp727" pod "3f07035a-2595-4005-8d5b-bfebe3775611" (UID: "3f07035a-2595-4005-8d5b-bfebe3775611"). InnerVolumeSpecName "kube-api-access-dp727". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:23:20.992453 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.992372    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-workload-socket\") pod \"529b113f-33b4-437c-80e2-6ce54f2ad4be\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") "
Nov 02 22:23:20.992453 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.992429    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-token\" (UniqueName: \"kubernetes.io/projected/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-token\") pod \"529b113f-33b4-437c-80e2-6ce54f2ad4be\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") "
Nov 02 22:23:20.992684 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.992480    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/529b113f-33b4-437c-80e2-6ce54f2ad4be-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/529b113f-33b4-437c-80e2-6ce54f2ad4be-istiod-ca-cert\") pod \"529b113f-33b4-437c-80e2-6ce54f2ad4be\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") "
Nov 02 22:23:20.992684 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.992584    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-data\") pod \"529b113f-33b4-437c-80e2-6ce54f2ad4be\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") "
Nov 02 22:23:20.992684 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.992647    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-podinfo\") pod \"529b113f-33b4-437c-80e2-6ce54f2ad4be\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") "
Nov 02 22:23:20.992684 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.992662    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-workload-socket" pod "529b113f-33b4-437c-80e2-6ce54f2ad4be" (UID: "529b113f-33b4-437c-80e2-6ce54f2ad4be"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:23:20.992912 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.992707    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/529b113f-33b4-437c-80e2-6ce54f2ad4be-kube-api-access-nhh6s\" (UniqueName: \"kubernetes.io/projected/529b113f-33b4-437c-80e2-6ce54f2ad4be-kube-api-access-nhh6s\") pod \"529b113f-33b4-437c-80e2-6ce54f2ad4be\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") "
Nov 02 22:23:20.992912 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.992742    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-envoy\") pod \"529b113f-33b4-437c-80e2-6ce54f2ad4be\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") "
Nov 02 22:23:20.992912 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.992859    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-credential-socket\") pod \"529b113f-33b4-437c-80e2-6ce54f2ad4be\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") "
Nov 02 22:23:20.992912 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.992908    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-workload-certs\") pod \"529b113f-33b4-437c-80e2-6ce54f2ad4be\" (UID: \"529b113f-33b4-437c-80e2-6ce54f2ad4be\") "
Nov 02 22:23:20.993123 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.992989    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/529b113f-33b4-437c-80e2-6ce54f2ad4be-istiod-ca-cert" pod "529b113f-33b4-437c-80e2-6ce54f2ad4be" (UID: "529b113f-33b4-437c-80e2-6ce54f2ad4be"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:23:20.993706 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.993677    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/529b113f-33b4-437c-80e2-6ce54f2ad4be-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:20.993706 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.993702    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f07035a-2595-4005-8d5b-bfebe3775611-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:20.993895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.993717    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:20.993895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.993732    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dp727\" (UniqueName: \"kubernetes.io/projected/3f07035a-2595-4005-8d5b-bfebe3775611-kube-api-access-dp727\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:20.993895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.993746    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:20.993895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.993759    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f07035a-2595-4005-8d5b-bfebe3775611-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:20.993895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.993772    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f07035a-2595-4005-8d5b-bfebe3775611-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:20.993895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.993786    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:20.993895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.993800    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f07035a-2595-4005-8d5b-bfebe3775611-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:20.993895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.993815    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:20.993895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.993831    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-data" pod "529b113f-33b4-437c-80e2-6ce54f2ad4be" (UID: "529b113f-33b4-437c-80e2-6ce54f2ad4be"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:23:20.994410 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.994171    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-credential-socket" pod "529b113f-33b4-437c-80e2-6ce54f2ad4be" (UID: "529b113f-33b4-437c-80e2-6ce54f2ad4be"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:23:20.994410 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.994247    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-workload-certs" pod "529b113f-33b4-437c-80e2-6ce54f2ad4be" (UID: "529b113f-33b4-437c-80e2-6ce54f2ad4be"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:23:20.995564 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.995533    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-token" pod "529b113f-33b4-437c-80e2-6ce54f2ad4be" (UID: "529b113f-33b4-437c-80e2-6ce54f2ad4be"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:23:20.996148 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.996119    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-podinfo" pod "529b113f-33b4-437c-80e2-6ce54f2ad4be" (UID: "529b113f-33b4-437c-80e2-6ce54f2ad4be"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:23:20.996640 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.996612    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/529b113f-33b4-437c-80e2-6ce54f2ad4be-kube-api-access-nhh6s" pod "529b113f-33b4-437c-80e2-6ce54f2ad4be" (UID: "529b113f-33b4-437c-80e2-6ce54f2ad4be"). InnerVolumeSpecName "kube-api-access-nhh6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:23:20.997163 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:20.997141    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-envoy" pod "529b113f-33b4-437c-80e2-6ce54f2ad4be" (UID: "529b113f-33b4-437c-80e2-6ce54f2ad4be"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:23:21.095771 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.095746    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:21.095771 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.095771    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:21.095771 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.095781    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:21.095992 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.095791    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhh6s\" (UniqueName: \"kubernetes.io/projected/529b113f-33b4-437c-80e2-6ce54f2ad4be-kube-api-access-nhh6s\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:21.095992 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.095800    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:21.095992 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.095810    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:21.095992 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.095818    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/529b113f-33b4-437c-80e2-6ce54f2ad4be-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:23:21.175780 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.175743    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:21.306994 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.306906    5076 generic.go:356] "Generic (PLEG): container finished" podID="3f07035a-2595-4005-8d5b-bfebe3775611" containerID="97f73362687d9b2ce3e4d4ce7b4a1cac9568dccae86f1e443795a210c86bad9b" exitCode=0
Nov 02 22:23:21.306994 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.306961    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"
Nov 02 22:23:21.307245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.306987    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8" event={"ID":"3f07035a-2595-4005-8d5b-bfebe3775611","Type":"ContainerDied","Data":"97f73362687d9b2ce3e4d4ce7b4a1cac9568dccae86f1e443795a210c86bad9b"}
Nov 02 22:23:21.307245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.307061    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8" event={"ID":"3f07035a-2595-4005-8d5b-bfebe3775611","Type":"ContainerDied","Data":"704fde1ec5689040fa6e7632692b9ab7e26092d07c86671323b0dd62de625e09"}
Nov 02 22:23:21.307245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.307109    5076 scope.go:122] "RemoveContainer" containerID="97f73362687d9b2ce3e4d4ce7b4a1cac9568dccae86f1e443795a210c86bad9b"
Nov 02 22:23:21.309399 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.309375    5076 generic.go:356] "Generic (PLEG): container finished" podID="529b113f-33b4-437c-80e2-6ce54f2ad4be" containerID="c3dd5c5866105e4831098b9a5e4294ecdfed2d515d9edd906ac86557eee82fdc" exitCode=0
Nov 02 22:23:21.309531 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.309421    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"
Nov 02 22:23:21.309531 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.309452    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4" event={"ID":"529b113f-33b4-437c-80e2-6ce54f2ad4be","Type":"ContainerDied","Data":"c3dd5c5866105e4831098b9a5e4294ecdfed2d515d9edd906ac86557eee82fdc"}
Nov 02 22:23:21.309531 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.309506    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4" event={"ID":"529b113f-33b4-437c-80e2-6ce54f2ad4be","Type":"ContainerDied","Data":"27f0520dfb584b68048e978f9a531af07993ea39ab0060219a0c88171fddb21c"}
Nov 02 22:23:21.323293 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.319974    5076 scope.go:122] "RemoveContainer" containerID="97f73362687d9b2ce3e4d4ce7b4a1cac9568dccae86f1e443795a210c86bad9b"
Nov 02 22:23:21.323906 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:23:21.323875    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97f73362687d9b2ce3e4d4ce7b4a1cac9568dccae86f1e443795a210c86bad9b\": container with ID starting with 97f73362687d9b2ce3e4d4ce7b4a1cac9568dccae86f1e443795a210c86bad9b not found: ID does not exist" containerID="97f73362687d9b2ce3e4d4ce7b4a1cac9568dccae86f1e443795a210c86bad9b"
Nov 02 22:23:21.324021 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.323916    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97f73362687d9b2ce3e4d4ce7b4a1cac9568dccae86f1e443795a210c86bad9b"} err="failed to get container status \"97f73362687d9b2ce3e4d4ce7b4a1cac9568dccae86f1e443795a210c86bad9b\": rpc error: code = NotFound desc = could not find container \"97f73362687d9b2ce3e4d4ce7b4a1cac9568dccae86f1e443795a210c86bad9b\": container with ID starting with 97f73362687d9b2ce3e4d4ce7b4a1cac9568dccae86f1e443795a210c86bad9b not found: ID does not exist"
Nov 02 22:23:21.324021 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.323952    5076 scope.go:122] "RemoveContainer" containerID="c3dd5c5866105e4831098b9a5e4294ecdfed2d515d9edd906ac86557eee82fdc"
Nov 02 22:23:21.339087 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.339050    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"]
Nov 02 22:23:21.344614 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.344589    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-wz4g4"]
Nov 02 22:23:21.359371 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.359346    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"]
Nov 02 22:23:21.365938 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.365904    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-c302b6-openshift-default-847b94b857-d7lz8"]
Nov 02 22:23:21.368291 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.366199    5076 scope.go:122] "RemoveContainer" containerID="c3dd5c5866105e4831098b9a5e4294ecdfed2d515d9edd906ac86557eee82fdc"
Nov 02 22:23:21.369360 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:23:21.369332    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3dd5c5866105e4831098b9a5e4294ecdfed2d515d9edd906ac86557eee82fdc\": container with ID starting with c3dd5c5866105e4831098b9a5e4294ecdfed2d515d9edd906ac86557eee82fdc not found: ID does not exist" containerID="c3dd5c5866105e4831098b9a5e4294ecdfed2d515d9edd906ac86557eee82fdc"
Nov 02 22:23:21.369506 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.369478    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3dd5c5866105e4831098b9a5e4294ecdfed2d515d9edd906ac86557eee82fdc"} err="failed to get container status \"c3dd5c5866105e4831098b9a5e4294ecdfed2d515d9edd906ac86557eee82fdc\": rpc error: code = NotFound desc = could not find container \"c3dd5c5866105e4831098b9a5e4294ecdfed2d515d9edd906ac86557eee82fdc\": container with ID starting with c3dd5c5866105e4831098b9a5e4294ecdfed2d515d9edd906ac86557eee82fdc not found: ID does not exist"
Nov 02 22:23:21.874153 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:21.874116    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:22.506629 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:22.506592    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:23.089242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:23.088625    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3f07035a-2595-4005-8d5b-bfebe3775611" path="/var/lib/kubelet/pods/3f07035a-2595-4005-8d5b-bfebe3775611/volumes"
Nov 02 22:23:23.089849 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:23.089494    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="529b113f-33b4-437c-80e2-6ce54f2ad4be" path="/var/lib/kubelet/pods/529b113f-33b4-437c-80e2-6ce54f2ad4be/volumes"
Nov 02 22:23:23.730108 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:23.730073    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:24.558578 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:24.558541    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:24.907051 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:24.907014    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:25.167579 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:25.167495    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:25.921702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:25.921670    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:26.746689 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:26.746638    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:27.577685 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:27.577643    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:28.167598 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:28.167562    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:28.773903 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:28.773866    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:29.399552 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:29.399482    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:29.894695 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:23:29.894659    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:23:30.084608 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:30.084570    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:30.673192 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:30.673156    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:31.272734 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:31.272696    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:31.905468 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:31.905419    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:32.595819 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:32.595773    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:33.284123 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:33.284078    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:33.923432 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:33.923396    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:34.562611 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:34.562574    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:34.663336 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:34.663303    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:35.180264 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:35.180199    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:35.946974 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:35.946936    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:36.565554 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:36.565518    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:37.350241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:37.350198    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:37.983946 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:37.983914    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:38.679983 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:38.679952    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:39.270261 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:39.270188    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:39.872155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:39.872122    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:40.465469 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:40.465440    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:41.064942 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:41.064907    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:41.698962 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:41.698919    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:42.348673 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:42.348634    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:42.966162 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:42.966126    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:43.591017 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:43.590983    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:44.315200 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:44.315165    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:44.970341 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:44.970305    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:45.589756 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:45.589720    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:46.182908 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:46.182873    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:46.769921 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:46.769883    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:47.471932 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:47.471892    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:48.191369 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:48.191333    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:48.794618 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:48.794590    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:49.371874 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:49.371836    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:49.968244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:49.968182    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:50.568747 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:50.568713    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:51.167867 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:51.167835    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:51.822751 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:51.822714    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:52.685434 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:52.685399    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:53.385028 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:53.384974    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:54.025230 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:54.025190    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:54.133615 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:54.130334    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:54.711692 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:54.706713    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:55.296787 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:55.296753    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:55.996742 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:55.996709    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:56.633850 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:56.633813    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:57.364518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:57.364470    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:57.970466 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:57.970420    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:58.571872 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:58.571831    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:59.208275 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:59.208207    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:59.884106 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:23:59.884065    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:23:59.894986 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:23:59.894954    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:24:00.519091 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:00.519049    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:00.812597 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:00.812502    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"]
Nov 02 22:24:00.812805 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:00.812778    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg" podUID="0d8408b1-b83c-4a50-a207-714eca0f1b7b" containerName="istio-proxy" containerID="cri-o://0a5c4a78fd962a199f88b6b7225e04318fac0516ca307cbcdb9b02d2ac83c4e2" gracePeriod=30
Nov 02 22:24:01.166941 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:01.166909    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:01.804096 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:01.804059    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:02.493576 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:02.493542    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:03.183382 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:03.183353    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:03.783382 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:03.783349    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:04.375239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:04.373598    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:04.972849 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:04.972815    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:05.671944 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:05.671906    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:06.109039 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.109008    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:24:06.254070 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.253291    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-podinfo\") pod \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") "
Nov 02 22:24:06.254070 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.253374    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-workload-socket\") pod \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") "
Nov 02 22:24:06.254070 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.253416    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-data\") pod \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") "
Nov 02 22:24:06.254070 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.253483    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d8408b1-b83c-4a50-a207-714eca0f1b7b-kube-api-access-swhhb\" (UniqueName: \"kubernetes.io/projected/0d8408b1-b83c-4a50-a207-714eca0f1b7b-kube-api-access-swhhb\") pod \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") "
Nov 02 22:24:06.254070 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.253538    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-workload-certs\") pod \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") "
Nov 02 22:24:06.254070 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.253613    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-token\" (UniqueName: \"kubernetes.io/projected/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-token\") pod \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") "
Nov 02 22:24:06.254070 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.253727    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istiod-ca-cert\") pod \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") "
Nov 02 22:24:06.254070 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.253828    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-credential-socket\") pod \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") "
Nov 02 22:24:06.254070 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.253864    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-envoy\") pod \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\" (UID: \"0d8408b1-b83c-4a50-a207-714eca0f1b7b\") "
Nov 02 22:24:06.259170 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.257446    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-envoy" pod "0d8408b1-b83c-4a50-a207-714eca0f1b7b" (UID: "0d8408b1-b83c-4a50-a207-714eca0f1b7b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:24:06.262872 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.262834    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-workload-certs" pod "0d8408b1-b83c-4a50-a207-714eca0f1b7b" (UID: "0d8408b1-b83c-4a50-a207-714eca0f1b7b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:24:06.263071 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.262947    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-credential-socket" pod "0d8408b1-b83c-4a50-a207-714eca0f1b7b" (UID: "0d8408b1-b83c-4a50-a207-714eca0f1b7b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:24:06.263175 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.262989    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istiod-ca-cert" pod "0d8408b1-b83c-4a50-a207-714eca0f1b7b" (UID: "0d8408b1-b83c-4a50-a207-714eca0f1b7b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:24:06.263316 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.263289    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-data" pod "0d8408b1-b83c-4a50-a207-714eca0f1b7b" (UID: "0d8408b1-b83c-4a50-a207-714eca0f1b7b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:24:06.263674 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.263645    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-workload-socket" pod "0d8408b1-b83c-4a50-a207-714eca0f1b7b" (UID: "0d8408b1-b83c-4a50-a207-714eca0f1b7b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:24:06.266639 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.266516    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-token" pod "0d8408b1-b83c-4a50-a207-714eca0f1b7b" (UID: "0d8408b1-b83c-4a50-a207-714eca0f1b7b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:24:06.267014 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.266979    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d8408b1-b83c-4a50-a207-714eca0f1b7b-kube-api-access-swhhb" pod "0d8408b1-b83c-4a50-a207-714eca0f1b7b" (UID: "0d8408b1-b83c-4a50-a207-714eca0f1b7b"). InnerVolumeSpecName "kube-api-access-swhhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:24:06.267396 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.267369    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-podinfo" pod "0d8408b1-b83c-4a50-a207-714eca0f1b7b" (UID: "0d8408b1-b83c-4a50-a207-714eca0f1b7b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:24:06.356006 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.355968    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:24:06.356006 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.356001    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:24:06.356006 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.356011    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:24:06.356294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.356020    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:24:06.356294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.356029    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:24:06.356294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.356037    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:24:06.356294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.356047    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swhhb\" (UniqueName: \"kubernetes.io/projected/0d8408b1-b83c-4a50-a207-714eca0f1b7b-kube-api-access-swhhb\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:24:06.356294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.356057    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d8408b1-b83c-4a50-a207-714eca0f1b7b-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:24:06.356294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.356065    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d8408b1-b83c-4a50-a207-714eca0f1b7b-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:24:06.366858 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.366830    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:06.781695 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.781665    5076 generic.go:356] "Generic (PLEG): container finished" podID="0d8408b1-b83c-4a50-a207-714eca0f1b7b" containerID="0a5c4a78fd962a199f88b6b7225e04318fac0516ca307cbcdb9b02d2ac83c4e2" exitCode=0
Nov 02 22:24:06.781849 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.781726    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg" event={"ID":"0d8408b1-b83c-4a50-a207-714eca0f1b7b","Type":"ContainerDied","Data":"0a5c4a78fd962a199f88b6b7225e04318fac0516ca307cbcdb9b02d2ac83c4e2"}
Nov 02 22:24:06.781849 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.781734    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"
Nov 02 22:24:06.781849 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.781791    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg" event={"ID":"0d8408b1-b83c-4a50-a207-714eca0f1b7b","Type":"ContainerDied","Data":"dd61a7d99b53e12e6730a2542dab8a3cd58f9fe703c0fab9e490ecb6b4a7cccb"}
Nov 02 22:24:06.781849 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.781812    5076 scope.go:122] "RemoveContainer" containerID="0a5c4a78fd962a199f88b6b7225e04318fac0516ca307cbcdb9b02d2ac83c4e2"
Nov 02 22:24:06.793878 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.793856    5076 scope.go:122] "RemoveContainer" containerID="0a5c4a78fd962a199f88b6b7225e04318fac0516ca307cbcdb9b02d2ac83c4e2"
Nov 02 22:24:06.794262 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:24:06.794201    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a5c4a78fd962a199f88b6b7225e04318fac0516ca307cbcdb9b02d2ac83c4e2\": container with ID starting with 0a5c4a78fd962a199f88b6b7225e04318fac0516ca307cbcdb9b02d2ac83c4e2 not found: ID does not exist" containerID="0a5c4a78fd962a199f88b6b7225e04318fac0516ca307cbcdb9b02d2ac83c4e2"
Nov 02 22:24:06.794364 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.794276    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a5c4a78fd962a199f88b6b7225e04318fac0516ca307cbcdb9b02d2ac83c4e2"} err="failed to get container status \"0a5c4a78fd962a199f88b6b7225e04318fac0516ca307cbcdb9b02d2ac83c4e2\": rpc error: code = NotFound desc = could not find container \"0a5c4a78fd962a199f88b6b7225e04318fac0516ca307cbcdb9b02d2ac83c4e2\": container with ID starting with 0a5c4a78fd962a199f88b6b7225e04318fac0516ca307cbcdb9b02d2ac83c4e2 not found: ID does not exist"
Nov 02 22:24:06.807266 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.807211    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"]
Nov 02 22:24:06.811637 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:06.811616    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-9l7vg"]
Nov 02 22:24:07.055936 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:07.055849    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0d8408b1-b83c-4a50-a207-714eca0f1b7b" path="/var/lib/kubelet/pods/0d8408b1-b83c-4a50-a207-714eca0f1b7b/volumes"
Nov 02 22:24:07.101664 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:07.101572    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:07.710374 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:07.710344    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:08.479210 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:08.479164    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:09.065099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:09.065067    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:09.694659 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:09.694629    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:10.472963 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:10.472923    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:11.156040 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:11.156004    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:11.683072 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:11.683034    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:12.273137 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:12.273096    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:12.873331 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:12.873295    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:13.560737 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:13.560704    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:14.198421 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:14.198386    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:14.870739 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:14.870707    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:15.506378 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:15.506350    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:16.078890 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:16.078855    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:16.699436 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:16.699390    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:17.378418 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:17.378373    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:18.147593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:18.147545    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:18.770477 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:18.770407    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:19.432431 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:19.432390    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:20.090421 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:20.090391    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:20.771281 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:20.771249    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:21.371788 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:21.371751    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:22.063851 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:22.063806    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:22.759049 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:22.759007    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:23.582795 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:23.582761    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:24.265868 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:24.265821    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:24.863116 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:24.863083    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:25.568468 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:25.568431    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:26.227667 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:26.227633    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:26.571331 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:26.571251    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"]
Nov 02 22:24:26.584289 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:26.584258    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:27.041545 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:27.041510    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:27.773749 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:27.773713    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:28.399787 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:28.399752    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:29.206699 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:29.206667    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:29.887190 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:29.887152    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:29.903134 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:24:29.903095    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:24:30.521234 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:30.521192    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:31.193526 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:31.193489    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:31.940610 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:31.940562    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:32.696177 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:32.696142    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:33.498922 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:33.498870    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:34.264931 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:34.264894    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:34.621916 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:34.621880    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:34.961198 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:34.961110    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:35.503483 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:35.503454    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:36.093026 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:36.092997    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:36.888461 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:36.888426    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:37.475425 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:37.475393    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:37.726189 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:37.726114    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:38.494694 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:38.494661    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:39.344040 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:39.343941    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:40.277645 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:40.277612    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:40.976328 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:40.976288    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:41.595101 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:41.595055    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk" podUID="39e7bfaa-9013-4559-9e7e-d985fd896011" containerName="main" containerID="cri-o://bede950de728f92d47d1b1e111455ed33843247f364e18733791d4555de6ea1e" gracePeriod=45
Nov 02 22:24:41.693199 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:41.693163    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:41.942716 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:41.942687    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:24:42.060339 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.060305    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-model-cache\") pod \"39e7bfaa-9013-4559-9e7e-d985fd896011\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") "
Nov 02 22:24:42.060515 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.060410    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/39e7bfaa-9013-4559-9e7e-d985fd896011-tls-certs\" (UniqueName: \"kubernetes.io/secret/39e7bfaa-9013-4559-9e7e-d985fd896011-tls-certs\") pod \"39e7bfaa-9013-4559-9e7e-d985fd896011\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") "
Nov 02 22:24:42.060515 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.060474    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-tmp-dir\") pod \"39e7bfaa-9013-4559-9e7e-d985fd896011\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") "
Nov 02 22:24:42.060647 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.060539    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-model-cache" pod "39e7bfaa-9013-4559-9e7e-d985fd896011" (UID: "39e7bfaa-9013-4559-9e7e-d985fd896011"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:24:42.060647 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.060564    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-dshm\" (UniqueName: \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-dshm\") pod \"39e7bfaa-9013-4559-9e7e-d985fd896011\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") "
Nov 02 22:24:42.060647 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.060599    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39e7bfaa-9013-4559-9e7e-d985fd896011-kube-api-access-stfnp\" (UniqueName: \"kubernetes.io/projected/39e7bfaa-9013-4559-9e7e-d985fd896011-kube-api-access-stfnp\") pod \"39e7bfaa-9013-4559-9e7e-d985fd896011\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") "
Nov 02 22:24:42.060647 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.060639    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-home\" (UniqueName: \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-home\") pod \"39e7bfaa-9013-4559-9e7e-d985fd896011\" (UID: \"39e7bfaa-9013-4559-9e7e-d985fd896011\") "
Nov 02 22:24:42.060861 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.060799    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-tmp-dir" pod "39e7bfaa-9013-4559-9e7e-d985fd896011" (UID: "39e7bfaa-9013-4559-9e7e-d985fd896011"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:24:42.060970 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.060941    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-home" pod "39e7bfaa-9013-4559-9e7e-d985fd896011" (UID: "39e7bfaa-9013-4559-9e7e-d985fd896011"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:24:42.061358 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.061329    5076 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-tmp-dir\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:24:42.061358 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.061359    5076 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-home\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:24:42.061554 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.061374    5076 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-model-cache\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:24:42.062766 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.062736    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-dshm" pod "39e7bfaa-9013-4559-9e7e-d985fd896011" (UID: "39e7bfaa-9013-4559-9e7e-d985fd896011"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:24:42.062766 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.062761    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39e7bfaa-9013-4559-9e7e-d985fd896011-kube-api-access-stfnp" pod "39e7bfaa-9013-4559-9e7e-d985fd896011" (UID: "39e7bfaa-9013-4559-9e7e-d985fd896011"). InnerVolumeSpecName "kube-api-access-stfnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:24:42.062941 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.062777    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39e7bfaa-9013-4559-9e7e-d985fd896011-tls-certs" pod "39e7bfaa-9013-4559-9e7e-d985fd896011" (UID: "39e7bfaa-9013-4559-9e7e-d985fd896011"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:24:42.120572 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.120540    5076 generic.go:356] "Generic (PLEG): container finished" podID="39e7bfaa-9013-4559-9e7e-d985fd896011" containerID="bede950de728f92d47d1b1e111455ed33843247f364e18733791d4555de6ea1e" exitCode=0
Nov 02 22:24:42.120722 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.120582    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"
Nov 02 22:24:42.120722 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.120621    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk" event={"ID":"39e7bfaa-9013-4559-9e7e-d985fd896011","Type":"ContainerDied","Data":"bede950de728f92d47d1b1e111455ed33843247f364e18733791d4555de6ea1e"}
Nov 02 22:24:42.120722 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.120660    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk" event={"ID":"39e7bfaa-9013-4559-9e7e-d985fd896011","Type":"ContainerDied","Data":"84c20081b41474243e9c48f1da3d485f7733f4fb611fcf47cbaabac2c2b8bc44"}
Nov 02 22:24:42.120722 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.120677    5076 scope.go:122] "RemoveContainer" containerID="bede950de728f92d47d1b1e111455ed33843247f364e18733791d4555de6ea1e"
Nov 02 22:24:42.132316 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.132303    5076 scope.go:122] "RemoveContainer" containerID="bede950de728f92d47d1b1e111455ed33843247f364e18733791d4555de6ea1e"
Nov 02 22:24:42.132585 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:24:42.132567    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bede950de728f92d47d1b1e111455ed33843247f364e18733791d4555de6ea1e\": container with ID starting with bede950de728f92d47d1b1e111455ed33843247f364e18733791d4555de6ea1e not found: ID does not exist" containerID="bede950de728f92d47d1b1e111455ed33843247f364e18733791d4555de6ea1e"
Nov 02 22:24:42.132629 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.132596    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bede950de728f92d47d1b1e111455ed33843247f364e18733791d4555de6ea1e"} err="failed to get container status \"bede950de728f92d47d1b1e111455ed33843247f364e18733791d4555de6ea1e\": rpc error: code = NotFound desc = could not find container \"bede950de728f92d47d1b1e111455ed33843247f364e18733791d4555de6ea1e\": container with ID starting with bede950de728f92d47d1b1e111455ed33843247f364e18733791d4555de6ea1e not found: ID does not exist"
Nov 02 22:24:42.146249 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.146200    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"]
Nov 02 22:24:42.149677 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.149654    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-419f68/test-model-419f68-kserve-686bbc4695-w8mtk"]
Nov 02 22:24:42.163049 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.163028    5076 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39e7bfaa-9013-4559-9e7e-d985fd896011-dshm\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:24:42.163049 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.163056    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stfnp\" (UniqueName: \"kubernetes.io/projected/39e7bfaa-9013-4559-9e7e-d985fd896011-kube-api-access-stfnp\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:24:42.163207 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.163075    5076 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39e7bfaa-9013-4559-9e7e-d985fd896011-tls-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:24:42.379634 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:42.379599    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:43.055506 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:43.055471    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="39e7bfaa-9013-4559-9e7e-d985fd896011" path="/var/lib/kubelet/pods/39e7bfaa-9013-4559-9e7e-d985fd896011/volumes"
Nov 02 22:24:43.091437 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:43.091408    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:43.886485 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:43.886453    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:44.677597 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:44.677557    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:45.375798 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:45.375760    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:46.144004 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:46.143963    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:46.766721 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:46.766689    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:47.411182 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:47.411146    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:48.076638 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:48.076602    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:48.214141 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:48.214105    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:48.291752 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:48.291718    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:48.957089 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:48.956382    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:49.483736 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:49.483696    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:50.184328 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:50.184284    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:50.284727 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:50.284691    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:50.384888 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:50.384846    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:51.079213 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:51.079175    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:51.368877 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:51.368840    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:52.083340 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:52.083204    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:52.734190 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:52.734144    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:53.431234 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:53.431187    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"]
Nov 02 22:24:53.431465 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:53.431436    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8" podUID="31c47ce5-da96-4582-a8e0-09c5e8aafd4f" containerName="maas-api" containerID="cri-o://bb2d2c7ced3d61275af32718c8709ae0903c993efae5cc14cca9683b2bca1edd" gracePeriod=30
Nov 02 22:24:53.445062 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:53.445037    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:53.598382 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:53.596546    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:53.711303 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:53.710836    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:54.016350 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.016313    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:54.026450 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.026425    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"
Nov 02 22:24:54.056801 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.056767    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-metrics-certs\") pod \"31c47ce5-da96-4582-a8e0-09c5e8aafd4f\" (UID: \"31c47ce5-da96-4582-a8e0-09c5e8aafd4f\") "
Nov 02 22:24:54.056971 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.056883    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-maas-api-tls\") pod \"31c47ce5-da96-4582-a8e0-09c5e8aafd4f\" (UID: \"31c47ce5-da96-4582-a8e0-09c5e8aafd4f\") "
Nov 02 22:24:54.057025 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.056977    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-kube-api-access-nr8zq\" (UniqueName: \"kubernetes.io/projected/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-kube-api-access-nr8zq\") pod \"31c47ce5-da96-4582-a8e0-09c5e8aafd4f\" (UID: \"31c47ce5-da96-4582-a8e0-09c5e8aafd4f\") "
Nov 02 22:24:54.057069 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.057058    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-openshift-service-ca\") pod \"31c47ce5-da96-4582-a8e0-09c5e8aafd4f\" (UID: \"31c47ce5-da96-4582-a8e0-09c5e8aafd4f\") "
Nov 02 22:24:54.057867 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.057837    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-openshift-service-ca" pod "31c47ce5-da96-4582-a8e0-09c5e8aafd4f" (UID: "31c47ce5-da96-4582-a8e0-09c5e8aafd4f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:24:54.058260 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.058205    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:24:54.060453 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.060428    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-kube-api-access-nr8zq" pod "31c47ce5-da96-4582-a8e0-09c5e8aafd4f" (UID: "31c47ce5-da96-4582-a8e0-09c5e8aafd4f"). InnerVolumeSpecName "kube-api-access-nr8zq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:24:54.060737 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.060693    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-metrics-certs" pod "31c47ce5-da96-4582-a8e0-09c5e8aafd4f" (UID: "31c47ce5-da96-4582-a8e0-09c5e8aafd4f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:24:54.073346 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.073318    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-maas-api-tls" pod "31c47ce5-da96-4582-a8e0-09c5e8aafd4f" (UID: "31c47ce5-da96-4582-a8e0-09c5e8aafd4f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:24:54.183238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.166397    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:24:54.183238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.166431    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:24:54.183238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.166447    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr8zq\" (UniqueName: \"kubernetes.io/projected/31c47ce5-da96-4582-a8e0-09c5e8aafd4f-kube-api-access-nr8zq\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:24:54.256792 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.256701    5076 generic.go:356] "Generic (PLEG): container finished" podID="31c47ce5-da96-4582-a8e0-09c5e8aafd4f" containerID="bb2d2c7ced3d61275af32718c8709ae0903c993efae5cc14cca9683b2bca1edd" exitCode=0
Nov 02 22:24:54.256792 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.256748    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"
Nov 02 22:24:54.256995 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.256784    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8" event={"ID":"31c47ce5-da96-4582-a8e0-09c5e8aafd4f","Type":"ContainerDied","Data":"bb2d2c7ced3d61275af32718c8709ae0903c993efae5cc14cca9683b2bca1edd"}
Nov 02 22:24:54.256995 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.256853    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8" event={"ID":"31c47ce5-da96-4582-a8e0-09c5e8aafd4f","Type":"ContainerDied","Data":"04e67b1c00e717ba04b00fe3ee27ffe4d1b4a335e827d68ac69756bd4351a152"}
Nov 02 22:24:54.256995 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.256881    5076 scope.go:122] "RemoveContainer" containerID="bb2d2c7ced3d61275af32718c8709ae0903c993efae5cc14cca9683b2bca1edd"
Nov 02 22:24:54.281854 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.281833    5076 scope.go:122] "RemoveContainer" containerID="bb2d2c7ced3d61275af32718c8709ae0903c993efae5cc14cca9683b2bca1edd"
Nov 02 22:24:54.282264 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:24:54.282193    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb2d2c7ced3d61275af32718c8709ae0903c993efae5cc14cca9683b2bca1edd\": container with ID starting with bb2d2c7ced3d61275af32718c8709ae0903c993efae5cc14cca9683b2bca1edd not found: ID does not exist" containerID="bb2d2c7ced3d61275af32718c8709ae0903c993efae5cc14cca9683b2bca1edd"
Nov 02 22:24:54.282335 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.282281    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb2d2c7ced3d61275af32718c8709ae0903c993efae5cc14cca9683b2bca1edd"} err="failed to get container status \"bb2d2c7ced3d61275af32718c8709ae0903c993efae5cc14cca9683b2bca1edd\": rpc error: code = NotFound desc = could not find container \"bb2d2c7ced3d61275af32718c8709ae0903c993efae5cc14cca9683b2bca1edd\": container with ID starting with bb2d2c7ced3d61275af32718c8709ae0903c993efae5cc14cca9683b2bca1edd not found: ID does not exist"
Nov 02 22:24:54.292522 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.292492    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"]
Nov 02 22:24:54.295491 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.295466    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-419f68-56c69dcff8-sgbz8"]
Nov 02 22:24:54.401554 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.401511    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:54.798936 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:54.798902    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:55.055279 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:55.055159    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="31c47ce5-da96-4582-a8e0-09c5e8aafd4f" path="/var/lib/kubelet/pods/31c47ce5-da96-4582-a8e0-09c5e8aafd4f/volumes"
Nov 02 22:24:55.642917 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:55.642753    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:56.295560 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:56.295527    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:57.079673 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:57.079631    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:57.762459 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:57.762409    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:58.479365 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:58.479327    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:58.579046 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:58.579012    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:59.280269 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:24:59.280208    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:24:59.890462 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:24:59.890427    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:25:00.061522 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:00.061487    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:00.768246 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:00.768182    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:00.879333 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:00.879297    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:01.176241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:01.174977    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:01.644741 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:01.644706    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:02.486212 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:02.486179    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:03.182533 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:03.182505    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:03.764906 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:03.764875    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:04.490974 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:04.490939    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:05.369105 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:05.369068    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:05.503692 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:05.503646    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:06.388368 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:06.388331    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:07.166727 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:07.166696    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:07.865059 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:07.865022    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:08.594302 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:08.594265    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:09.486704 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:09.486254    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:10.700172 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:10.700132    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:11.592549 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:11.592506    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:11.702714 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:11.698760    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:11.794452 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:11.794421    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:11.893979 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:11.893948    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:12.427347 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:12.427306    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:12.759578 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:12.759539    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:13.087362 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:13.086917    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:13.287419 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:13.287378    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:13.395908 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:13.393376    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:13.651996 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:13.651918    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:13.918432 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:13.918339    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:14.541891 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:14.541852    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:15.280022 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:15.279989    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:15.660108 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:15.660062    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"]
Nov 02 22:25:15.660357 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:15.660333    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb" podUID="8c282ee8-f3d0-4043-b798-cebd43900b30" containerName="istio-proxy" containerID="cri-o://fc3ae2b5fc6c5f1cde936a8b0d14aa5498bf245b2e1912b64077f6f1d2d76f4f" gracePeriod=30
Nov 02 22:25:15.848919 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:15.848883    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:15.962564 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:15.962490    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:16.368449 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:16.368417    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:17.283234 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:17.283155    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:17.866927 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:17.866887    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"]
Nov 02 22:25:17.889057 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:17.888668    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:18.212689 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:18.212603    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:18.977768 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:18.977731    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:19.764746 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:19.764713    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:20.216472 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:20.216439    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:20.323578 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:20.323543    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:20.575421 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:20.575323    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"]
Nov 02 22:25:20.576577 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:20.576546    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm" podUID="c9896887-2ff5-4567-a650-6de8c5f25135" containerName="istio-proxy" containerID="cri-o://9a8a06493d2df85184c08c830ed49d4e0e35f8a02781406db93779584a25116d" gracePeriod=30
Nov 02 22:25:20.586512 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:20.586486    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"]
Nov 02 22:25:20.586714 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:20.586692    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v" podUID="35ee896c-9d7e-4b87-aaf7-c000622f208e" containerName="istio-proxy" containerID="cri-o://7d983c87ec5c15a8cb437d24a297d67b255a033d1f376539e0eaaabb64877aa9" gracePeriod=30
Nov 02 22:25:20.611889 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:20.611844    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:20.714288 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:20.714254    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:21.058700 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.058667    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:25:21.172641 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.172609    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8c282ee8-f3d0-4043-b798-cebd43900b30-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c282ee8-f3d0-4043-b798-cebd43900b30-istiod-ca-cert\") pod \"8c282ee8-f3d0-4043-b798-cebd43900b30\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") "
Nov 02 22:25:21.172896 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.172877    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c282ee8-f3d0-4043-b798-cebd43900b30-kube-api-access-tzdth\" (UniqueName: \"kubernetes.io/projected/8c282ee8-f3d0-4043-b798-cebd43900b30-kube-api-access-tzdth\") pod \"8c282ee8-f3d0-4043-b798-cebd43900b30\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") "
Nov 02 22:25:21.173055 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.172984    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c282ee8-f3d0-4043-b798-cebd43900b30-istiod-ca-cert" pod "8c282ee8-f3d0-4043-b798-cebd43900b30" (UID: "8c282ee8-f3d0-4043-b798-cebd43900b30"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:25:21.173332 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.173310    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-podinfo\") pod \"8c282ee8-f3d0-4043-b798-cebd43900b30\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") "
Nov 02 22:25:21.173508 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.173492    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-envoy\") pod \"8c282ee8-f3d0-4043-b798-cebd43900b30\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") "
Nov 02 22:25:21.173887 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.173526    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-token\" (UniqueName: \"kubernetes.io/projected/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-token\") pod \"8c282ee8-f3d0-4043-b798-cebd43900b30\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") "
Nov 02 22:25:21.175846 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.175822    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-data\") pod \"8c282ee8-f3d0-4043-b798-cebd43900b30\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") "
Nov 02 22:25:21.175991 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.175897    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-workload-socket\") pod \"8c282ee8-f3d0-4043-b798-cebd43900b30\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") "
Nov 02 22:25:21.176057 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.176019    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-workload-certs\") pod \"8c282ee8-f3d0-4043-b798-cebd43900b30\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") "
Nov 02 22:25:21.176121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.176091    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-credential-socket\") pod \"8c282ee8-f3d0-4043-b798-cebd43900b30\" (UID: \"8c282ee8-f3d0-4043-b798-cebd43900b30\") "
Nov 02 22:25:21.177201 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.176399    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-workload-certs" pod "8c282ee8-f3d0-4043-b798-cebd43900b30" (UID: "8c282ee8-f3d0-4043-b798-cebd43900b30"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:21.177201 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.176569    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-data" pod "8c282ee8-f3d0-4043-b798-cebd43900b30" (UID: "8c282ee8-f3d0-4043-b798-cebd43900b30"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:21.177201 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.176781    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-credential-socket" pod "8c282ee8-f3d0-4043-b798-cebd43900b30" (UID: "8c282ee8-f3d0-4043-b798-cebd43900b30"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:21.177201 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.177110    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:21.177201 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.177132    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c282ee8-f3d0-4043-b798-cebd43900b30-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:21.177201 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.177160    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:21.177201 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.177177    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:21.178032 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.178011    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-workload-socket" pod "8c282ee8-f3d0-4043-b798-cebd43900b30" (UID: "8c282ee8-f3d0-4043-b798-cebd43900b30"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:21.178791 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.178762    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-token" pod "8c282ee8-f3d0-4043-b798-cebd43900b30" (UID: "8c282ee8-f3d0-4043-b798-cebd43900b30"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:21.179178 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.179153    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-envoy" pod "8c282ee8-f3d0-4043-b798-cebd43900b30" (UID: "8c282ee8-f3d0-4043-b798-cebd43900b30"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:21.192846 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.192820    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c282ee8-f3d0-4043-b798-cebd43900b30-kube-api-access-tzdth" pod "8c282ee8-f3d0-4043-b798-cebd43900b30" (UID: "8c282ee8-f3d0-4043-b798-cebd43900b30"). InnerVolumeSpecName "kube-api-access-tzdth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:21.194540 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.194513    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-podinfo" pod "8c282ee8-f3d0-4043-b798-cebd43900b30" (UID: "8c282ee8-f3d0-4043-b798-cebd43900b30"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:25:21.279285 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.279249    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:21.279285 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.279279    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:21.279285 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.279290    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c282ee8-f3d0-4043-b798-cebd43900b30-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:21.279726 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.279301    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzdth\" (UniqueName: \"kubernetes.io/projected/8c282ee8-f3d0-4043-b798-cebd43900b30-kube-api-access-tzdth\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:21.279726 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.279312    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c282ee8-f3d0-4043-b798-cebd43900b30-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:21.600948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.600846    5076 generic.go:356] "Generic (PLEG): container finished" podID="8c282ee8-f3d0-4043-b798-cebd43900b30" containerID="fc3ae2b5fc6c5f1cde936a8b0d14aa5498bf245b2e1912b64077f6f1d2d76f4f" exitCode=0
Nov 02 22:25:21.600948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.600912    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"
Nov 02 22:25:21.600948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.600932    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb" event={"ID":"8c282ee8-f3d0-4043-b798-cebd43900b30","Type":"ContainerDied","Data":"fc3ae2b5fc6c5f1cde936a8b0d14aa5498bf245b2e1912b64077f6f1d2d76f4f"}
Nov 02 22:25:21.601374 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.600995    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb" event={"ID":"8c282ee8-f3d0-4043-b798-cebd43900b30","Type":"ContainerDied","Data":"ae6c3b6acc8ce8e0fb72e2d74e66835e38606945a47d62af79a6d59f03c4b075"}
Nov 02 22:25:21.601374 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.601036    5076 scope.go:122] "RemoveContainer" containerID="fc3ae2b5fc6c5f1cde936a8b0d14aa5498bf245b2e1912b64077f6f1d2d76f4f"
Nov 02 22:25:21.613827 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.613802    5076 scope.go:122] "RemoveContainer" containerID="fc3ae2b5fc6c5f1cde936a8b0d14aa5498bf245b2e1912b64077f6f1d2d76f4f"
Nov 02 22:25:21.614148 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:25:21.614119    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc3ae2b5fc6c5f1cde936a8b0d14aa5498bf245b2e1912b64077f6f1d2d76f4f\": container with ID starting with fc3ae2b5fc6c5f1cde936a8b0d14aa5498bf245b2e1912b64077f6f1d2d76f4f not found: ID does not exist" containerID="fc3ae2b5fc6c5f1cde936a8b0d14aa5498bf245b2e1912b64077f6f1d2d76f4f"
Nov 02 22:25:21.614268 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.614158    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc3ae2b5fc6c5f1cde936a8b0d14aa5498bf245b2e1912b64077f6f1d2d76f4f"} err="failed to get container status \"fc3ae2b5fc6c5f1cde936a8b0d14aa5498bf245b2e1912b64077f6f1d2d76f4f\": rpc error: code = NotFound desc = could not find container \"fc3ae2b5fc6c5f1cde936a8b0d14aa5498bf245b2e1912b64077f6f1d2d76f4f\": container with ID starting with fc3ae2b5fc6c5f1cde936a8b0d14aa5498bf245b2e1912b64077f6f1d2d76f4f not found: ID does not exist"
Nov 02 22:25:21.634576 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.634553    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"]
Nov 02 22:25:21.641623 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.641573    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-mhjzb"]
Nov 02 22:25:21.845049 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:21.845017    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:22.432171 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:22.432133    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:22.518428 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:22.518359    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:22.609198 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:22.609099    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:23.055287 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:23.055198    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8c282ee8-f3d0-4043-b798-cebd43900b30" path="/var/lib/kubelet/pods/8c282ee8-f3d0-4043-b798-cebd43900b30/volumes"
Nov 02 22:25:23.278016 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:23.277971    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:23.377010 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:23.376975    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:23.487250 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:23.486801    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:24.007646 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.007611    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:24.308175 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308102    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"]
Nov 02 22:25:24.308722 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308707    5076 cpu_manager.go:414] "containerMap: removing container" podUID="529b113f-33b4-437c-80e2-6ce54f2ad4be" containerName="istio-proxy"
Nov 02 22:25:24.308768 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308724    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="529b113f-33b4-437c-80e2-6ce54f2ad4be" containerName="istio-proxy"
Nov 02 22:25:24.308768 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308736    5076 cpu_manager.go:414] "containerMap: removing container" podUID="3f07035a-2595-4005-8d5b-bfebe3775611" containerName="istio-proxy"
Nov 02 22:25:24.308768 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308744    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3f07035a-2595-4005-8d5b-bfebe3775611" containerName="istio-proxy"
Nov 02 22:25:24.308865 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308770    5076 cpu_manager.go:414] "containerMap: removing container" podUID="8c282ee8-f3d0-4043-b798-cebd43900b30" containerName="istio-proxy"
Nov 02 22:25:24.308865 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308776    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c282ee8-f3d0-4043-b798-cebd43900b30" containerName="istio-proxy"
Nov 02 22:25:24.308865 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308785    5076 cpu_manager.go:414] "containerMap: removing container" podUID="0d8408b1-b83c-4a50-a207-714eca0f1b7b" containerName="istio-proxy"
Nov 02 22:25:24.308865 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308789    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0d8408b1-b83c-4a50-a207-714eca0f1b7b" containerName="istio-proxy"
Nov 02 22:25:24.308865 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308800    5076 cpu_manager.go:414] "containerMap: removing container" podUID="31c47ce5-da96-4582-a8e0-09c5e8aafd4f" containerName="maas-api"
Nov 02 22:25:24.308865 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308805    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="31c47ce5-da96-4582-a8e0-09c5e8aafd4f" containerName="maas-api"
Nov 02 22:25:24.308865 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308813    5076 cpu_manager.go:414] "containerMap: removing container" podUID="39e7bfaa-9013-4559-9e7e-d985fd896011" containerName="main"
Nov 02 22:25:24.308865 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308817    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="39e7bfaa-9013-4559-9e7e-d985fd896011" containerName="main"
Nov 02 22:25:24.308865 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308826    5076 cpu_manager.go:414] "containerMap: removing container" podUID="ec87244f-5ca4-4986-b922-a02136cb4164" containerName="maas-api"
Nov 02 22:25:24.308865 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308830    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ec87244f-5ca4-4986-b922-a02136cb4164" containerName="maas-api"
Nov 02 22:25:24.308865 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308849    5076 cpu_manager.go:414] "containerMap: removing container" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main"
Nov 02 22:25:24.308865 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308853    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main"
Nov 02 22:25:24.309204 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308926    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="d608bfbf-7412-42a9-9fb7-52c2309ab511" containerName="main"
Nov 02 22:25:24.309204 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308938    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="529b113f-33b4-437c-80e2-6ce54f2ad4be" containerName="istio-proxy"
Nov 02 22:25:24.309204 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308943    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="3f07035a-2595-4005-8d5b-bfebe3775611" containerName="istio-proxy"
Nov 02 22:25:24.309204 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308952    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="8c282ee8-f3d0-4043-b798-cebd43900b30" containerName="istio-proxy"
Nov 02 22:25:24.309204 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308957    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="0d8408b1-b83c-4a50-a207-714eca0f1b7b" containerName="istio-proxy"
Nov 02 22:25:24.309204 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308963    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="31c47ce5-da96-4582-a8e0-09c5e8aafd4f" containerName="maas-api"
Nov 02 22:25:24.309204 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308968    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="39e7bfaa-9013-4559-9e7e-d985fd896011" containerName="main"
Nov 02 22:25:24.309204 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.308974    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="ec87244f-5ca4-4986-b922-a02136cb4164" containerName="maas-api"
Nov 02 22:25:24.313400 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.313378    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.318709 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.318691    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a54217-openshift-default-dockercfg-7tr9f\""
Nov 02 22:25:24.324255 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.324200    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"]
Nov 02 22:25:24.440948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.440910    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-podinfo\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.441140 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.440966    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nt4w\" (UniqueName: \"kubernetes.io/projected/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-kube-api-access-2nt4w\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.441140 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.441047    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-workload-certs\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.441140 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.441089    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-envoy\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.441338 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.441172    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-token\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.441338 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.441229    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-workload-socket\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.441450 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.441359    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istiod-ca-cert\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.441450 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.441400    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-data\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.441583 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.441566    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-credential-socket\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.543114 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.543079    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-workload-socket\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.543612 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.543142    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istiod-ca-cert\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.543612 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.543173    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-data\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.543612 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.543283    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-credential-socket\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.543612 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.543396    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-podinfo\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.543612 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.543434    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nt4w\" (UniqueName: \"kubernetes.io/projected/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-kube-api-access-2nt4w\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.543612 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.543465    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-workload-certs\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.543612 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.543496    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-envoy\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.543612 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.543538    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-token\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.544081 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.543614    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-data\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.544081 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.543710    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-credential-socket\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.544081 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.543963    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-workload-certs\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.544081 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.544036    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istiod-ca-cert\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.544081 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.544072    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-workload-socket\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.545774 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.545756    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-envoy\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.545919 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.545901    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-podinfo\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.551086 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.551066    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-token\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.551392 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.551372    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nt4w\" (UniqueName: \"kubernetes.io/projected/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-kube-api-access-2nt4w\") pod \"e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") " pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.647706 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.647676    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:24.688686 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.688645    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:24.935321 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.935291    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"]
Nov 02 22:25:24.938047 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.938010    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:25:24.938143 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.938093    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:25:24.938143 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:24.938134    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:25:25.373564 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:25.373529    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:25.661256 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:25.661201    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7" event={"ID":"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7","Type":"ContainerStarted","Data":"4360171f0902dd2cf202142cba7455df204a409ecaf5569ab63342933e9720de"}
Nov 02 22:25:25.661636 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:25.661313    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7" event={"ID":"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7","Type":"ContainerStarted","Data":"6e93c1db43b7d977513b88c80b6ccabad476495dde6f2bf30b6177ccc14341bb"}
Nov 02 22:25:25.947344 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:25.947313    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:25:25.998278 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:25.987403    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:25:26.006456 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.006197    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7" podStartSLOduration=2.006180034 podStartE2EDuration="2.006180034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:25:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:25:25.696797255 +0000 UTC m=+1634.753131636" watchObservedRunningTime="2026-11-02 22:25:26.006180034 +0000 UTC m=+1635.062514414"
Nov 02 22:25:26.021798 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.020659    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-credential-socket\") pod \"c9896887-2ff5-4567-a650-6de8c5f25135\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") "
Nov 02 22:25:26.021798 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.020720    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-istio-envoy\") pod \"c9896887-2ff5-4567-a650-6de8c5f25135\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") "
Nov 02 22:25:26.021798 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.020757    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/35ee896c-9d7e-4b87-aaf7-c000622f208e-kube-api-access-ftfln\" (UniqueName: \"kubernetes.io/projected/35ee896c-9d7e-4b87-aaf7-c000622f208e-kube-api-access-ftfln\") pod \"35ee896c-9d7e-4b87-aaf7-c000622f208e\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") "
Nov 02 22:25:26.021798 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.020799    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-token\" (UniqueName: \"kubernetes.io/projected/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-token\") pod \"35ee896c-9d7e-4b87-aaf7-c000622f208e\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") "
Nov 02 22:25:26.021798 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.020885    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c9896887-2ff5-4567-a650-6de8c5f25135-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9896887-2ff5-4567-a650-6de8c5f25135-istiod-ca-cert\") pod \"c9896887-2ff5-4567-a650-6de8c5f25135\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") "
Nov 02 22:25:26.021798 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.020926    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c9896887-2ff5-4567-a650-6de8c5f25135-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9896887-2ff5-4567-a650-6de8c5f25135-istio-podinfo\") pod \"c9896887-2ff5-4567-a650-6de8c5f25135\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") "
Nov 02 22:25:26.021798 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.021454    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c9896887-2ff5-4567-a650-6de8c5f25135-kube-api-access-zlsl6\" (UniqueName: \"kubernetes.io/projected/c9896887-2ff5-4567-a650-6de8c5f25135-kube-api-access-zlsl6\") pod \"c9896887-2ff5-4567-a650-6de8c5f25135\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") "
Nov 02 22:25:26.021798 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.021576    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c9896887-2ff5-4567-a650-6de8c5f25135-istio-token\" (UniqueName: \"kubernetes.io/projected/c9896887-2ff5-4567-a650-6de8c5f25135-istio-token\") pod \"c9896887-2ff5-4567-a650-6de8c5f25135\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") "
Nov 02 22:25:26.021798 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.021644    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-workload-socket\") pod \"35ee896c-9d7e-4b87-aaf7-c000622f208e\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") "
Nov 02 22:25:26.021798 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.021680    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-workload-socket\") pod \"c9896887-2ff5-4567-a650-6de8c5f25135\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") "
Nov 02 22:25:26.021798 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.021728    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-envoy\") pod \"35ee896c-9d7e-4b87-aaf7-c000622f208e\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") "
Nov 02 22:25:26.021798 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.021756    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-workload-certs\") pod \"35ee896c-9d7e-4b87-aaf7-c000622f208e\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") "
Nov 02 22:25:26.022488 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.021818    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-podinfo\") pod \"35ee896c-9d7e-4b87-aaf7-c000622f208e\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") "
Nov 02 22:25:26.022488 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.021867    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-istio-data\") pod \"c9896887-2ff5-4567-a650-6de8c5f25135\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") "
Nov 02 22:25:26.022488 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.021902    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/35ee896c-9d7e-4b87-aaf7-c000622f208e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35ee896c-9d7e-4b87-aaf7-c000622f208e-istiod-ca-cert\") pod \"35ee896c-9d7e-4b87-aaf7-c000622f208e\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") "
Nov 02 22:25:26.022488 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.022002    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-workload-certs\") pod \"c9896887-2ff5-4567-a650-6de8c5f25135\" (UID: \"c9896887-2ff5-4567-a650-6de8c5f25135\") "
Nov 02 22:25:26.022488 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.022035    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-data\") pod \"35ee896c-9d7e-4b87-aaf7-c000622f208e\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") "
Nov 02 22:25:26.022488 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.022086    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-credential-socket\") pod \"35ee896c-9d7e-4b87-aaf7-c000622f208e\" (UID: \"35ee896c-9d7e-4b87-aaf7-c000622f208e\") "
Nov 02 22:25:26.022488 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.022264    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-workload-certs" pod "35ee896c-9d7e-4b87-aaf7-c000622f208e" (UID: "35ee896c-9d7e-4b87-aaf7-c000622f208e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:26.022488 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.022436    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-workload-socket" pod "c9896887-2ff5-4567-a650-6de8c5f25135" (UID: "c9896887-2ff5-4567-a650-6de8c5f25135"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:26.022897 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.022630    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-credential-socket" pod "c9896887-2ff5-4567-a650-6de8c5f25135" (UID: "c9896887-2ff5-4567-a650-6de8c5f25135"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:26.022897 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.022789    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-workload-socket" pod "35ee896c-9d7e-4b87-aaf7-c000622f208e" (UID: "35ee896c-9d7e-4b87-aaf7-c000622f208e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:26.024068 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.022721    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35ee896c-9d7e-4b87-aaf7-c000622f208e-istiod-ca-cert" pod "35ee896c-9d7e-4b87-aaf7-c000622f208e" (UID: "35ee896c-9d7e-4b87-aaf7-c000622f208e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:25:26.024068 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.023389    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-istio-data" pod "c9896887-2ff5-4567-a650-6de8c5f25135" (UID: "c9896887-2ff5-4567-a650-6de8c5f25135"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:26.024068 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.023590    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-workload-certs" pod "c9896887-2ff5-4567-a650-6de8c5f25135" (UID: "c9896887-2ff5-4567-a650-6de8c5f25135"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:26.024068 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.023803    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-credential-socket" pod "35ee896c-9d7e-4b87-aaf7-c000622f208e" (UID: "35ee896c-9d7e-4b87-aaf7-c000622f208e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:26.024489 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.024092    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:26.024489 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.024122    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:26.024489 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.024137    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:26.024489 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.024150    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:26.024489 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.024164    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35ee896c-9d7e-4b87-aaf7-c000622f208e-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:26.024489 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.024177    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:26.024489 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.024190    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:26.024489 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.024204    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:26.024489 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.024432    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-data" pod "35ee896c-9d7e-4b87-aaf7-c000622f208e" (UID: "35ee896c-9d7e-4b87-aaf7-c000622f208e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:26.024932 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.024843    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-envoy" pod "35ee896c-9d7e-4b87-aaf7-c000622f208e" (UID: "35ee896c-9d7e-4b87-aaf7-c000622f208e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:26.025074 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.025028    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-podinfo" pod "35ee896c-9d7e-4b87-aaf7-c000622f208e" (UID: "35ee896c-9d7e-4b87-aaf7-c000622f208e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:25:26.025444 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.025417    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9896887-2ff5-4567-a650-6de8c5f25135-istiod-ca-cert" pod "c9896887-2ff5-4567-a650-6de8c5f25135" (UID: "c9896887-2ff5-4567-a650-6de8c5f25135"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:25:26.025947 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.025770    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-token" pod "35ee896c-9d7e-4b87-aaf7-c000622f208e" (UID: "35ee896c-9d7e-4b87-aaf7-c000622f208e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:26.025947 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.025904    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35ee896c-9d7e-4b87-aaf7-c000622f208e-kube-api-access-ftfln" pod "35ee896c-9d7e-4b87-aaf7-c000622f208e" (UID: "35ee896c-9d7e-4b87-aaf7-c000622f208e"). InnerVolumeSpecName "kube-api-access-ftfln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:26.026118 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.025962    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c9896887-2ff5-4567-a650-6de8c5f25135-istio-podinfo" pod "c9896887-2ff5-4567-a650-6de8c5f25135" (UID: "c9896887-2ff5-4567-a650-6de8c5f25135"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:25:26.027043 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.027021    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9896887-2ff5-4567-a650-6de8c5f25135-kube-api-access-zlsl6" pod "c9896887-2ff5-4567-a650-6de8c5f25135" (UID: "c9896887-2ff5-4567-a650-6de8c5f25135"). InnerVolumeSpecName "kube-api-access-zlsl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:26.027178 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.027158    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9896887-2ff5-4567-a650-6de8c5f25135-istio-token" pod "c9896887-2ff5-4567-a650-6de8c5f25135" (UID: "c9896887-2ff5-4567-a650-6de8c5f25135"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:26.028038 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.027780    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-istio-envoy" pod "c9896887-2ff5-4567-a650-6de8c5f25135" (UID: "c9896887-2ff5-4567-a650-6de8c5f25135"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:26.125252 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.125187    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9896887-2ff5-4567-a650-6de8c5f25135-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:26.125252 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.125247    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:26.125252 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.125260    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:26.125507 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.125271    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:26.125507 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.125279    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9896887-2ff5-4567-a650-6de8c5f25135-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:26.125507 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.125288    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftfln\" (UniqueName: \"kubernetes.io/projected/35ee896c-9d7e-4b87-aaf7-c000622f208e-kube-api-access-ftfln\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:26.125507 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.125297    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35ee896c-9d7e-4b87-aaf7-c000622f208e-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:26.125507 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.125305    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9896887-2ff5-4567-a650-6de8c5f25135-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:26.125507 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.125313    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9896887-2ff5-4567-a650-6de8c5f25135-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:26.125507 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.125321    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlsl6\" (UniqueName: \"kubernetes.io/projected/c9896887-2ff5-4567-a650-6de8c5f25135-kube-api-access-zlsl6\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:26.197416 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.197322    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:26.648292 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.648259    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:26.649701 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.649661    5076 patch_prober.go:29] interesting pod/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Nov 02 22:25:26.649701 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.649717    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7" podUID="a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Nov 02 22:25:26.679250 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.678356    5076 generic.go:356] "Generic (PLEG): container finished" podID="35ee896c-9d7e-4b87-aaf7-c000622f208e" containerID="7d983c87ec5c15a8cb437d24a297d67b255a033d1f376539e0eaaabb64877aa9" exitCode=0
Nov 02 22:25:26.679250 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.678519    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v" event={"ID":"35ee896c-9d7e-4b87-aaf7-c000622f208e","Type":"ContainerDied","Data":"7d983c87ec5c15a8cb437d24a297d67b255a033d1f376539e0eaaabb64877aa9"}
Nov 02 22:25:26.679250 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.678570    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v" event={"ID":"35ee896c-9d7e-4b87-aaf7-c000622f208e","Type":"ContainerDied","Data":"2254f5288f27844eed55f5f3b538c98daec97bffb97d3759169450a31fdf6c33"}
Nov 02 22:25:26.679250 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.678608    5076 scope.go:122] "RemoveContainer" containerID="7d983c87ec5c15a8cb437d24a297d67b255a033d1f376539e0eaaabb64877aa9"
Nov 02 22:25:26.679250 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.678775    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"
Nov 02 22:25:26.694303 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.687131    5076 generic.go:356] "Generic (PLEG): container finished" podID="c9896887-2ff5-4567-a650-6de8c5f25135" containerID="9a8a06493d2df85184c08c830ed49d4e0e35f8a02781406db93779584a25116d" exitCode=0
Nov 02 22:25:26.694303 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.688102    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"
Nov 02 22:25:26.699310 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.696628    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm" event={"ID":"c9896887-2ff5-4567-a650-6de8c5f25135","Type":"ContainerDied","Data":"9a8a06493d2df85184c08c830ed49d4e0e35f8a02781406db93779584a25116d"}
Nov 02 22:25:26.699310 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.696689    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm" event={"ID":"c9896887-2ff5-4567-a650-6de8c5f25135","Type":"ContainerDied","Data":"06e0d28a48ade01678a5fef6c397e183b6d886bc5efcc1955617e3b2a5543cf0"}
Nov 02 22:25:26.705168 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.705145    5076 scope.go:122] "RemoveContainer" containerID="7d983c87ec5c15a8cb437d24a297d67b255a033d1f376539e0eaaabb64877aa9"
Nov 02 22:25:26.705555 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:25:26.705529    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d983c87ec5c15a8cb437d24a297d67b255a033d1f376539e0eaaabb64877aa9\": container with ID starting with 7d983c87ec5c15a8cb437d24a297d67b255a033d1f376539e0eaaabb64877aa9 not found: ID does not exist" containerID="7d983c87ec5c15a8cb437d24a297d67b255a033d1f376539e0eaaabb64877aa9"
Nov 02 22:25:26.705671 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.705569    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d983c87ec5c15a8cb437d24a297d67b255a033d1f376539e0eaaabb64877aa9"} err="failed to get container status \"7d983c87ec5c15a8cb437d24a297d67b255a033d1f376539e0eaaabb64877aa9\": rpc error: code = NotFound desc = could not find container \"7d983c87ec5c15a8cb437d24a297d67b255a033d1f376539e0eaaabb64877aa9\": container with ID starting with 7d983c87ec5c15a8cb437d24a297d67b255a033d1f376539e0eaaabb64877aa9 not found: ID does not exist"
Nov 02 22:25:26.705671 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.705593    5076 scope.go:122] "RemoveContainer" containerID="9a8a06493d2df85184c08c830ed49d4e0e35f8a02781406db93779584a25116d"
Nov 02 22:25:26.720826 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.720630    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"]
Nov 02 22:25:26.720826 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.720672    5076 scope.go:122] "RemoveContainer" containerID="9a8a06493d2df85184c08c830ed49d4e0e35f8a02781406db93779584a25116d"
Nov 02 22:25:26.720997 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:25:26.720981    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a8a06493d2df85184c08c830ed49d4e0e35f8a02781406db93779584a25116d\": container with ID starting with 9a8a06493d2df85184c08c830ed49d4e0e35f8a02781406db93779584a25116d not found: ID does not exist" containerID="9a8a06493d2df85184c08c830ed49d4e0e35f8a02781406db93779584a25116d"
Nov 02 22:25:26.721043 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.721006    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a8a06493d2df85184c08c830ed49d4e0e35f8a02781406db93779584a25116d"} err="failed to get container status \"9a8a06493d2df85184c08c830ed49d4e0e35f8a02781406db93779584a25116d\": rpc error: code = NotFound desc = could not find container \"9a8a06493d2df85184c08c830ed49d4e0e35f8a02781406db93779584a25116d\": container with ID starting with 9a8a06493d2df85184c08c830ed49d4e0e35f8a02781406db93779584a25116d not found: ID does not exist"
Nov 02 22:25:26.727742 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.727718    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-ql78v"]
Nov 02 22:25:26.738785 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.738627    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"]
Nov 02 22:25:26.742440 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.742420    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-e49edd-openshift-default-8486ddd84c-nchcm"]
Nov 02 22:25:26.989240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:26.988819    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:27.055093 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:27.055060    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="35ee896c-9d7e-4b87-aaf7-c000622f208e" path="/var/lib/kubelet/pods/35ee896c-9d7e-4b87-aaf7-c000622f208e/volumes"
Nov 02 22:25:27.055588 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:27.055573    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c9896887-2ff5-4567-a650-6de8c5f25135" path="/var/lib/kubelet/pods/c9896887-2ff5-4567-a650-6de8c5f25135/volumes"
Nov 02 22:25:27.404687 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:27.404650    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"]
Nov 02 22:25:27.404928 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:27.404896    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4" podUID="065ff515-e8ec-4d5d-9bc4-161017ebc705" containerName="maas-api" containerID="cri-o://3d5b9d30c00caca83a825233320f350e49a70dc5a7a973c0eb06ddfd3d32c693" gracePeriod=30
Nov 02 22:25:27.452083 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:27.452047    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:27.622943 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:27.622909    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:27.663128 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:27.663046    5076 patch_prober.go:29] interesting pod/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Nov 02 22:25:27.665476 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:27.665442    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7" podUID="a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Nov 02 22:25:27.744896 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:27.740476    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:27.904366 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:27.904184    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:28.196646 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.196569    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:28.205319 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.205292    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"
Nov 02 22:25:28.299895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.299802    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/065ff515-e8ec-4d5d-9bc4-161017ebc705-kube-api-access-fs4gs\" (UniqueName: \"kubernetes.io/projected/065ff515-e8ec-4d5d-9bc4-161017ebc705-kube-api-access-fs4gs\") pod \"065ff515-e8ec-4d5d-9bc4-161017ebc705\" (UID: \"065ff515-e8ec-4d5d-9bc4-161017ebc705\") "
Nov 02 22:25:28.300179 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.300153    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/065ff515-e8ec-4d5d-9bc4-161017ebc705-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/065ff515-e8ec-4d5d-9bc4-161017ebc705-openshift-service-ca\") pod \"065ff515-e8ec-4d5d-9bc4-161017ebc705\" (UID: \"065ff515-e8ec-4d5d-9bc4-161017ebc705\") "
Nov 02 22:25:28.300383 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.300365    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/065ff515-e8ec-4d5d-9bc4-161017ebc705-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/065ff515-e8ec-4d5d-9bc4-161017ebc705-maas-api-tls\") pod \"065ff515-e8ec-4d5d-9bc4-161017ebc705\" (UID: \"065ff515-e8ec-4d5d-9bc4-161017ebc705\") "
Nov 02 22:25:28.300524 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.300510    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/065ff515-e8ec-4d5d-9bc4-161017ebc705-metrics-certs\" (UniqueName: \"kubernetes.io/secret/065ff515-e8ec-4d5d-9bc4-161017ebc705-metrics-certs\") pod \"065ff515-e8ec-4d5d-9bc4-161017ebc705\" (UID: \"065ff515-e8ec-4d5d-9bc4-161017ebc705\") "
Nov 02 22:25:28.302364 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.302336    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/065ff515-e8ec-4d5d-9bc4-161017ebc705-openshift-service-ca" pod "065ff515-e8ec-4d5d-9bc4-161017ebc705" (UID: "065ff515-e8ec-4d5d-9bc4-161017ebc705"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:25:28.302567 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.302530    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/065ff515-e8ec-4d5d-9bc4-161017ebc705-kube-api-access-fs4gs" pod "065ff515-e8ec-4d5d-9bc4-161017ebc705" (UID: "065ff515-e8ec-4d5d-9bc4-161017ebc705"). InnerVolumeSpecName "kube-api-access-fs4gs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:28.303777 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.303741    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/065ff515-e8ec-4d5d-9bc4-161017ebc705-metrics-certs" pod "065ff515-e8ec-4d5d-9bc4-161017ebc705" (UID: "065ff515-e8ec-4d5d-9bc4-161017ebc705"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:25:28.304534 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.304508    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/065ff515-e8ec-4d5d-9bc4-161017ebc705-maas-api-tls" pod "065ff515-e8ec-4d5d-9bc4-161017ebc705" (UID: "065ff515-e8ec-4d5d-9bc4-161017ebc705"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:25:28.402479 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.402442    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs4gs\" (UniqueName: \"kubernetes.io/projected/065ff515-e8ec-4d5d-9bc4-161017ebc705-kube-api-access-fs4gs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:28.402479 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.402475    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/065ff515-e8ec-4d5d-9bc4-161017ebc705-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:28.402479 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.402486    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/065ff515-e8ec-4d5d-9bc4-161017ebc705-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:28.402726 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.402496    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/065ff515-e8ec-4d5d-9bc4-161017ebc705-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:28.648787 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.648757    5076 patch_prober.go:29] interesting pod/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Nov 02 22:25:28.648963 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.648807    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7" podUID="a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Nov 02 22:25:28.857420 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.857388    5076 generic.go:356] "Generic (PLEG): container finished" podID="065ff515-e8ec-4d5d-9bc4-161017ebc705" containerID="3d5b9d30c00caca83a825233320f350e49a70dc5a7a973c0eb06ddfd3d32c693" exitCode=0
Nov 02 22:25:28.857842 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.857429    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4" event={"ID":"065ff515-e8ec-4d5d-9bc4-161017ebc705","Type":"ContainerDied","Data":"3d5b9d30c00caca83a825233320f350e49a70dc5a7a973c0eb06ddfd3d32c693"}
Nov 02 22:25:28.857842 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.857472    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4" event={"ID":"065ff515-e8ec-4d5d-9bc4-161017ebc705","Type":"ContainerDied","Data":"4193cd481948d81cb4a839546aa6bff266e438ba49aef8cd58a6caad886c098d"}
Nov 02 22:25:28.857842 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.857493    5076 scope.go:122] "RemoveContainer" containerID="3d5b9d30c00caca83a825233320f350e49a70dc5a7a973c0eb06ddfd3d32c693"
Nov 02 22:25:28.857842 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.857432    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"
Nov 02 22:25:28.881750 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.880438    5076 scope.go:122] "RemoveContainer" containerID="3d5b9d30c00caca83a825233320f350e49a70dc5a7a973c0eb06ddfd3d32c693"
Nov 02 22:25:28.881750 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:25:28.881557    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d5b9d30c00caca83a825233320f350e49a70dc5a7a973c0eb06ddfd3d32c693\": container with ID starting with 3d5b9d30c00caca83a825233320f350e49a70dc5a7a973c0eb06ddfd3d32c693 not found: ID does not exist" containerID="3d5b9d30c00caca83a825233320f350e49a70dc5a7a973c0eb06ddfd3d32c693"
Nov 02 22:25:28.881750 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.881600    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d5b9d30c00caca83a825233320f350e49a70dc5a7a973c0eb06ddfd3d32c693"} err="failed to get container status \"3d5b9d30c00caca83a825233320f350e49a70dc5a7a973c0eb06ddfd3d32c693\": rpc error: code = NotFound desc = could not find container \"3d5b9d30c00caca83a825233320f350e49a70dc5a7a973c0eb06ddfd3d32c693\": container with ID starting with 3d5b9d30c00caca83a825233320f350e49a70dc5a7a973c0eb06ddfd3d32c693 not found: ID does not exist"
Nov 02 22:25:28.897252 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.897184    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"]
Nov 02 22:25:28.902153 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.902096    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e30968-6f8b8b85d5-jqtm4"]
Nov 02 22:25:28.917973 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:28.917942    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:29.016605 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:29.016565    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:29.057011 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:29.056969    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="065ff515-e8ec-4d5d-9bc4-161017ebc705" path="/var/lib/kubelet/pods/065ff515-e8ec-4d5d-9bc4-161017ebc705/volumes"
Nov 02 22:25:29.649003 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:29.648968    5076 patch_prober.go:29] interesting pod/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Nov 02 22:25:29.649173 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:29.649023    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7" podUID="a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Nov 02 22:25:29.924066 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:25:29.923260    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:25:30.064613 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:30.064579    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:30.648374 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:30.648333    5076 patch_prober.go:29] interesting pod/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Nov 02 22:25:30.648560 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:30.648393    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7" podUID="a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Nov 02 22:25:30.847204 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:30.845547    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:31.150239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:31.145897    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:31.244240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:31.234397    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:31.433967 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:31.433876    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:31.533643 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:31.533598    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:31.638238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:31.635895    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:31.657240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:31.649572    5076 patch_prober.go:29] interesting pod/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Nov 02 22:25:31.657240 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:31.649629    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7" podUID="a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Nov 02 22:25:31.734293 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:31.733677    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:32.653348 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:32.653320    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:32.653763 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:32.653715    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:32.654467 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:32.654447    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:32.681722 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:32.681685    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:32.895446 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:32.895395    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn" podUID="a35fda59-30bb-45f0-b723-a917027ad697" containerName="main" containerID="cri-o://b700c6012b7616ca57f154632706035b5dbc03edc8141281460fa49c41e02d9c" gracePeriod=45
Nov 02 22:25:33.203349 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.203319    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:25:33.228900 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.228868    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-dshm\" (UniqueName: \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-dshm\") pod \"a35fda59-30bb-45f0-b723-a917027ad697\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") "
Nov 02 22:25:33.229077 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.228939    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a35fda59-30bb-45f0-b723-a917027ad697-kube-api-access-sjzjp\" (UniqueName: \"kubernetes.io/projected/a35fda59-30bb-45f0-b723-a917027ad697-kube-api-access-sjzjp\") pod \"a35fda59-30bb-45f0-b723-a917027ad697\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") "
Nov 02 22:25:33.229169 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.229125    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-tmp-dir\") pod \"a35fda59-30bb-45f0-b723-a917027ad697\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") "
Nov 02 22:25:33.229276 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.229194    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-home\" (UniqueName: \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-home\") pod \"a35fda59-30bb-45f0-b723-a917027ad697\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") "
Nov 02 22:25:33.229349 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.229276    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a35fda59-30bb-45f0-b723-a917027ad697-tls-certs\" (UniqueName: \"kubernetes.io/secret/a35fda59-30bb-45f0-b723-a917027ad697-tls-certs\") pod \"a35fda59-30bb-45f0-b723-a917027ad697\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") "
Nov 02 22:25:33.229349 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.229330    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-model-cache\") pod \"a35fda59-30bb-45f0-b723-a917027ad697\" (UID: \"a35fda59-30bb-45f0-b723-a917027ad697\") "
Nov 02 22:25:33.229580 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.229555    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-home" pod "a35fda59-30bb-45f0-b723-a917027ad697" (UID: "a35fda59-30bb-45f0-b723-a917027ad697"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:33.229740 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.229720    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-model-cache" pod "a35fda59-30bb-45f0-b723-a917027ad697" (UID: "a35fda59-30bb-45f0-b723-a917027ad697"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:33.229922 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.229901    5076 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-home\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:33.229922 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.229921    5076 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-model-cache\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:33.230170 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.230142    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-tmp-dir" pod "a35fda59-30bb-45f0-b723-a917027ad697" (UID: "a35fda59-30bb-45f0-b723-a917027ad697"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:33.236699 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.236670    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a35fda59-30bb-45f0-b723-a917027ad697-kube-api-access-sjzjp" pod "a35fda59-30bb-45f0-b723-a917027ad697" (UID: "a35fda59-30bb-45f0-b723-a917027ad697"). InnerVolumeSpecName "kube-api-access-sjzjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:33.241669 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.241633    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-dshm" pod "a35fda59-30bb-45f0-b723-a917027ad697" (UID: "a35fda59-30bb-45f0-b723-a917027ad697"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:33.241669 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.241655    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a35fda59-30bb-45f0-b723-a917027ad697-tls-certs" pod "a35fda59-30bb-45f0-b723-a917027ad697" (UID: "a35fda59-30bb-45f0-b723-a917027ad697"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:25:33.331809 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.331772    5076 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a35fda59-30bb-45f0-b723-a917027ad697-tls-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:33.331809 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.331809    5076 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-dshm\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:33.332015 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.331823    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjzjp\" (UniqueName: \"kubernetes.io/projected/a35fda59-30bb-45f0-b723-a917027ad697-kube-api-access-sjzjp\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:33.332015 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.331836    5076 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a35fda59-30bb-45f0-b723-a917027ad697-tmp-dir\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:33.560614 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.558771    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:33.963420 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.963380    5076 generic.go:356] "Generic (PLEG): container finished" podID="a35fda59-30bb-45f0-b723-a917027ad697" containerID="b700c6012b7616ca57f154632706035b5dbc03edc8141281460fa49c41e02d9c" exitCode=0
Nov 02 22:25:33.963871 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.963458    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"
Nov 02 22:25:33.963871 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.963472    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn" event={"ID":"a35fda59-30bb-45f0-b723-a917027ad697","Type":"ContainerDied","Data":"b700c6012b7616ca57f154632706035b5dbc03edc8141281460fa49c41e02d9c"}
Nov 02 22:25:33.963871 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.963531    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn" event={"ID":"a35fda59-30bb-45f0-b723-a917027ad697","Type":"ContainerDied","Data":"70a2f24a7ba01be919344686f1b5d57dd034dc686e6f0a3e09763f9da06356f2"}
Nov 02 22:25:33.963871 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.963550    5076 scope.go:122] "RemoveContainer" containerID="b700c6012b7616ca57f154632706035b5dbc03edc8141281460fa49c41e02d9c"
Nov 02 22:25:33.974210 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.974193    5076 scope.go:122] "RemoveContainer" containerID="b700c6012b7616ca57f154632706035b5dbc03edc8141281460fa49c41e02d9c"
Nov 02 22:25:33.974658 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:25:33.974630    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b700c6012b7616ca57f154632706035b5dbc03edc8141281460fa49c41e02d9c\": container with ID starting with b700c6012b7616ca57f154632706035b5dbc03edc8141281460fa49c41e02d9c not found: ID does not exist" containerID="b700c6012b7616ca57f154632706035b5dbc03edc8141281460fa49c41e02d9c"
Nov 02 22:25:33.974730 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.974668    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b700c6012b7616ca57f154632706035b5dbc03edc8141281460fa49c41e02d9c"} err="failed to get container status \"b700c6012b7616ca57f154632706035b5dbc03edc8141281460fa49c41e02d9c\": rpc error: code = NotFound desc = could not find container \"b700c6012b7616ca57f154632706035b5dbc03edc8141281460fa49c41e02d9c\": container with ID starting with b700c6012b7616ca57f154632706035b5dbc03edc8141281460fa49c41e02d9c not found: ID does not exist"
Nov 02 22:25:33.987847 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.987825    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"]
Nov 02 22:25:33.991003 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:33.990983    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn"]
Nov 02 22:25:34.180359 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:34.180307    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-inf-a-d28bd1/test-model-d28bd1-kserve-55598f9cd5-hddqn" podUID="a35fda59-30bb-45f0-b723-a917027ad697" containerName="main" probeResult="failure" output="Get \"https://10.132.0.123:8000/ready\": context deadline exceeded"
Nov 02 22:25:34.401358 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:34.401320    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:34.600592 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:34.600553    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:34.701874 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:34.701776    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:34.919504 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:34.919467    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:35.126247 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:35.124504    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a35fda59-30bb-45f0-b723-a917027ad697" path="/var/lib/kubelet/pods/a35fda59-30bb-45f0-b723-a917027ad697/volumes"
Nov 02 22:25:35.164282 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:35.164252    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:36.250248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:36.250181    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:36.941296 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:36.932677    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"]
Nov 02 22:25:36.941296 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:36.932943    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7" podUID="a3737eb7-9ed7-4193-a612-3fb38cade513" containerName="maas-api" containerID="cri-o://c99392105a08dbbcd8674d1ed8f5db485cc4471d77aeeba93af6238a0f62a4a4" gracePeriod=30
Nov 02 22:25:36.973555 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:36.973523    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:37.173283 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:37.169899    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:37.280314 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:37.277906    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:37.506433 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:37.506405    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"
Nov 02 22:25:37.551449 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:37.551358    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:37.672239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:37.670972    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a3737eb7-9ed7-4193-a612-3fb38cade513-kube-api-access-k8wlm\" (UniqueName: \"kubernetes.io/projected/a3737eb7-9ed7-4193-a612-3fb38cade513-kube-api-access-k8wlm\") pod \"a3737eb7-9ed7-4193-a612-3fb38cade513\" (UID: \"a3737eb7-9ed7-4193-a612-3fb38cade513\") "
Nov 02 22:25:37.672239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:37.671047    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a3737eb7-9ed7-4193-a612-3fb38cade513-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3737eb7-9ed7-4193-a612-3fb38cade513-maas-api-tls\") pod \"a3737eb7-9ed7-4193-a612-3fb38cade513\" (UID: \"a3737eb7-9ed7-4193-a612-3fb38cade513\") "
Nov 02 22:25:37.672239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:37.671164    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a3737eb7-9ed7-4193-a612-3fb38cade513-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3737eb7-9ed7-4193-a612-3fb38cade513-metrics-certs\") pod \"a3737eb7-9ed7-4193-a612-3fb38cade513\" (UID: \"a3737eb7-9ed7-4193-a612-3fb38cade513\") "
Nov 02 22:25:37.672239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:37.671289    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a3737eb7-9ed7-4193-a612-3fb38cade513-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3737eb7-9ed7-4193-a612-3fb38cade513-openshift-service-ca\") pod \"a3737eb7-9ed7-4193-a612-3fb38cade513\" (UID: \"a3737eb7-9ed7-4193-a612-3fb38cade513\") "
Nov 02 22:25:37.685599 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:37.685169    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3737eb7-9ed7-4193-a612-3fb38cade513-kube-api-access-k8wlm" pod "a3737eb7-9ed7-4193-a612-3fb38cade513" (UID: "a3737eb7-9ed7-4193-a612-3fb38cade513"). InnerVolumeSpecName "kube-api-access-k8wlm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:37.689639 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:37.686450    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3737eb7-9ed7-4193-a612-3fb38cade513-openshift-service-ca" pod "a3737eb7-9ed7-4193-a612-3fb38cade513" (UID: "a3737eb7-9ed7-4193-a612-3fb38cade513"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:25:37.694272 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:37.694244    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3737eb7-9ed7-4193-a612-3fb38cade513-metrics-certs" pod "a3737eb7-9ed7-4193-a612-3fb38cade513" (UID: "a3737eb7-9ed7-4193-a612-3fb38cade513"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:25:37.695685 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:37.695652    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3737eb7-9ed7-4193-a612-3fb38cade513-maas-api-tls" pod "a3737eb7-9ed7-4193-a612-3fb38cade513" (UID: "a3737eb7-9ed7-4193-a612-3fb38cade513"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:25:37.772837 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:37.772797    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3737eb7-9ed7-4193-a612-3fb38cade513-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:37.773004 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:37.772852    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3737eb7-9ed7-4193-a612-3fb38cade513-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:37.773004 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:37.772869    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8wlm\" (UniqueName: \"kubernetes.io/projected/a3737eb7-9ed7-4193-a612-3fb38cade513-kube-api-access-k8wlm\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:37.773004 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:37.772879    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3737eb7-9ed7-4193-a612-3fb38cade513-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:37.783925 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:37.783894    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:38.000835 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:38.000797    5076 generic.go:356] "Generic (PLEG): container finished" podID="a3737eb7-9ed7-4193-a612-3fb38cade513" containerID="c99392105a08dbbcd8674d1ed8f5db485cc4471d77aeeba93af6238a0f62a4a4" exitCode=0
Nov 02 22:25:38.001004 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:38.000853    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"
Nov 02 22:25:38.001004 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:38.000879    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7" event={"ID":"a3737eb7-9ed7-4193-a612-3fb38cade513","Type":"ContainerDied","Data":"c99392105a08dbbcd8674d1ed8f5db485cc4471d77aeeba93af6238a0f62a4a4"}
Nov 02 22:25:38.001004 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:38.000941    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7" event={"ID":"a3737eb7-9ed7-4193-a612-3fb38cade513","Type":"ContainerDied","Data":"997bf2ea003e5444aa5d2f8f5dc204b433f677d2ea5456f6f91039d88e4f2411"}
Nov 02 22:25:38.001004 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:38.000965    5076 scope.go:122] "RemoveContainer" containerID="c99392105a08dbbcd8674d1ed8f5db485cc4471d77aeeba93af6238a0f62a4a4"
Nov 02 22:25:38.011798 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:38.011777    5076 scope.go:122] "RemoveContainer" containerID="c99392105a08dbbcd8674d1ed8f5db485cc4471d77aeeba93af6238a0f62a4a4"
Nov 02 22:25:38.012072 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:25:38.012052    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c99392105a08dbbcd8674d1ed8f5db485cc4471d77aeeba93af6238a0f62a4a4\": container with ID starting with c99392105a08dbbcd8674d1ed8f5db485cc4471d77aeeba93af6238a0f62a4a4 not found: ID does not exist" containerID="c99392105a08dbbcd8674d1ed8f5db485cc4471d77aeeba93af6238a0f62a4a4"
Nov 02 22:25:38.012154 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:38.012082    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c99392105a08dbbcd8674d1ed8f5db485cc4471d77aeeba93af6238a0f62a4a4"} err="failed to get container status \"c99392105a08dbbcd8674d1ed8f5db485cc4471d77aeeba93af6238a0f62a4a4\": rpc error: code = NotFound desc = could not find container \"c99392105a08dbbcd8674d1ed8f5db485cc4471d77aeeba93af6238a0f62a4a4\": container with ID starting with c99392105a08dbbcd8674d1ed8f5db485cc4471d77aeeba93af6238a0f62a4a4 not found: ID does not exist"
Nov 02 22:25:38.030677 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:38.030650    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"]
Nov 02 22:25:38.033947 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:38.033924    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-df8835-7bbcd554db-jdrw7"]
Nov 02 22:25:38.192118 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:38.192061    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:38.466341 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:38.466299    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:38.566887 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:38.566854    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:38.782662 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:38.782020    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"]
Nov 02 22:25:38.782662 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:38.782286    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7" podUID="a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" containerName="istio-proxy" containerID="cri-o://4360171f0902dd2cf202142cba7455df204a409ecaf5569ab63342933e9720de" gracePeriod=30
Nov 02 22:25:38.820674 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:38.820633    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:38.948455 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:38.948423    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:39.064438 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:39.064233    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a3737eb7-9ed7-4193-a612-3fb38cade513" path="/var/lib/kubelet/pods/a3737eb7-9ed7-4193-a612-3fb38cade513/volumes"
Nov 02 22:25:39.453832 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:39.453794    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:39.553780 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:39.553739    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:39.911379 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:39.911332    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:40.460837 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:40.460802    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"]
Nov 02 22:25:40.461133 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:40.461048    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd" podUID="6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476" containerName="maas-api" containerID="cri-o://1985a17850d5bbac9d3a79eae150856ab110ec278a32020e5122346a8e0fd4c4" gracePeriod=30
Nov 02 22:25:40.530525 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:40.530482    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:40.824735 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:40.824622    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:40.926023 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:40.925982    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:40.996439 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:40.996409    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"
Nov 02 22:25:41.011329 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.011259    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:41.063242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.037792    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-maas-api-tls\") pod \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\" (UID: \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\") "
Nov 02 22:25:41.071494 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.071464    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-openshift-service-ca\") pod \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\" (UID: \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\") "
Nov 02 22:25:41.071733 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.071715    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-kube-api-access-9g5kd\" (UniqueName: \"kubernetes.io/projected/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-kube-api-access-9g5kd\") pod \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\" (UID: \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\") "
Nov 02 22:25:41.071899 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.071869    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-metrics-certs\") pod \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\" (UID: \"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476\") "
Nov 02 22:25:41.087570 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.085306    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-maas-api-tls" pod "6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476" (UID: "6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:25:41.096047 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.096021    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-openshift-service-ca" pod "6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476" (UID: "6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:25:41.099849 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.099757    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-metrics-certs" pod "6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476" (UID: "6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:25:41.101680 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.101654    5076 generic.go:356] "Generic (PLEG): container finished" podID="6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476" containerID="1985a17850d5bbac9d3a79eae150856ab110ec278a32020e5122346a8e0fd4c4" exitCode=0
Nov 02 22:25:41.101889 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.101869    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"
Nov 02 22:25:41.102944 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.102918    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-kube-api-access-9g5kd" pod "6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476" (UID: "6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476"). InnerVolumeSpecName "kube-api-access-9g5kd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:41.103597 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.103571    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd" event={"ID":"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476","Type":"ContainerDied","Data":"1985a17850d5bbac9d3a79eae150856ab110ec278a32020e5122346a8e0fd4c4"}
Nov 02 22:25:41.103699 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.103622    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd" event={"ID":"6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476","Type":"ContainerDied","Data":"a47d49411b2640846f03f577865268029367285e4a1e9d2695094627ad30ab66"}
Nov 02 22:25:41.103699 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.103653    5076 scope.go:122] "RemoveContainer" containerID="1985a17850d5bbac9d3a79eae150856ab110ec278a32020e5122346a8e0fd4c4"
Nov 02 22:25:41.120079 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.120060    5076 scope.go:122] "RemoveContainer" containerID="1985a17850d5bbac9d3a79eae150856ab110ec278a32020e5122346a8e0fd4c4"
Nov 02 22:25:41.120538 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:25:41.120510    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1985a17850d5bbac9d3a79eae150856ab110ec278a32020e5122346a8e0fd4c4\": container with ID starting with 1985a17850d5bbac9d3a79eae150856ab110ec278a32020e5122346a8e0fd4c4 not found: ID does not exist" containerID="1985a17850d5bbac9d3a79eae150856ab110ec278a32020e5122346a8e0fd4c4"
Nov 02 22:25:41.120674 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.120547    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1985a17850d5bbac9d3a79eae150856ab110ec278a32020e5122346a8e0fd4c4"} err="failed to get container status \"1985a17850d5bbac9d3a79eae150856ab110ec278a32020e5122346a8e0fd4c4\": rpc error: code = NotFound desc = could not find container \"1985a17850d5bbac9d3a79eae150856ab110ec278a32020e5122346a8e0fd4c4\": container with ID starting with 1985a17850d5bbac9d3a79eae150856ab110ec278a32020e5122346a8e0fd4c4 not found: ID does not exist"
Nov 02 22:25:41.175041 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.175011    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:41.175041 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.175040    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:41.175257 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.175050    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9g5kd\" (UniqueName: \"kubernetes.io/projected/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-kube-api-access-9g5kd\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:41.175257 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.175061    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:41.364501 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.364467    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:41.428839 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.428799    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"]
Nov 02 22:25:41.441813 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.441774    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d28bd1-55685ffc9f-j5hrd"]
Nov 02 22:25:41.682068 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:41.681986    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:42.282667 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:42.282629    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:42.939361 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:42.939325    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:43.054482 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:43.054448    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476" path="/var/lib/kubelet/pods/6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476/volumes"
Nov 02 22:25:43.598418 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:43.598378    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:44.072003 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.071975    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:44.124234 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.124180    5076 generic.go:356] "Generic (PLEG): container finished" podID="a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" containerID="4360171f0902dd2cf202142cba7455df204a409ecaf5569ab63342933e9720de" exitCode=0
Nov 02 22:25:44.124386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.124259    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"
Nov 02 22:25:44.124386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.124280    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7" event={"ID":"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7","Type":"ContainerDied","Data":"4360171f0902dd2cf202142cba7455df204a409ecaf5569ab63342933e9720de"}
Nov 02 22:25:44.124386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.124366    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7" event={"ID":"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7","Type":"ContainerDied","Data":"6e93c1db43b7d977513b88c80b6ccabad476495dde6f2bf30b6177ccc14341bb"}
Nov 02 22:25:44.124529 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.124416    5076 scope.go:122] "RemoveContainer" containerID="4360171f0902dd2cf202142cba7455df204a409ecaf5569ab63342933e9720de"
Nov 02 22:25:44.136791 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.136768    5076 scope.go:122] "RemoveContainer" containerID="4360171f0902dd2cf202142cba7455df204a409ecaf5569ab63342933e9720de"
Nov 02 22:25:44.137124 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:25:44.137104    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4360171f0902dd2cf202142cba7455df204a409ecaf5569ab63342933e9720de\": container with ID starting with 4360171f0902dd2cf202142cba7455df204a409ecaf5569ab63342933e9720de not found: ID does not exist" containerID="4360171f0902dd2cf202142cba7455df204a409ecaf5569ab63342933e9720de"
Nov 02 22:25:44.137196 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.137133    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4360171f0902dd2cf202142cba7455df204a409ecaf5569ab63342933e9720de"} err="failed to get container status \"4360171f0902dd2cf202142cba7455df204a409ecaf5569ab63342933e9720de\": rpc error: code = NotFound desc = could not find container \"4360171f0902dd2cf202142cba7455df204a409ecaf5569ab63342933e9720de\": container with ID starting with 4360171f0902dd2cf202142cba7455df204a409ecaf5569ab63342933e9720de not found: ID does not exist"
Nov 02 22:25:44.213259 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.213151    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-workload-certs\") pod \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") "
Nov 02 22:25:44.213400 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.213269    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-token\" (UniqueName: \"kubernetes.io/projected/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-token\") pod \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") "
Nov 02 22:25:44.213400 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.213322    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-podinfo\") pod \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") "
Nov 02 22:25:44.213400 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.213378    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-data\") pod \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") "
Nov 02 22:25:44.213592 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.213441    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istiod-ca-cert\") pod \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") "
Nov 02 22:25:44.213592 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.213475    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-workload-certs" pod "a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" (UID: "a7ef9602-dd0b-44fd-b422-d9b6bc0829c7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:44.213592 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.213573    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-envoy\") pod \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") "
Nov 02 22:25:44.213790 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.213632    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-credential-socket\") pod \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") "
Nov 02 22:25:44.213790 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.213684    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-kube-api-access-2nt4w\" (UniqueName: \"kubernetes.io/projected/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-kube-api-access-2nt4w\") pod \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") "
Nov 02 22:25:44.213790 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.213713    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-workload-socket\") pod \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\" (UID: \"a7ef9602-dd0b-44fd-b422-d9b6bc0829c7\") "
Nov 02 22:25:44.214025 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.213683    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-data" pod "a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" (UID: "a7ef9602-dd0b-44fd-b422-d9b6bc0829c7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:44.214099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.214076    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istiod-ca-cert" pod "a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" (UID: "a7ef9602-dd0b-44fd-b422-d9b6bc0829c7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:25:44.214295 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.214195    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-workload-socket" pod "a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" (UID: "a7ef9602-dd0b-44fd-b422-d9b6bc0829c7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:44.214395 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.214280    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-credential-socket" pod "a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" (UID: "a7ef9602-dd0b-44fd-b422-d9b6bc0829c7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:44.214573 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.214532    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:44.214661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.214579    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:44.214661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.214597    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:44.214661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.214610    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:44.214661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.214644    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:44.216589 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.216426    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-envoy" pod "a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" (UID: "a7ef9602-dd0b-44fd-b422-d9b6bc0829c7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:44.216919 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.216889    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-podinfo" pod "a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" (UID: "a7ef9602-dd0b-44fd-b422-d9b6bc0829c7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:25:44.217428 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.217394    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-kube-api-access-2nt4w" pod "a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" (UID: "a7ef9602-dd0b-44fd-b422-d9b6bc0829c7"). InnerVolumeSpecName "kube-api-access-2nt4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:44.218355 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.218331    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-token" pod "a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" (UID: "a7ef9602-dd0b-44fd-b422-d9b6bc0829c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:44.291229 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.291183    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:44.315705 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.315677    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:44.315705 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.315703    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:44.315705 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.315712    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:44.315921 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.315721    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nt4w\" (UniqueName: \"kubernetes.io/projected/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7-kube-api-access-2nt4w\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:44.449394 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.449360    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"]
Nov 02 22:25:44.455531 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.455502    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a54217-openshift-default-554d688f75-fmmp7"]
Nov 02 22:25:44.465091 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.465016    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:44.566212 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.566157    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:44.784055 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:44.783965    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:45.054509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:45.054424    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" path="/var/lib/kubelet/pods/a7ef9602-dd0b-44fd-b422-d9b6bc0829c7/volumes"
Nov 02 22:25:45.075331 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:45.075302    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:45.547363 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:45.547327    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:45.650968 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:45.650934    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"]
Nov 02 22:25:45.651166 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:45.651144    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr" podUID="5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" containerName="istio-proxy" containerID="cri-o://c5025acd6ff46fbd12f082888c0f0ba67af20ccb79c706957892b69330a4f40f" gracePeriod=30
Nov 02 22:25:45.654459 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:45.654433    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:45.654640 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:45.654619    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"]
Nov 02 22:25:45.654820 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:45.654802    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c" podUID="c29d7205-65d5-49f9-8e49-834671694b92" containerName="istio-proxy" containerID="cri-o://eb6cf98830cac1fedf6529bf2ca86e0bcea0ca92b5375d5c523161264d90fa7a" gracePeriod=30
Nov 02 22:25:45.939769 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:45.939728    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"]
Nov 02 22:25:45.940148 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:45.939966    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm" podUID="75affa76-6588-4026-bb96-573b65ea5ce8" containerName="istio-proxy" containerID="cri-o://8d284727a202005e6f028dfa8e34578f517a379f4a80204199ea9ee48d5ddc7e" gracePeriod=30
Nov 02 22:25:46.036616 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.036582    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:46.265338 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.265257    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"]
Nov 02 22:25:46.265474 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.265451    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9" podUID="db7c9431-656a-4ff5-9ee6-bbdf456ec5fa" containerName="discovery" containerID="cri-o://ed36007005f7d0fd11ef269bb8b9f78542c1ca9f4da017b93f2ca8e083135031" gracePeriod=30
Nov 02 22:25:46.550410 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.550386    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:25:46.650777 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.650742    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-csr-ca-configmap\") pod \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") "
Nov 02 22:25:46.650941 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.650831    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-kubeconfig\") pod \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") "
Nov 02 22:25:46.650941 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.650886    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-local-certs\") pod \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") "
Nov 02 22:25:46.651063 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.650960    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-token\" (UniqueName: \"kubernetes.io/projected/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-token\") pod \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") "
Nov 02 22:25:46.651063 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.651039    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-kube-api-access-626q2\" (UniqueName: \"kubernetes.io/projected/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-kube-api-access-626q2\") pod \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") "
Nov 02 22:25:46.651183 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.651072    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-csr-dns-cert\") pod \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") "
Nov 02 22:25:46.651183 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.651108    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-cacerts\" (UniqueName: \"kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-cacerts\") pod \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\" (UID: \"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa\") "
Nov 02 22:25:46.651329 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.651211    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-csr-ca-configmap" pod "db7c9431-656a-4ff5-9ee6-bbdf456ec5fa" (UID: "db7c9431-656a-4ff5-9ee6-bbdf456ec5fa"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:25:46.651758 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.651727    5076 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-csr-ca-configmap\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:46.653648 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.653613    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-local-certs" pod "db7c9431-656a-4ff5-9ee6-bbdf456ec5fa" (UID: "db7c9431-656a-4ff5-9ee6-bbdf456ec5fa"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:46.653760 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.653727    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-kubeconfig" pod "db7c9431-656a-4ff5-9ee6-bbdf456ec5fa" (UID: "db7c9431-656a-4ff5-9ee6-bbdf456ec5fa"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:25:46.653903 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.653866    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-cacerts" pod "db7c9431-656a-4ff5-9ee6-bbdf456ec5fa" (UID: "db7c9431-656a-4ff5-9ee6-bbdf456ec5fa"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:25:46.654081 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.654064    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-token" pod "db7c9431-656a-4ff5-9ee6-bbdf456ec5fa" (UID: "db7c9431-656a-4ff5-9ee6-bbdf456ec5fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:46.654170 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.654147    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-csr-dns-cert" pod "db7c9431-656a-4ff5-9ee6-bbdf456ec5fa" (UID: "db7c9431-656a-4ff5-9ee6-bbdf456ec5fa"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:25:46.654289 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.654271    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-kube-api-access-626q2" pod "db7c9431-656a-4ff5-9ee6-bbdf456ec5fa" (UID: "db7c9431-656a-4ff5-9ee6-bbdf456ec5fa"). InnerVolumeSpecName "kube-api-access-626q2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:46.721026 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.720992    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:46.761189 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.758355    5076 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-kubeconfig\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:46.761189 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.758397    5076 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-local-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:46.761189 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.758412    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:46.761189 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.758428    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-626q2\" (UniqueName: \"kubernetes.io/projected/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-kube-api-access-626q2\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:46.761189 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.758444    5076 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-istio-csr-dns-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:46.761189 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:46.758459    5076 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa-cacerts\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:47.161846 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:47.161812    5076 generic.go:356] "Generic (PLEG): container finished" podID="db7c9431-656a-4ff5-9ee6-bbdf456ec5fa" containerID="ed36007005f7d0fd11ef269bb8b9f78542c1ca9f4da017b93f2ca8e083135031" exitCode=0
Nov 02 22:25:47.162314 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:47.161856    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"
Nov 02 22:25:47.162314 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:47.161901    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9" event={"ID":"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa","Type":"ContainerDied","Data":"ed36007005f7d0fd11ef269bb8b9f78542c1ca9f4da017b93f2ca8e083135031"}
Nov 02 22:25:47.162314 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:47.161962    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9" event={"ID":"db7c9431-656a-4ff5-9ee6-bbdf456ec5fa","Type":"ContainerDied","Data":"a56e09fc948512bd62be040a47ff8d7a8e922a0291a8c913b8ca05731c7baf25"}
Nov 02 22:25:47.162314 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:47.161994    5076 scope.go:122] "RemoveContainer" containerID="ed36007005f7d0fd11ef269bb8b9f78542c1ca9f4da017b93f2ca8e083135031"
Nov 02 22:25:47.173978 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:47.173960    5076 scope.go:122] "RemoveContainer" containerID="324dbfef0855bfd9bb9972e75f4e66435ff2e16d73a1a141a87c50ee5b80186e"
Nov 02 22:25:47.186032 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:47.186008    5076 scope.go:122] "RemoveContainer" containerID="ed36007005f7d0fd11ef269bb8b9f78542c1ca9f4da017b93f2ca8e083135031"
Nov 02 22:25:47.186506 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:25:47.186475    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed36007005f7d0fd11ef269bb8b9f78542c1ca9f4da017b93f2ca8e083135031\": container with ID starting with ed36007005f7d0fd11ef269bb8b9f78542c1ca9f4da017b93f2ca8e083135031 not found: ID does not exist" containerID="ed36007005f7d0fd11ef269bb8b9f78542c1ca9f4da017b93f2ca8e083135031"
Nov 02 22:25:47.186585 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:47.186515    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed36007005f7d0fd11ef269bb8b9f78542c1ca9f4da017b93f2ca8e083135031"} err="failed to get container status \"ed36007005f7d0fd11ef269bb8b9f78542c1ca9f4da017b93f2ca8e083135031\": rpc error: code = NotFound desc = could not find container \"ed36007005f7d0fd11ef269bb8b9f78542c1ca9f4da017b93f2ca8e083135031\": container with ID starting with ed36007005f7d0fd11ef269bb8b9f78542c1ca9f4da017b93f2ca8e083135031 not found: ID does not exist"
Nov 02 22:25:47.186585 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:47.186530    5076 scope.go:122] "RemoveContainer" containerID="324dbfef0855bfd9bb9972e75f4e66435ff2e16d73a1a141a87c50ee5b80186e"
Nov 02 22:25:47.186790 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:25:47.186770    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"324dbfef0855bfd9bb9972e75f4e66435ff2e16d73a1a141a87c50ee5b80186e\": container with ID starting with 324dbfef0855bfd9bb9972e75f4e66435ff2e16d73a1a141a87c50ee5b80186e not found: ID does not exist" containerID="324dbfef0855bfd9bb9972e75f4e66435ff2e16d73a1a141a87c50ee5b80186e"
Nov 02 22:25:47.186848 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:47.186800    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"324dbfef0855bfd9bb9972e75f4e66435ff2e16d73a1a141a87c50ee5b80186e"} err="failed to get container status \"324dbfef0855bfd9bb9972e75f4e66435ff2e16d73a1a141a87c50ee5b80186e\": rpc error: code = NotFound desc = could not find container \"324dbfef0855bfd9bb9972e75f4e66435ff2e16d73a1a141a87c50ee5b80186e\": container with ID starting with 324dbfef0855bfd9bb9972e75f4e66435ff2e16d73a1a141a87c50ee5b80186e not found: ID does not exist"
Nov 02 22:25:47.200146 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:47.200122    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"]
Nov 02 22:25:47.216659 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:47.216638    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-d5mx9"]
Nov 02 22:25:47.566517 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:47.566480    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:48.166687 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:48.166655    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:48.344174 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:48.344142    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:48.445147 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:48.444976    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:48.681718 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:48.681681    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:48.961291 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:48.961255    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:49.056858 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:49.056819    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="db7c9431-656a-4ff5-9ee6-bbdf456ec5fa" path="/var/lib/kubelet/pods/db7c9431-656a-4ff5-9ee6-bbdf456ec5fa/volumes"
Nov 02 22:25:49.612143 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:49.612108    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"]
Nov 02 22:25:49.612635 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:49.612391    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6" podUID="0252ac19-8757-4b54-9d18-79342afbc0b7" containerName="maas-api" containerID="cri-o://35cedfab14e73d796b1a22bfaaa5d4799cbbf55f3417dd0ac797cbf450c62a93" gracePeriod=30
Nov 02 22:25:50.040890 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.040856    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:50.063049 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.063031    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"
Nov 02 22:25:50.104344 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.104311    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0252ac19-8757-4b54-9d18-79342afbc0b7-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0252ac19-8757-4b54-9d18-79342afbc0b7-openshift-service-ca\") pod \"0252ac19-8757-4b54-9d18-79342afbc0b7\" (UID: \"0252ac19-8757-4b54-9d18-79342afbc0b7\") "
Nov 02 22:25:50.104897 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.104866    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0252ac19-8757-4b54-9d18-79342afbc0b7-openshift-service-ca" pod "0252ac19-8757-4b54-9d18-79342afbc0b7" (UID: "0252ac19-8757-4b54-9d18-79342afbc0b7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:25:50.142073 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.142048    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:50.186072 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.186039    5076 generic.go:356] "Generic (PLEG): container finished" podID="0252ac19-8757-4b54-9d18-79342afbc0b7" containerID="35cedfab14e73d796b1a22bfaaa5d4799cbbf55f3417dd0ac797cbf450c62a93" exitCode=0
Nov 02 22:25:50.186248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.186086    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"
Nov 02 22:25:50.186248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.186118    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6" event={"ID":"0252ac19-8757-4b54-9d18-79342afbc0b7","Type":"ContainerDied","Data":"35cedfab14e73d796b1a22bfaaa5d4799cbbf55f3417dd0ac797cbf450c62a93"}
Nov 02 22:25:50.186248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.186171    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6" event={"ID":"0252ac19-8757-4b54-9d18-79342afbc0b7","Type":"ContainerDied","Data":"d8b9013f62de116f92fa5f17a505035cbb128211f448077b804e20fd8af1bc6c"}
Nov 02 22:25:50.186248 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.186195    5076 scope.go:122] "RemoveContainer" containerID="35cedfab14e73d796b1a22bfaaa5d4799cbbf55f3417dd0ac797cbf450c62a93"
Nov 02 22:25:50.198698 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.198675    5076 scope.go:122] "RemoveContainer" containerID="35cedfab14e73d796b1a22bfaaa5d4799cbbf55f3417dd0ac797cbf450c62a93"
Nov 02 22:25:50.199135 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:25:50.199102    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35cedfab14e73d796b1a22bfaaa5d4799cbbf55f3417dd0ac797cbf450c62a93\": container with ID starting with 35cedfab14e73d796b1a22bfaaa5d4799cbbf55f3417dd0ac797cbf450c62a93 not found: ID does not exist" containerID="35cedfab14e73d796b1a22bfaaa5d4799cbbf55f3417dd0ac797cbf450c62a93"
Nov 02 22:25:50.199679 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.199146    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35cedfab14e73d796b1a22bfaaa5d4799cbbf55f3417dd0ac797cbf450c62a93"} err="failed to get container status \"35cedfab14e73d796b1a22bfaaa5d4799cbbf55f3417dd0ac797cbf450c62a93\": rpc error: code = NotFound desc = could not find container \"35cedfab14e73d796b1a22bfaaa5d4799cbbf55f3417dd0ac797cbf450c62a93\": container with ID starting with 35cedfab14e73d796b1a22bfaaa5d4799cbbf55f3417dd0ac797cbf450c62a93 not found: ID does not exist"
Nov 02 22:25:50.222502 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.222003    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0252ac19-8757-4b54-9d18-79342afbc0b7-kube-api-access-m4t8c\" (UniqueName: \"kubernetes.io/projected/0252ac19-8757-4b54-9d18-79342afbc0b7-kube-api-access-m4t8c\") pod \"0252ac19-8757-4b54-9d18-79342afbc0b7\" (UID: \"0252ac19-8757-4b54-9d18-79342afbc0b7\") "
Nov 02 22:25:50.228014 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.227452    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0252ac19-8757-4b54-9d18-79342afbc0b7-metrics-certs\" (UniqueName: \"kubernetes.io/secret/0252ac19-8757-4b54-9d18-79342afbc0b7-metrics-certs\") pod \"0252ac19-8757-4b54-9d18-79342afbc0b7\" (UID: \"0252ac19-8757-4b54-9d18-79342afbc0b7\") "
Nov 02 22:25:50.228382 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.228361    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0252ac19-8757-4b54-9d18-79342afbc0b7-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0252ac19-8757-4b54-9d18-79342afbc0b7-maas-api-tls\") pod \"0252ac19-8757-4b54-9d18-79342afbc0b7\" (UID: \"0252ac19-8757-4b54-9d18-79342afbc0b7\") "
Nov 02 22:25:50.229562 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.229542    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0252ac19-8757-4b54-9d18-79342afbc0b7-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:50.257442 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.255351    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:50.257442 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.256513    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0252ac19-8757-4b54-9d18-79342afbc0b7-metrics-certs" pod "0252ac19-8757-4b54-9d18-79342afbc0b7" (UID: "0252ac19-8757-4b54-9d18-79342afbc0b7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:25:50.257442 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.257162    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0252ac19-8757-4b54-9d18-79342afbc0b7-maas-api-tls" pod "0252ac19-8757-4b54-9d18-79342afbc0b7" (UID: "0252ac19-8757-4b54-9d18-79342afbc0b7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:25:50.259259 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.258425    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0252ac19-8757-4b54-9d18-79342afbc0b7-kube-api-access-m4t8c" pod "0252ac19-8757-4b54-9d18-79342afbc0b7" (UID: "0252ac19-8757-4b54-9d18-79342afbc0b7"). InnerVolumeSpecName "kube-api-access-m4t8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:50.338282 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.337252    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4t8c\" (UniqueName: \"kubernetes.io/projected/0252ac19-8757-4b54-9d18-79342afbc0b7-kube-api-access-m4t8c\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:50.338282 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.337294    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0252ac19-8757-4b54-9d18-79342afbc0b7-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:50.338282 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.337311    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0252ac19-8757-4b54-9d18-79342afbc0b7-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:50.348537 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.348503    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:50.514861 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.514823    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"]
Nov 02 22:25:50.517756 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.517729    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-00c72a-6989c56f96-xwtx6"]
Nov 02 22:25:50.681827 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.681796    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:50.954878 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.953931    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"]
Nov 02 22:25:50.954878 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.954142    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh" podUID="15d4c979-5871-42fa-9cb4-10ca87638d95" containerName="istio-proxy" containerID="cri-o://c743957a965b0db6914723007a4e08e93789f55199ccaef175b4ed68af22a35b" gracePeriod=30
Nov 02 22:25:50.973450 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:25:50.973414    5076 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75affa76_6588_4026_bb96_573b65ea5ce8.slice/crio-8d284727a202005e6f028dfa8e34578f517a379f4a80204199ea9ee48d5ddc7e.scope\": RecentStats: unable to find data in memory cache]"
Nov 02 22:25:50.983461 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:50.977276    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:25:51.021993 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.021970    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:25:51.053987 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.053957    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-workload-certs\") pod \"c29d7205-65d5-49f9-8e49-834671694b92\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") "
Nov 02 22:25:51.054161 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.054022    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-workload-socket\") pod \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") "
Nov 02 22:25:51.054161 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.054059    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-envoy\") pod \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") "
Nov 02 22:25:51.054161 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.054108    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c29d7205-65d5-49f9-8e49-834671694b92-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c29d7205-65d5-49f9-8e49-834671694b92-istio-podinfo\") pod \"c29d7205-65d5-49f9-8e49-834671694b92\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") "
Nov 02 22:25:51.054161 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.054137    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c29d7205-65d5-49f9-8e49-834671694b92-kube-api-access-t9phk\" (UniqueName: \"kubernetes.io/projected/c29d7205-65d5-49f9-8e49-834671694b92-kube-api-access-t9phk\") pod \"c29d7205-65d5-49f9-8e49-834671694b92\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") "
Nov 02 22:25:51.054432 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.054190    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-podinfo\") pod \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") "
Nov 02 22:25:51.054432 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.054231    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-workload-certs\") pod \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") "
Nov 02 22:25:51.054432 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.054262    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-istio-data\") pod \"c29d7205-65d5-49f9-8e49-834671694b92\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") "
Nov 02 22:25:51.054432 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.054296    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c29d7205-65d5-49f9-8e49-834671694b92-istio-token\" (UniqueName: \"kubernetes.io/projected/c29d7205-65d5-49f9-8e49-834671694b92-istio-token\") pod \"c29d7205-65d5-49f9-8e49-834671694b92\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") "
Nov 02 22:25:51.054432 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.054356    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c29d7205-65d5-49f9-8e49-834671694b92-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c29d7205-65d5-49f9-8e49-834671694b92-istiod-ca-cert\") pod \"c29d7205-65d5-49f9-8e49-834671694b92\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") "
Nov 02 22:25:51.054432 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.054387    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-workload-socket\") pod \"c29d7205-65d5-49f9-8e49-834671694b92\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") "
Nov 02 22:25:51.054432 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.054429    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-istio-envoy\") pod \"c29d7205-65d5-49f9-8e49-834671694b92\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") "
Nov 02 22:25:51.054787 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.054489    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-credential-socket\") pod \"c29d7205-65d5-49f9-8e49-834671694b92\" (UID: \"c29d7205-65d5-49f9-8e49-834671694b92\") "
Nov 02 22:25:51.054787 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.054544    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-workload-socket" pod "5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" (UID: "5d4a7334-30f4-4b93-ac4d-edfda88cf5d6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:51.054787 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.054571    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-token\" (UniqueName: \"kubernetes.io/projected/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-token\") pod \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") "
Nov 02 22:25:51.054787 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.054700    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-data\") pod \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") "
Nov 02 22:25:51.054787 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.054762    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-credential-socket\") pod \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") "
Nov 02 22:25:51.055034 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.054815    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istiod-ca-cert\") pod \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") "
Nov 02 22:25:51.055034 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.054870    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-kube-api-access-xch59\" (UniqueName: \"kubernetes.io/projected/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-kube-api-access-xch59\") pod \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\" (UID: \"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6\") "
Nov 02 22:25:51.055370 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.055348    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.055479 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.055426    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-workload-certs" pod "5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" (UID: "5d4a7334-30f4-4b93-ac4d-edfda88cf5d6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:51.055795 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.055578    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istiod-ca-cert" pod "5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" (UID: "5d4a7334-30f4-4b93-ac4d-edfda88cf5d6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:25:51.055795 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.055591    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-data" pod "5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" (UID: "5d4a7334-30f4-4b93-ac4d-edfda88cf5d6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:51.055795 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.055609    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-credential-socket" pod "5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" (UID: "5d4a7334-30f4-4b93-ac4d-edfda88cf5d6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:51.056316 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.056291    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-workload-certs" pod "c29d7205-65d5-49f9-8e49-834671694b92" (UID: "c29d7205-65d5-49f9-8e49-834671694b92"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:51.057508 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.056956    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c29d7205-65d5-49f9-8e49-834671694b92-istiod-ca-cert" pod "c29d7205-65d5-49f9-8e49-834671694b92" (UID: "c29d7205-65d5-49f9-8e49-834671694b92"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:25:51.057668 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.057004    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-istio-data" pod "c29d7205-65d5-49f9-8e49-834671694b92" (UID: "c29d7205-65d5-49f9-8e49-834671694b92"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:51.057668 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.057139    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-workload-socket" pod "c29d7205-65d5-49f9-8e49-834671694b92" (UID: "c29d7205-65d5-49f9-8e49-834671694b92"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:51.057668 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.057149    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-credential-socket" pod "c29d7205-65d5-49f9-8e49-834671694b92" (UID: "c29d7205-65d5-49f9-8e49-834671694b92"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:51.057977 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.057953    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-envoy" pod "5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" (UID: "5d4a7334-30f4-4b93-ac4d-edfda88cf5d6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:51.059254 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.059235    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c29d7205-65d5-49f9-8e49-834671694b92-kube-api-access-t9phk" pod "c29d7205-65d5-49f9-8e49-834671694b92" (UID: "c29d7205-65d5-49f9-8e49-834671694b92"). InnerVolumeSpecName "kube-api-access-t9phk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:51.060657 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.060632    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-kube-api-access-xch59" pod "5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" (UID: "5d4a7334-30f4-4b93-ac4d-edfda88cf5d6"). InnerVolumeSpecName "kube-api-access-xch59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:51.060807 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.060787    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-token" pod "5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" (UID: "5d4a7334-30f4-4b93-ac4d-edfda88cf5d6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:51.060923 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.060823    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-podinfo" pod "5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" (UID: "5d4a7334-30f4-4b93-ac4d-edfda88cf5d6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:25:51.060923 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.060841    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c29d7205-65d5-49f9-8e49-834671694b92-istio-podinfo" pod "c29d7205-65d5-49f9-8e49-834671694b92" (UID: "c29d7205-65d5-49f9-8e49-834671694b92"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:25:51.061914 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.061895    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c29d7205-65d5-49f9-8e49-834671694b92-istio-token" pod "c29d7205-65d5-49f9-8e49-834671694b92" (UID: "c29d7205-65d5-49f9-8e49-834671694b92"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:51.062538 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.062512    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-istio-envoy" pod "c29d7205-65d5-49f9-8e49-834671694b92" (UID: "c29d7205-65d5-49f9-8e49-834671694b92"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:51.062988 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.062964    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0252ac19-8757-4b54-9d18-79342afbc0b7" path="/var/lib/kubelet/pods/0252ac19-8757-4b54-9d18-79342afbc0b7/volumes"
Nov 02 22:25:51.157155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.157111    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.157155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.157144    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xch59\" (UniqueName: \"kubernetes.io/projected/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-kube-api-access-xch59\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.157155 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.157161    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.157398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.157179    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.157398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.157193    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c29d7205-65d5-49f9-8e49-834671694b92-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.157398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.157208    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9phk\" (UniqueName: \"kubernetes.io/projected/c29d7205-65d5-49f9-8e49-834671694b92-kube-api-access-t9phk\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.157398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.157255    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.157398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.157270    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.157398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.157286    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.157398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.157300    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c29d7205-65d5-49f9-8e49-834671694b92-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.157398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.157315    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c29d7205-65d5-49f9-8e49-834671694b92-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.157398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.157330    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.157398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.157345    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.157398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.157361    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c29d7205-65d5-49f9-8e49-834671694b92-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.157398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.157375    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.157398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.157388    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.157398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.157397    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.195070 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.194987    5076 generic.go:356] "Generic (PLEG): container finished" podID="5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" containerID="c5025acd6ff46fbd12f082888c0f0ba67af20ccb79c706957892b69330a4f40f" exitCode=0
Nov 02 22:25:51.195070 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.195045    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"
Nov 02 22:25:51.195289 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.195069    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr" event={"ID":"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6","Type":"ContainerDied","Data":"c5025acd6ff46fbd12f082888c0f0ba67af20ccb79c706957892b69330a4f40f"}
Nov 02 22:25:51.195289 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.195128    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr" event={"ID":"5d4a7334-30f4-4b93-ac4d-edfda88cf5d6","Type":"ContainerDied","Data":"a31056000dc9032892b1d959966e1824763fa671fa4617cecf02e8f7f185cd86"}
Nov 02 22:25:51.195289 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.195160    5076 scope.go:122] "RemoveContainer" containerID="c5025acd6ff46fbd12f082888c0f0ba67af20ccb79c706957892b69330a4f40f"
Nov 02 22:25:51.197550 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.197417    5076 generic.go:356] "Generic (PLEG): container finished" podID="75affa76-6588-4026-bb96-573b65ea5ce8" containerID="8d284727a202005e6f028dfa8e34578f517a379f4a80204199ea9ee48d5ddc7e" exitCode=0
Nov 02 22:25:51.197696 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.197581    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm" event={"ID":"75affa76-6588-4026-bb96-573b65ea5ce8","Type":"ContainerDied","Data":"8d284727a202005e6f028dfa8e34578f517a379f4a80204199ea9ee48d5ddc7e"}
Nov 02 22:25:51.198798 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.198711    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:51.200652 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.200632    5076 generic.go:356] "Generic (PLEG): container finished" podID="c29d7205-65d5-49f9-8e49-834671694b92" containerID="eb6cf98830cac1fedf6529bf2ca86e0bcea0ca92b5375d5c523161264d90fa7a" exitCode=0
Nov 02 22:25:51.200748 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.200664    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c" event={"ID":"c29d7205-65d5-49f9-8e49-834671694b92","Type":"ContainerDied","Data":"eb6cf98830cac1fedf6529bf2ca86e0bcea0ca92b5375d5c523161264d90fa7a"}
Nov 02 22:25:51.200748 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.200674    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"
Nov 02 22:25:51.200748 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.200697    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c" event={"ID":"c29d7205-65d5-49f9-8e49-834671694b92","Type":"ContainerDied","Data":"9bf13edd995ae6ab93bd5a003baa20b9894d8db5945886141a8e202abefdd064"}
Nov 02 22:25:51.206786 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.206771    5076 scope.go:122] "RemoveContainer" containerID="c5025acd6ff46fbd12f082888c0f0ba67af20ccb79c706957892b69330a4f40f"
Nov 02 22:25:51.207067 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:25:51.207047    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5025acd6ff46fbd12f082888c0f0ba67af20ccb79c706957892b69330a4f40f\": container with ID starting with c5025acd6ff46fbd12f082888c0f0ba67af20ccb79c706957892b69330a4f40f not found: ID does not exist" containerID="c5025acd6ff46fbd12f082888c0f0ba67af20ccb79c706957892b69330a4f40f"
Nov 02 22:25:51.207130 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.207077    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5025acd6ff46fbd12f082888c0f0ba67af20ccb79c706957892b69330a4f40f"} err="failed to get container status \"c5025acd6ff46fbd12f082888c0f0ba67af20ccb79c706957892b69330a4f40f\": rpc error: code = NotFound desc = could not find container \"c5025acd6ff46fbd12f082888c0f0ba67af20ccb79c706957892b69330a4f40f\": container with ID starting with c5025acd6ff46fbd12f082888c0f0ba67af20ccb79c706957892b69330a4f40f not found: ID does not exist"
Nov 02 22:25:51.207130 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.207096    5076 scope.go:122] "RemoveContainer" containerID="eb6cf98830cac1fedf6529bf2ca86e0bcea0ca92b5375d5c523161264d90fa7a"
Nov 02 22:25:51.215926 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.215904    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"]
Nov 02 22:25:51.217457 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.217437    5076 scope.go:122] "RemoveContainer" containerID="eb6cf98830cac1fedf6529bf2ca86e0bcea0ca92b5375d5c523161264d90fa7a"
Nov 02 22:25:51.217763 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:25:51.217736    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb6cf98830cac1fedf6529bf2ca86e0bcea0ca92b5375d5c523161264d90fa7a\": container with ID starting with eb6cf98830cac1fedf6529bf2ca86e0bcea0ca92b5375d5c523161264d90fa7a not found: ID does not exist" containerID="eb6cf98830cac1fedf6529bf2ca86e0bcea0ca92b5375d5c523161264d90fa7a"
Nov 02 22:25:51.217853 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.217771    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb6cf98830cac1fedf6529bf2ca86e0bcea0ca92b5375d5c523161264d90fa7a"} err="failed to get container status \"eb6cf98830cac1fedf6529bf2ca86e0bcea0ca92b5375d5c523161264d90fa7a\": rpc error: code = NotFound desc = could not find container \"eb6cf98830cac1fedf6529bf2ca86e0bcea0ca92b5375d5c523161264d90fa7a\": container with ID starting with eb6cf98830cac1fedf6529bf2ca86e0bcea0ca92b5375d5c523161264d90fa7a not found: ID does not exist"
Nov 02 22:25:51.219048 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.219030    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-t74cr"]
Nov 02 22:25:51.229902 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.229880    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"]
Nov 02 22:25:51.235553 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.235529    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-qmm9c"]
Nov 02 22:25:51.587774 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.587752    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:25:51.666212 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.666185    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-credential-socket\") pod \"75affa76-6588-4026-bb96-573b65ea5ce8\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") "
Nov 02 22:25:51.666407 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.666271    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-workload-certs\") pod \"75affa76-6588-4026-bb96-573b65ea5ce8\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") "
Nov 02 22:25:51.666407 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.666315    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-istio-envoy\") pod \"75affa76-6588-4026-bb96-573b65ea5ce8\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") "
Nov 02 22:25:51.666537 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.666441    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75affa76-6588-4026-bb96-573b65ea5ce8-kube-api-access-z68pp\" (UniqueName: \"kubernetes.io/projected/75affa76-6588-4026-bb96-573b65ea5ce8-kube-api-access-z68pp\") pod \"75affa76-6588-4026-bb96-573b65ea5ce8\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") "
Nov 02 22:25:51.666537 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.666450    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-credential-socket" pod "75affa76-6588-4026-bb96-573b65ea5ce8" (UID: "75affa76-6588-4026-bb96-573b65ea5ce8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:51.666537 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.666480    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75affa76-6588-4026-bb96-573b65ea5ce8-istio-token\" (UniqueName: \"kubernetes.io/projected/75affa76-6588-4026-bb96-573b65ea5ce8-istio-token\") pod \"75affa76-6588-4026-bb96-573b65ea5ce8\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") "
Nov 02 22:25:51.666537 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.666520    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/75affa76-6588-4026-bb96-573b65ea5ce8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75affa76-6588-4026-bb96-573b65ea5ce8-istio-podinfo\") pod \"75affa76-6588-4026-bb96-573b65ea5ce8\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") "
Nov 02 22:25:51.666770 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.666551    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-workload-socket\") pod \"75affa76-6588-4026-bb96-573b65ea5ce8\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") "
Nov 02 22:25:51.666770 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.666600    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-workload-certs" pod "75affa76-6588-4026-bb96-573b65ea5ce8" (UID: "75affa76-6588-4026-bb96-573b65ea5ce8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:51.666770 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.666621    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/75affa76-6588-4026-bb96-573b65ea5ce8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75affa76-6588-4026-bb96-573b65ea5ce8-istiod-ca-cert\") pod \"75affa76-6588-4026-bb96-573b65ea5ce8\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") "
Nov 02 22:25:51.666770 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.666700    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-istio-data\") pod \"75affa76-6588-4026-bb96-573b65ea5ce8\" (UID: \"75affa76-6588-4026-bb96-573b65ea5ce8\") "
Nov 02 22:25:51.666983 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.666810    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-workload-socket" pod "75affa76-6588-4026-bb96-573b65ea5ce8" (UID: "75affa76-6588-4026-bb96-573b65ea5ce8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:51.667038 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.667007    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-istio-data" pod "75affa76-6588-4026-bb96-573b65ea5ce8" (UID: "75affa76-6588-4026-bb96-573b65ea5ce8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:51.667092 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.667061    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75affa76-6588-4026-bb96-573b65ea5ce8-istiod-ca-cert" pod "75affa76-6588-4026-bb96-573b65ea5ce8" (UID: "75affa76-6588-4026-bb96-573b65ea5ce8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:25:51.667329 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.667308    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.667436 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.667334    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75affa76-6588-4026-bb96-573b65ea5ce8-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.667436 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.667351    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.667436 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.667367    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.667436 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.667381    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.668766 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.668741    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-istio-envoy" pod "75affa76-6588-4026-bb96-573b65ea5ce8" (UID: "75affa76-6588-4026-bb96-573b65ea5ce8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:51.669010 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.668984    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75affa76-6588-4026-bb96-573b65ea5ce8-istio-token" pod "75affa76-6588-4026-bb96-573b65ea5ce8" (UID: "75affa76-6588-4026-bb96-573b65ea5ce8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:51.669144 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.669125    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/75affa76-6588-4026-bb96-573b65ea5ce8-istio-podinfo" pod "75affa76-6588-4026-bb96-573b65ea5ce8" (UID: "75affa76-6588-4026-bb96-573b65ea5ce8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:25:51.669545 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.669523    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75affa76-6588-4026-bb96-573b65ea5ce8-kube-api-access-z68pp" pod "75affa76-6588-4026-bb96-573b65ea5ce8" (UID: "75affa76-6588-4026-bb96-573b65ea5ce8"). InnerVolumeSpecName "kube-api-access-z68pp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:51.768424 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.768339    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75affa76-6588-4026-bb96-573b65ea5ce8-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.768424 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.768367    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z68pp\" (UniqueName: \"kubernetes.io/projected/75affa76-6588-4026-bb96-573b65ea5ce8-kube-api-access-z68pp\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.768424 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.768379    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75affa76-6588-4026-bb96-573b65ea5ce8-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.768424 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.768388    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75affa76-6588-4026-bb96-573b65ea5ce8-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:51.870117 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:51.870080    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:52.213914 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:52.213881    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm" event={"ID":"75affa76-6588-4026-bb96-573b65ea5ce8","Type":"ContainerDied","Data":"5ff4c9e93522e79d4a521e8c52f712fe7576611ed6312236e5939e784ac2efaf"}
Nov 02 22:25:52.213914 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:52.213899    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"
Nov 02 22:25:52.214280 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:52.213939    5076 scope.go:122] "RemoveContainer" containerID="8d284727a202005e6f028dfa8e34578f517a379f4a80204199ea9ee48d5ddc7e"
Nov 02 22:25:52.240661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:52.240638    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"]
Nov 02 22:25:52.245067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:52.245042    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-9rstm"]
Nov 02 22:25:52.558010 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:52.557927    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:53.013736 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.013701    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"]
Nov 02 22:25:53.014299 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.014269    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj" podUID="b57e9830-dbca-4612-b162-f7dbfafe7d3a" containerName="maas-api" containerID="cri-o://5475c3c79b27796f1eefa1d1051bf8e3342e21cd934d8250a31b50505194ac45" gracePeriod=30
Nov 02 22:25:53.053185 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.053150    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:53.069262 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.068031    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" path="/var/lib/kubelet/pods/5d4a7334-30f4-4b93-ac4d-edfda88cf5d6/volumes"
Nov 02 22:25:53.069262 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.068850    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="75affa76-6588-4026-bb96-573b65ea5ce8" path="/var/lib/kubelet/pods/75affa76-6588-4026-bb96-573b65ea5ce8/volumes"
Nov 02 22:25:53.070388 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.069778    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c29d7205-65d5-49f9-8e49-834671694b92" path="/var/lib/kubelet/pods/c29d7205-65d5-49f9-8e49-834671694b92/volumes"
Nov 02 22:25:53.206528 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.206482    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:53.229385 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.229067    5076 generic.go:356] "Generic (PLEG): container finished" podID="b57e9830-dbca-4612-b162-f7dbfafe7d3a" containerID="5475c3c79b27796f1eefa1d1051bf8e3342e21cd934d8250a31b50505194ac45" exitCode=0
Nov 02 22:25:53.229385 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.229232    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj" event={"ID":"b57e9830-dbca-4612-b162-f7dbfafe7d3a","Type":"ContainerDied","Data":"5475c3c79b27796f1eefa1d1051bf8e3342e21cd934d8250a31b50505194ac45"}
Nov 02 22:25:53.328139 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.324935    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:53.381253 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.376252    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"
Nov 02 22:25:53.470017 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.469982    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:53.489378 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.489346    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b57e9830-dbca-4612-b162-f7dbfafe7d3a-kube-api-access-f9r4v\" (UniqueName: \"kubernetes.io/projected/b57e9830-dbca-4612-b162-f7dbfafe7d3a-kube-api-access-f9r4v\") pod \"b57e9830-dbca-4612-b162-f7dbfafe7d3a\" (UID: \"b57e9830-dbca-4612-b162-f7dbfafe7d3a\") "
Nov 02 22:25:53.489534 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.489433    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b57e9830-dbca-4612-b162-f7dbfafe7d3a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b57e9830-dbca-4612-b162-f7dbfafe7d3a-metrics-certs\") pod \"b57e9830-dbca-4612-b162-f7dbfafe7d3a\" (UID: \"b57e9830-dbca-4612-b162-f7dbfafe7d3a\") "
Nov 02 22:25:53.489598 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.489567    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b57e9830-dbca-4612-b162-f7dbfafe7d3a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b57e9830-dbca-4612-b162-f7dbfafe7d3a-maas-api-tls\") pod \"b57e9830-dbca-4612-b162-f7dbfafe7d3a\" (UID: \"b57e9830-dbca-4612-b162-f7dbfafe7d3a\") "
Nov 02 22:25:53.489633 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.489604    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b57e9830-dbca-4612-b162-f7dbfafe7d3a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b57e9830-dbca-4612-b162-f7dbfafe7d3a-openshift-service-ca\") pod \"b57e9830-dbca-4612-b162-f7dbfafe7d3a\" (UID: \"b57e9830-dbca-4612-b162-f7dbfafe7d3a\") "
Nov 02 22:25:53.490014 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.489983    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b57e9830-dbca-4612-b162-f7dbfafe7d3a-openshift-service-ca" pod "b57e9830-dbca-4612-b162-f7dbfafe7d3a" (UID: "b57e9830-dbca-4612-b162-f7dbfafe7d3a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:25:53.491640 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.491613    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b57e9830-dbca-4612-b162-f7dbfafe7d3a-metrics-certs" pod "b57e9830-dbca-4612-b162-f7dbfafe7d3a" (UID: "b57e9830-dbca-4612-b162-f7dbfafe7d3a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:25:53.491939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.491913    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b57e9830-dbca-4612-b162-f7dbfafe7d3a-maas-api-tls" pod "b57e9830-dbca-4612-b162-f7dbfafe7d3a" (UID: "b57e9830-dbca-4612-b162-f7dbfafe7d3a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:25:53.492043 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.492016    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b57e9830-dbca-4612-b162-f7dbfafe7d3a-kube-api-access-f9r4v" pod "b57e9830-dbca-4612-b162-f7dbfafe7d3a" (UID: "b57e9830-dbca-4612-b162-f7dbfafe7d3a"). InnerVolumeSpecName "kube-api-access-f9r4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:53.590893 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.590801    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9r4v\" (UniqueName: \"kubernetes.io/projected/b57e9830-dbca-4612-b162-f7dbfafe7d3a-kube-api-access-f9r4v\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:53.590893 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.590842    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b57e9830-dbca-4612-b162-f7dbfafe7d3a-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:53.590893 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.590858    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b57e9830-dbca-4612-b162-f7dbfafe7d3a-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:53.590893 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.590871    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b57e9830-dbca-4612-b162-f7dbfafe7d3a-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:53.714815 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:53.714763    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:54.126509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:54.126473    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:54.236847 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:54.236804    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj" event={"ID":"b57e9830-dbca-4612-b162-f7dbfafe7d3a","Type":"ContainerDied","Data":"f2331def3d1dba7b67294e63137b6765c666e31a39a251c46fec3fd6497e5a13"}
Nov 02 22:25:54.237045 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:54.236866    5076 scope.go:122] "RemoveContainer" containerID="5475c3c79b27796f1eefa1d1051bf8e3342e21cd934d8250a31b50505194ac45"
Nov 02 22:25:54.237045 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:54.236820    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"
Nov 02 22:25:54.263032 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:54.262980    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"]
Nov 02 22:25:54.266599 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:54.266576    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a621f1-6698bbc576-rv5jj"]
Nov 02 22:25:54.804344 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:54.804309    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:55.053755 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:55.053723    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b57e9830-dbca-4612-b162-f7dbfafe7d3a" path="/var/lib/kubelet/pods/b57e9830-dbca-4612-b162-f7dbfafe7d3a/volumes"
Nov 02 22:25:55.417876 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:55.417841    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:55.519499 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:55.519462    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:56.036597 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.036562    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:56.254947 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.254920    5076 generic.go:356] "Generic (PLEG): container finished" podID="15d4c979-5871-42fa-9cb4-10ca87638d95" containerID="c743957a965b0db6914723007a4e08e93789f55199ccaef175b4ed68af22a35b" exitCode=0
Nov 02 22:25:56.255046 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.254994    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh" event={"ID":"15d4c979-5871-42fa-9cb4-10ca87638d95","Type":"ContainerDied","Data":"c743957a965b0db6914723007a4e08e93789f55199ccaef175b4ed68af22a35b"}
Nov 02 22:25:56.255096 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.255047    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh" event={"ID":"15d4c979-5871-42fa-9cb4-10ca87638d95","Type":"ContainerDied","Data":"7f17098bff9c81ee546039099111f88c3d9170fde838050597abcb211ca71d8e"}
Nov 02 22:25:56.255096 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.255072    5076 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f17098bff9c81ee546039099111f88c3d9170fde838050597abcb211ca71d8e"
Nov 02 22:25:56.265613 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.265588    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:25:56.333077 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.333040    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-envoy\") pod \"15d4c979-5871-42fa-9cb4-10ca87638d95\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") "
Nov 02 22:25:56.333283 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.333109    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-podinfo\") pod \"15d4c979-5871-42fa-9cb4-10ca87638d95\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") "
Nov 02 22:25:56.333283 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.333167    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-credential-socket\") pod \"15d4c979-5871-42fa-9cb4-10ca87638d95\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") "
Nov 02 22:25:56.333283 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.333204    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/15d4c979-5871-42fa-9cb4-10ca87638d95-kube-api-access-w8wcc\" (UniqueName: \"kubernetes.io/projected/15d4c979-5871-42fa-9cb4-10ca87638d95-kube-api-access-w8wcc\") pod \"15d4c979-5871-42fa-9cb4-10ca87638d95\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") "
Nov 02 22:25:56.333283 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.333248    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-token\" (UniqueName: \"kubernetes.io/projected/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-token\") pod \"15d4c979-5871-42fa-9cb4-10ca87638d95\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") "
Nov 02 22:25:56.333509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.333295    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-workload-socket\") pod \"15d4c979-5871-42fa-9cb4-10ca87638d95\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") "
Nov 02 22:25:56.333509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.333362    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-workload-certs\") pod \"15d4c979-5871-42fa-9cb4-10ca87638d95\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") "
Nov 02 22:25:56.333509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.333421    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/15d4c979-5871-42fa-9cb4-10ca87638d95-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15d4c979-5871-42fa-9cb4-10ca87638d95-istiod-ca-cert\") pod \"15d4c979-5871-42fa-9cb4-10ca87638d95\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") "
Nov 02 22:25:56.333509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.333474    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-data\") pod \"15d4c979-5871-42fa-9cb4-10ca87638d95\" (UID: \"15d4c979-5871-42fa-9cb4-10ca87638d95\") "
Nov 02 22:25:56.333715 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.333540    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-credential-socket" pod "15d4c979-5871-42fa-9cb4-10ca87638d95" (UID: "15d4c979-5871-42fa-9cb4-10ca87638d95"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:56.333804 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.333777    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-workload-socket" pod "15d4c979-5871-42fa-9cb4-10ca87638d95" (UID: "15d4c979-5871-42fa-9cb4-10ca87638d95"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:56.333888 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.333870    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15d4c979-5871-42fa-9cb4-10ca87638d95-istiod-ca-cert" pod "15d4c979-5871-42fa-9cb4-10ca87638d95" (UID: "15d4c979-5871-42fa-9cb4-10ca87638d95"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:25:56.334026 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.334002    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-data" pod "15d4c979-5871-42fa-9cb4-10ca87638d95" (UID: "15d4c979-5871-42fa-9cb4-10ca87638d95"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:56.334099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.334023    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-workload-certs" pod "15d4c979-5871-42fa-9cb4-10ca87638d95" (UID: "15d4c979-5871-42fa-9cb4-10ca87638d95"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:56.334261 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.334235    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:56.334261 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.334264    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:56.334440 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.334280    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:56.334440 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.334294    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15d4c979-5871-42fa-9cb4-10ca87638d95-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:56.334440 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.334309    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:56.335875 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.335849    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-token" pod "15d4c979-5871-42fa-9cb4-10ca87638d95" (UID: "15d4c979-5871-42fa-9cb4-10ca87638d95"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:56.335875 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.335869    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-envoy" pod "15d4c979-5871-42fa-9cb4-10ca87638d95" (UID: "15d4c979-5871-42fa-9cb4-10ca87638d95"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:25:56.336053 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.335885    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-podinfo" pod "15d4c979-5871-42fa-9cb4-10ca87638d95" (UID: "15d4c979-5871-42fa-9cb4-10ca87638d95"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:25:56.336053 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.335962    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15d4c979-5871-42fa-9cb4-10ca87638d95-kube-api-access-w8wcc" pod "15d4c979-5871-42fa-9cb4-10ca87638d95" (UID: "15d4c979-5871-42fa-9cb4-10ca87638d95"). InnerVolumeSpecName "kube-api-access-w8wcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:56.435060 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.435030    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:56.435060 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.435057    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:56.435484 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.435069    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8wcc\" (UniqueName: \"kubernetes.io/projected/15d4c979-5871-42fa-9cb4-10ca87638d95-kube-api-access-w8wcc\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:56.435484 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.435078    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15d4c979-5871-42fa-9cb4-10ca87638d95-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:56.764777 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.764746    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:56.902893 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:56.902856    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:57.003031 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.003000    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:57.226970 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.226933    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:57.261352 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.261322    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"
Nov 02 22:25:57.285097 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.285066    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"]
Nov 02 22:25:57.325346 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.307210    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-rg7sh"]
Nov 02 22:25:57.433205 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.433171    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"]
Nov 02 22:25:57.433517 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.433454    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m" podUID="9164f6d8-20d6-4051-af7a-ea57cafff9a2" containerName="maas-api" containerID="cri-o://7ee6d6b975175ce7042a4bf32a9e53d8213db79a689231cee2fa928ae61a7d55" gracePeriod=30
Nov 02 22:25:57.479384 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.479320    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:57.616256 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.615532    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:57.715781 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.715747    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:57.741934 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.741897    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"
Nov 02 22:25:57.869881 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.869098    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9164f6d8-20d6-4051-af7a-ea57cafff9a2-kube-api-access-6js9d\" (UniqueName: \"kubernetes.io/projected/9164f6d8-20d6-4051-af7a-ea57cafff9a2-kube-api-access-6js9d\") pod \"9164f6d8-20d6-4051-af7a-ea57cafff9a2\" (UID: \"9164f6d8-20d6-4051-af7a-ea57cafff9a2\") "
Nov 02 22:25:57.869881 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.869144    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9164f6d8-20d6-4051-af7a-ea57cafff9a2-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9164f6d8-20d6-4051-af7a-ea57cafff9a2-maas-api-tls\") pod \"9164f6d8-20d6-4051-af7a-ea57cafff9a2\" (UID: \"9164f6d8-20d6-4051-af7a-ea57cafff9a2\") "
Nov 02 22:25:57.869881 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.869297    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9164f6d8-20d6-4051-af7a-ea57cafff9a2-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9164f6d8-20d6-4051-af7a-ea57cafff9a2-openshift-service-ca\") pod \"9164f6d8-20d6-4051-af7a-ea57cafff9a2\" (UID: \"9164f6d8-20d6-4051-af7a-ea57cafff9a2\") "
Nov 02 22:25:57.869881 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.869334    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9164f6d8-20d6-4051-af7a-ea57cafff9a2-metrics-certs\" (UniqueName: \"kubernetes.io/secret/9164f6d8-20d6-4051-af7a-ea57cafff9a2-metrics-certs\") pod \"9164f6d8-20d6-4051-af7a-ea57cafff9a2\" (UID: \"9164f6d8-20d6-4051-af7a-ea57cafff9a2\") "
Nov 02 22:25:57.870260 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.870044    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9164f6d8-20d6-4051-af7a-ea57cafff9a2-openshift-service-ca" pod "9164f6d8-20d6-4051-af7a-ea57cafff9a2" (UID: "9164f6d8-20d6-4051-af7a-ea57cafff9a2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:25:57.873085 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.872410    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9164f6d8-20d6-4051-af7a-ea57cafff9a2-metrics-certs" pod "9164f6d8-20d6-4051-af7a-ea57cafff9a2" (UID: "9164f6d8-20d6-4051-af7a-ea57cafff9a2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:25:57.873253 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.873149    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9164f6d8-20d6-4051-af7a-ea57cafff9a2-kube-api-access-6js9d" pod "9164f6d8-20d6-4051-af7a-ea57cafff9a2" (UID: "9164f6d8-20d6-4051-af7a-ea57cafff9a2"). InnerVolumeSpecName "kube-api-access-6js9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:25:57.873320 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.873279    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9164f6d8-20d6-4051-af7a-ea57cafff9a2-maas-api-tls" pod "9164f6d8-20d6-4051-af7a-ea57cafff9a2" (UID: "9164f6d8-20d6-4051-af7a-ea57cafff9a2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:25:57.971036 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.970997    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9164f6d8-20d6-4051-af7a-ea57cafff9a2-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:57.971036 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.971033    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9164f6d8-20d6-4051-af7a-ea57cafff9a2-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:57.971036 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.971044    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6js9d\" (UniqueName: \"kubernetes.io/projected/9164f6d8-20d6-4051-af7a-ea57cafff9a2-kube-api-access-6js9d\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:57.971369 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:57.971053    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9164f6d8-20d6-4051-af7a-ea57cafff9a2-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:25:58.117204 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:58.117166    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:58.274626 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:58.274536    5076 generic.go:356] "Generic (PLEG): container finished" podID="9164f6d8-20d6-4051-af7a-ea57cafff9a2" containerID="7ee6d6b975175ce7042a4bf32a9e53d8213db79a689231cee2fa928ae61a7d55" exitCode=0
Nov 02 22:25:58.274794 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:58.274765    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m" event={"ID":"9164f6d8-20d6-4051-af7a-ea57cafff9a2","Type":"ContainerDied","Data":"7ee6d6b975175ce7042a4bf32a9e53d8213db79a689231cee2fa928ae61a7d55"}
Nov 02 22:25:58.274876 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:58.274849    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m" event={"ID":"9164f6d8-20d6-4051-af7a-ea57cafff9a2","Type":"ContainerDied","Data":"ada16fc35242d52b2a37310376d37fffc0c463709215ff6f6bb375840cff2fb4"}
Nov 02 22:25:58.274923 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:58.274892    5076 scope.go:122] "RemoveContainer" containerID="7ee6d6b975175ce7042a4bf32a9e53d8213db79a689231cee2fa928ae61a7d55"
Nov 02 22:25:58.275091 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:58.275075    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"
Nov 02 22:25:58.286081 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:58.286061    5076 scope.go:122] "RemoveContainer" containerID="7ee6d6b975175ce7042a4bf32a9e53d8213db79a689231cee2fa928ae61a7d55"
Nov 02 22:25:58.286378 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:25:58.286357    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ee6d6b975175ce7042a4bf32a9e53d8213db79a689231cee2fa928ae61a7d55\": container with ID starting with 7ee6d6b975175ce7042a4bf32a9e53d8213db79a689231cee2fa928ae61a7d55 not found: ID does not exist" containerID="7ee6d6b975175ce7042a4bf32a9e53d8213db79a689231cee2fa928ae61a7d55"
Nov 02 22:25:58.286444 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:58.286385    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ee6d6b975175ce7042a4bf32a9e53d8213db79a689231cee2fa928ae61a7d55"} err="failed to get container status \"7ee6d6b975175ce7042a4bf32a9e53d8213db79a689231cee2fa928ae61a7d55\": rpc error: code = NotFound desc = could not find container \"7ee6d6b975175ce7042a4bf32a9e53d8213db79a689231cee2fa928ae61a7d55\": container with ID starting with 7ee6d6b975175ce7042a4bf32a9e53d8213db79a689231cee2fa928ae61a7d55 not found: ID does not exist"
Nov 02 22:25:58.301727 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:58.301577    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"]
Nov 02 22:25:58.305856 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:58.305833    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7bb56e-5bffc475b4-zv95m"]
Nov 02 22:25:58.674612 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:58.674565    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:59.053442 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:59.053361    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="15d4c979-5871-42fa-9cb4-10ca87638d95" path="/var/lib/kubelet/pods/15d4c979-5871-42fa-9cb4-10ca87638d95/volumes"
Nov 02 22:25:59.053893 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:59.053871    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9164f6d8-20d6-4051-af7a-ea57cafff9a2" path="/var/lib/kubelet/pods/9164f6d8-20d6-4051-af7a-ea57cafff9a2/volumes"
Nov 02 22:25:59.291070 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:59.291039    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:59.390307 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:59.390272    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:59.847701 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:59.847624    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:25:59.888495 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:25:59.888461    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:25:59.952614 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:25:59.952571    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:00.291393 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:00.291358    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:00.845944 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:00.845908    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:01.546212 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:01.546177    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:02.182964 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:02.182930    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:02.629374 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:02.629343    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"]
Nov 02 22:26:02.659026 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:02.658995    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"]
Nov 02 22:26:02.724440 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:02.724397    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:02.864566 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:02.864532    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:03.380666 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:03.380606    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"]
Nov 02 22:26:03.381230 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:03.381160    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs" podUID="c90a5e2d-6ada-450f-b930-5ba0fe60b1c5" containerName="maas-api" containerID="cri-o://06136650ab36061b4e11860c884f0c59e9dafdb73d8f6d20e753dc6a39bef76c" gracePeriod=30
Nov 02 22:26:03.393733 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:03.392408    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:03.522749 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:03.522713    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:03.641285 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:03.640405    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:03.678593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:03.678563    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"
Nov 02 22:26:03.723679 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:03.723645    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:03.766513 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:03.766487    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-maas-api-tls\") pod \"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5\" (UID: \"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5\") "
Nov 02 22:26:03.766647 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:03.766522    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-kube-api-access-m948m\" (UniqueName: \"kubernetes.io/projected/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-kube-api-access-m948m\") pod \"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5\" (UID: \"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5\") "
Nov 02 22:26:03.766705 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:03.766660    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-openshift-service-ca\") pod \"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5\" (UID: \"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5\") "
Nov 02 22:26:03.766824 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:03.766805    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-metrics-certs\" (UniqueName: \"kubernetes.io/secret/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-metrics-certs\") pod \"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5\" (UID: \"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5\") "
Nov 02 22:26:03.767035 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:03.767008    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-openshift-service-ca" pod "c90a5e2d-6ada-450f-b930-5ba0fe60b1c5" (UID: "c90a5e2d-6ada-450f-b930-5ba0fe60b1c5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:26:03.767256 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:03.767237    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:03.768936 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:03.768903    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-metrics-certs" pod "c90a5e2d-6ada-450f-b930-5ba0fe60b1c5" (UID: "c90a5e2d-6ada-450f-b930-5ba0fe60b1c5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:26:03.769201 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:03.769182    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-maas-api-tls" pod "c90a5e2d-6ada-450f-b930-5ba0fe60b1c5" (UID: "c90a5e2d-6ada-450f-b930-5ba0fe60b1c5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:26:03.769319 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:03.769248    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-kube-api-access-m948m" pod "c90a5e2d-6ada-450f-b930-5ba0fe60b1c5" (UID: "c90a5e2d-6ada-450f-b930-5ba0fe60b1c5"). InnerVolumeSpecName "kube-api-access-m948m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:26:03.872030 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:03.868375    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:03.872030 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:03.868413    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:03.872030 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:03.868428    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m948m\" (UniqueName: \"kubernetes.io/projected/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5-kube-api-access-m948m\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:04.095758 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:04.095680    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:04.341167 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:04.341125    5076 generic.go:356] "Generic (PLEG): container finished" podID="c90a5e2d-6ada-450f-b930-5ba0fe60b1c5" containerID="06136650ab36061b4e11860c884f0c59e9dafdb73d8f6d20e753dc6a39bef76c" exitCode=0
Nov 02 22:26:04.341339 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:04.341176    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"
Nov 02 22:26:04.341339 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:04.341209    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs" event={"ID":"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5","Type":"ContainerDied","Data":"06136650ab36061b4e11860c884f0c59e9dafdb73d8f6d20e753dc6a39bef76c"}
Nov 02 22:26:04.341339 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:04.341284    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs" event={"ID":"c90a5e2d-6ada-450f-b930-5ba0fe60b1c5","Type":"ContainerDied","Data":"753d723ba668ebd06098c996a38bf43876f0ee2cf1d94ea42f4fe9e1ee10f4c2"}
Nov 02 22:26:04.341339 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:04.341307    5076 scope.go:122] "RemoveContainer" containerID="06136650ab36061b4e11860c884f0c59e9dafdb73d8f6d20e753dc6a39bef76c"
Nov 02 22:26:04.351904 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:04.351885    5076 scope.go:122] "RemoveContainer" containerID="06136650ab36061b4e11860c884f0c59e9dafdb73d8f6d20e753dc6a39bef76c"
Nov 02 22:26:04.352175 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:26:04.352157    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06136650ab36061b4e11860c884f0c59e9dafdb73d8f6d20e753dc6a39bef76c\": container with ID starting with 06136650ab36061b4e11860c884f0c59e9dafdb73d8f6d20e753dc6a39bef76c not found: ID does not exist" containerID="06136650ab36061b4e11860c884f0c59e9dafdb73d8f6d20e753dc6a39bef76c"
Nov 02 22:26:04.352263 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:04.352184    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06136650ab36061b4e11860c884f0c59e9dafdb73d8f6d20e753dc6a39bef76c"} err="failed to get container status \"06136650ab36061b4e11860c884f0c59e9dafdb73d8f6d20e753dc6a39bef76c\": rpc error: code = NotFound desc = could not find container \"06136650ab36061b4e11860c884f0c59e9dafdb73d8f6d20e753dc6a39bef76c\": container with ID starting with 06136650ab36061b4e11860c884f0c59e9dafdb73d8f6d20e753dc6a39bef76c not found: ID does not exist"
Nov 02 22:26:04.368083 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:04.368059    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"]
Nov 02 22:26:04.368188 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:04.368105    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5eba37-f467b859d-nckxs"]
Nov 02 22:26:04.542653 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:04.542617    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:04.718280 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:04.718252    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:04.860407 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:04.860371    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"]
Nov 02 22:26:04.860660 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:04.860629    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt" podUID="7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" containerName="istio-proxy" containerID="cri-o://518613a5641f3d189eb5a2ea39a277822563309e8c0377eb96d9272548f00920" gracePeriod=30
Nov 02 22:26:04.890346 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:04.890316    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:05.053813 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:05.053730    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c90a5e2d-6ada-450f-b930-5ba0fe60b1c5" path="/var/lib/kubelet/pods/c90a5e2d-6ada-450f-b930-5ba0fe60b1c5/volumes"
Nov 02 22:26:05.331518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:05.331437    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:05.433908 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:05.433871    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:06.200909 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:06.200872    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:06.472526 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:06.472444    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:07.160905 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:07.158004    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:07.782287 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:07.782256    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:08.110658 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:08.110624    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:08.209270 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:08.209199    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:08.388603 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:08.388525    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:09.197818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:09.197788    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:09.860373 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:09.860319    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:10.125667 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.125607    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:26:10.249562 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.249531    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-credential-socket\") pod \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") "
Nov 02 22:26:10.250091 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.249651    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-envoy\") pod \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") "
Nov 02 22:26:10.250091 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.249689    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-kube-api-access-flz8s\" (UniqueName: \"kubernetes.io/projected/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-kube-api-access-flz8s\") pod \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") "
Nov 02 22:26:10.250091 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.249715    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istiod-ca-cert\") pod \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") "
Nov 02 22:26:10.250091 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.249840    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-credential-socket" pod "7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" (UID: "7c3afa50-8fb1-44e5-ab90-d7c6a48a124c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:10.250091 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.249940    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-workload-socket\") pod \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") "
Nov 02 22:26:10.250425 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.250131    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-workload-certs\") pod \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") "
Nov 02 22:26:10.250425 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.250197    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-data\") pod \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") "
Nov 02 22:26:10.250425 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.250317    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istiod-ca-cert" pod "7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" (UID: "7c3afa50-8fb1-44e5-ab90-d7c6a48a124c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:26:10.250571 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.250478    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-workload-certs" pod "7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" (UID: "7c3afa50-8fb1-44e5-ab90-d7c6a48a124c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:10.250625 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.250545    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-data" pod "7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" (UID: "7c3afa50-8fb1-44e5-ab90-d7c6a48a124c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:10.250625 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.250579    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-token\" (UniqueName: \"kubernetes.io/projected/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-token\") pod \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") "
Nov 02 22:26:10.250625 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.250600    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-workload-socket" pod "7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" (UID: "7c3afa50-8fb1-44e5-ab90-d7c6a48a124c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:10.250766 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.250633    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-podinfo\") pod \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\" (UID: \"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c\") "
Nov 02 22:26:10.251135 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.251110    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:10.251242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.251140    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:10.251242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.251157    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:10.251242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.251172    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:10.251242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.251187    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:10.252255 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.252227    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-envoy" pod "7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" (UID: "7c3afa50-8fb1-44e5-ab90-d7c6a48a124c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:10.252398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.252378    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-kube-api-access-flz8s" pod "7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" (UID: "7c3afa50-8fb1-44e5-ab90-d7c6a48a124c"). InnerVolumeSpecName "kube-api-access-flz8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:26:10.252541 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.252522    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-token" pod "7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" (UID: "7c3afa50-8fb1-44e5-ab90-d7c6a48a124c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:26:10.252623 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.252600    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-podinfo" pod "7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" (UID: "7c3afa50-8fb1-44e5-ab90-d7c6a48a124c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:26:10.352548 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.352510    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:10.352548 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.352544    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flz8s\" (UniqueName: \"kubernetes.io/projected/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-kube-api-access-flz8s\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:10.352548 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.352556    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:10.352775 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.352564    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:10.389387 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.389309    5076 generic.go:356] "Generic (PLEG): container finished" podID="7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" containerID="518613a5641f3d189eb5a2ea39a277822563309e8c0377eb96d9272548f00920" exitCode=0
Nov 02 22:26:10.389611 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.389377    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"
Nov 02 22:26:10.389754 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.389407    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt" event={"ID":"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c","Type":"ContainerDied","Data":"518613a5641f3d189eb5a2ea39a277822563309e8c0377eb96d9272548f00920"}
Nov 02 22:26:10.389888 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.389744    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt" event={"ID":"7c3afa50-8fb1-44e5-ab90-d7c6a48a124c","Type":"ContainerDied","Data":"6cf0858c0d34ba9aa66ed95ae9b4dfba4fbafb6bda2f340fe77c86f454d6850c"}
Nov 02 22:26:10.389888 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.389801    5076 scope.go:122] "RemoveContainer" containerID="518613a5641f3d189eb5a2ea39a277822563309e8c0377eb96d9272548f00920"
Nov 02 22:26:10.404453 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.404430    5076 scope.go:122] "RemoveContainer" containerID="518613a5641f3d189eb5a2ea39a277822563309e8c0377eb96d9272548f00920"
Nov 02 22:26:10.404787 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:26:10.404762    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"518613a5641f3d189eb5a2ea39a277822563309e8c0377eb96d9272548f00920\": container with ID starting with 518613a5641f3d189eb5a2ea39a277822563309e8c0377eb96d9272548f00920 not found: ID does not exist" containerID="518613a5641f3d189eb5a2ea39a277822563309e8c0377eb96d9272548f00920"
Nov 02 22:26:10.404860 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.404800    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"518613a5641f3d189eb5a2ea39a277822563309e8c0377eb96d9272548f00920"} err="failed to get container status \"518613a5641f3d189eb5a2ea39a277822563309e8c0377eb96d9272548f00920\": rpc error: code = NotFound desc = could not find container \"518613a5641f3d189eb5a2ea39a277822563309e8c0377eb96d9272548f00920\": container with ID starting with 518613a5641f3d189eb5a2ea39a277822563309e8c0377eb96d9272548f00920 not found: ID does not exist"
Nov 02 22:26:10.407872 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.407819    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:10.422475 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.422398    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"]
Nov 02 22:26:10.426758 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.426734    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w0-7bb56e-openshift-default-558658cfff-w89nt"]
Nov 02 22:26:10.571317 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.571286    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:10.813114 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.813025    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:10.919271 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:10.919205    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:11.038069 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:11.037895    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:11.059154 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:11.059119    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" path="/var/lib/kubelet/pods/7c3afa50-8fb1-44e5-ab90-d7c6a48a124c/volumes"
Nov 02 22:26:11.120041 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:11.119988    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:11.294241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:11.283341    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:11.858115 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:11.858079    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:12.328860 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:12.328790    5076 scope.go:122] "RemoveContainer" containerID="c743957a965b0db6914723007a4e08e93789f55199ccaef175b4ed68af22a35b"
Nov 02 22:26:12.829458 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:12.829414    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:13.390242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:13.379111    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"]
Nov 02 22:26:13.390242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:13.379554    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt" podUID="6b001b82-1101-4177-af42-7636d39d53be" containerName="maas-api" containerID="cri-o://a1460c38c21d2d84d76e5ac06518f5784a5810469d4d1c5336112ac52ae43043" gracePeriod=30
Nov 02 22:26:13.421866 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:13.421820    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:13.550812 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:13.550779    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:13.680456 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:13.677385    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:13.766308 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:13.766285    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"
Nov 02 22:26:13.808504 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:13.808477    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6b001b82-1101-4177-af42-7636d39d53be-kube-api-access-xb429\" (UniqueName: \"kubernetes.io/projected/6b001b82-1101-4177-af42-7636d39d53be-kube-api-access-xb429\") pod \"6b001b82-1101-4177-af42-7636d39d53be\" (UID: \"6b001b82-1101-4177-af42-7636d39d53be\") "
Nov 02 22:26:13.808662 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:13.808512    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6b001b82-1101-4177-af42-7636d39d53be-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b001b82-1101-4177-af42-7636d39d53be-openshift-service-ca\") pod \"6b001b82-1101-4177-af42-7636d39d53be\" (UID: \"6b001b82-1101-4177-af42-7636d39d53be\") "
Nov 02 22:26:13.808662 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:13.808589    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6b001b82-1101-4177-af42-7636d39d53be-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b001b82-1101-4177-af42-7636d39d53be-metrics-certs\") pod \"6b001b82-1101-4177-af42-7636d39d53be\" (UID: \"6b001b82-1101-4177-af42-7636d39d53be\") "
Nov 02 22:26:13.808787 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:13.808715    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6b001b82-1101-4177-af42-7636d39d53be-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b001b82-1101-4177-af42-7636d39d53be-maas-api-tls\") pod \"6b001b82-1101-4177-af42-7636d39d53be\" (UID: \"6b001b82-1101-4177-af42-7636d39d53be\") "
Nov 02 22:26:13.808989 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:13.808963    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b001b82-1101-4177-af42-7636d39d53be-openshift-service-ca" pod "6b001b82-1101-4177-af42-7636d39d53be" (UID: "6b001b82-1101-4177-af42-7636d39d53be"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:26:13.809286 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:13.809259    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b001b82-1101-4177-af42-7636d39d53be-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:13.810860 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:13.810839    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b001b82-1101-4177-af42-7636d39d53be-kube-api-access-xb429" pod "6b001b82-1101-4177-af42-7636d39d53be" (UID: "6b001b82-1101-4177-af42-7636d39d53be"). InnerVolumeSpecName "kube-api-access-xb429". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:26:13.811089 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:13.811067    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b001b82-1101-4177-af42-7636d39d53be-maas-api-tls" pod "6b001b82-1101-4177-af42-7636d39d53be" (UID: "6b001b82-1101-4177-af42-7636d39d53be"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:26:13.811432 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:13.811417    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b001b82-1101-4177-af42-7636d39d53be-metrics-certs" pod "6b001b82-1101-4177-af42-7636d39d53be" (UID: "6b001b82-1101-4177-af42-7636d39d53be"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:26:13.913131 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:13.913042    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xb429\" (UniqueName: \"kubernetes.io/projected/6b001b82-1101-4177-af42-7636d39d53be-kube-api-access-xb429\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:13.913131 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:13.913087    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b001b82-1101-4177-af42-7636d39d53be-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:13.913131 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:13.913103    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b001b82-1101-4177-af42-7636d39d53be-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:13.999815 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:13.999735    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:14.100308 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:14.100276    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:14.429681 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:14.429646    5076 generic.go:356] "Generic (PLEG): container finished" podID="6b001b82-1101-4177-af42-7636d39d53be" containerID="a1460c38c21d2d84d76e5ac06518f5784a5810469d4d1c5336112ac52ae43043" exitCode=0
Nov 02 22:26:14.430133 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:14.429687    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"
Nov 02 22:26:14.430133 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:14.429738    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt" event={"ID":"6b001b82-1101-4177-af42-7636d39d53be","Type":"ContainerDied","Data":"a1460c38c21d2d84d76e5ac06518f5784a5810469d4d1c5336112ac52ae43043"}
Nov 02 22:26:14.430133 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:14.429792    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt" event={"ID":"6b001b82-1101-4177-af42-7636d39d53be","Type":"ContainerDied","Data":"fa2cc8a8ac3d6dfde994b7cb89f2f4d6fadce8fab745fba88110c41333f371f8"}
Nov 02 22:26:14.430133 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:14.429814    5076 scope.go:122] "RemoveContainer" containerID="a1460c38c21d2d84d76e5ac06518f5784a5810469d4d1c5336112ac52ae43043"
Nov 02 22:26:14.440689 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:14.440670    5076 scope.go:122] "RemoveContainer" containerID="a1460c38c21d2d84d76e5ac06518f5784a5810469d4d1c5336112ac52ae43043"
Nov 02 22:26:14.440994 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:26:14.440956    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1460c38c21d2d84d76e5ac06518f5784a5810469d4d1c5336112ac52ae43043\": container with ID starting with a1460c38c21d2d84d76e5ac06518f5784a5810469d4d1c5336112ac52ae43043 not found: ID does not exist" containerID="a1460c38c21d2d84d76e5ac06518f5784a5810469d4d1c5336112ac52ae43043"
Nov 02 22:26:14.440994 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:14.440986    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1460c38c21d2d84d76e5ac06518f5784a5810469d4d1c5336112ac52ae43043"} err="failed to get container status \"a1460c38c21d2d84d76e5ac06518f5784a5810469d4d1c5336112ac52ae43043\": rpc error: code = NotFound desc = could not find container \"a1460c38c21d2d84d76e5ac06518f5784a5810469d4d1c5336112ac52ae43043\": container with ID starting with a1460c38c21d2d84d76e5ac06518f5784a5810469d4d1c5336112ac52ae43043 not found: ID does not exist"
Nov 02 22:26:14.452069 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:14.452042    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"]
Nov 02 22:26:14.455793 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:14.455771    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-ac0910-5845754c55-2xqpt"]
Nov 02 22:26:14.804817 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:14.804733    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:15.053303 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:15.053267    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6b001b82-1101-4177-af42-7636d39d53be" path="/var/lib/kubelet/pods/6b001b82-1101-4177-af42-7636d39d53be/volumes"
Nov 02 22:26:15.570293 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:15.570257    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:15.729864 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:15.729836    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:15.829461 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:15.829375    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:16.197180 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:16.197151    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:16.315410 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:16.315374    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"]
Nov 02 22:26:16.398796 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:16.398760    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:16.979742 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:16.979703    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:17.587664 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:17.587625    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:17.664037 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:17.663111    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main" containerID="cri-o://58f9c23fb9d4c2ff125d2dd72d5c97766c1e690489e1ce8cd8dc63d8b60d7400" gracePeriod=45
Nov 02 22:26:17.681099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:17.681059    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main" containerID="cri-o://d0c5855e4b16a60e8a718447f1e447d6ad74ab4917ec568a639af56b505dbcad" gracePeriod=45
Nov 02 22:26:17.949856 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:17.949816    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:26:17.962676 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:17.962643    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6b055e70-1c04-48f7-a96e-68ac94b0b283-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b055e70-1c04-48f7-a96e-68ac94b0b283-tls-certs\") pod \"6b055e70-1c04-48f7-a96e-68ac94b0b283\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") "
Nov 02 22:26:17.962830 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:17.962698    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-model-cache\") pod \"6b055e70-1c04-48f7-a96e-68ac94b0b283\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") "
Nov 02 22:26:17.962830 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:17.962785    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6b055e70-1c04-48f7-a96e-68ac94b0b283-kube-api-access-hhkwq\" (UniqueName: \"kubernetes.io/projected/6b055e70-1c04-48f7-a96e-68ac94b0b283-kube-api-access-hhkwq\") pod \"6b055e70-1c04-48f7-a96e-68ac94b0b283\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") "
Nov 02 22:26:17.962830 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:17.962819    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-dshm\") pod \"6b055e70-1c04-48f7-a96e-68ac94b0b283\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") "
Nov 02 22:26:17.962997 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:17.962957    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-home\" (UniqueName: \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-home\") pod \"6b055e70-1c04-48f7-a96e-68ac94b0b283\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") "
Nov 02 22:26:17.962997 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:17.962984    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-tmp-dir\") pod \"6b055e70-1c04-48f7-a96e-68ac94b0b283\" (UID: \"6b055e70-1c04-48f7-a96e-68ac94b0b283\") "
Nov 02 22:26:17.963777 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:17.963722    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-model-cache" pod "6b055e70-1c04-48f7-a96e-68ac94b0b283" (UID: "6b055e70-1c04-48f7-a96e-68ac94b0b283"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:17.963990 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:17.963969    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-tmp-dir" pod "6b055e70-1c04-48f7-a96e-68ac94b0b283" (UID: "6b055e70-1c04-48f7-a96e-68ac94b0b283"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:17.964299 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:17.964267    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-home" pod "6b055e70-1c04-48f7-a96e-68ac94b0b283" (UID: "6b055e70-1c04-48f7-a96e-68ac94b0b283"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:17.972478 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:17.972449    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b055e70-1c04-48f7-a96e-68ac94b0b283-tls-certs" pod "6b055e70-1c04-48f7-a96e-68ac94b0b283" (UID: "6b055e70-1c04-48f7-a96e-68ac94b0b283"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:26:17.979705 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:17.979662    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-dshm" pod "6b055e70-1c04-48f7-a96e-68ac94b0b283" (UID: "6b055e70-1c04-48f7-a96e-68ac94b0b283"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:17.980199 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:17.979958    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b055e70-1c04-48f7-a96e-68ac94b0b283-kube-api-access-hhkwq" pod "6b055e70-1c04-48f7-a96e-68ac94b0b283" (UID: "6b055e70-1c04-48f7-a96e-68ac94b0b283"). InnerVolumeSpecName "kube-api-access-hhkwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:26:17.992286 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:17.992267    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:26:18.063689 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.063651    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-home\" (UniqueName: \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-home\") pod \"820969fa-17ed-4e6c-8628-05def8372fdc\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") "
Nov 02 22:26:18.063858 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.063717    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/820969fa-17ed-4e6c-8628-05def8372fdc-kube-api-access-tvhxg\" (UniqueName: \"kubernetes.io/projected/820969fa-17ed-4e6c-8628-05def8372fdc-kube-api-access-tvhxg\") pod \"820969fa-17ed-4e6c-8628-05def8372fdc\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") "
Nov 02 22:26:18.063858 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.063824    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-model-cache\") pod \"820969fa-17ed-4e6c-8628-05def8372fdc\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") "
Nov 02 22:26:18.063973 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.063872    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-dshm\" (UniqueName: \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-dshm\") pod \"820969fa-17ed-4e6c-8628-05def8372fdc\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") "
Nov 02 22:26:18.063973 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.063917    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-tmp-dir\") pod \"820969fa-17ed-4e6c-8628-05def8372fdc\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") "
Nov 02 22:26:18.063973 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.063959    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-home" pod "820969fa-17ed-4e6c-8628-05def8372fdc" (UID: "820969fa-17ed-4e6c-8628-05def8372fdc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:18.064182 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.064012    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/820969fa-17ed-4e6c-8628-05def8372fdc-tls-certs\" (UniqueName: \"kubernetes.io/secret/820969fa-17ed-4e6c-8628-05def8372fdc-tls-certs\") pod \"820969fa-17ed-4e6c-8628-05def8372fdc\" (UID: \"820969fa-17ed-4e6c-8628-05def8372fdc\") "
Nov 02 22:26:18.064276 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.064182    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-model-cache" pod "820969fa-17ed-4e6c-8628-05def8372fdc" (UID: "820969fa-17ed-4e6c-8628-05def8372fdc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:18.064608 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.064581    5076 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-model-cache\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:18.064608 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.064607    5076 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-home\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:18.064782 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.064621    5076 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-tmp-dir\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:18.064782 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.064634    5076 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b055e70-1c04-48f7-a96e-68ac94b0b283-tls-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:18.064782 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.064646    5076 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-model-cache\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:18.064782 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.064658    5076 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-home\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:18.064782 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.064672    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhkwq\" (UniqueName: \"kubernetes.io/projected/6b055e70-1c04-48f7-a96e-68ac94b0b283-kube-api-access-hhkwq\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:18.064782 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.064684    5076 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b055e70-1c04-48f7-a96e-68ac94b0b283-dshm\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:18.065090 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.065022    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-tmp-dir" pod "820969fa-17ed-4e6c-8628-05def8372fdc" (UID: "820969fa-17ed-4e6c-8628-05def8372fdc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:18.066562 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.066534    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/820969fa-17ed-4e6c-8628-05def8372fdc-kube-api-access-tvhxg" pod "820969fa-17ed-4e6c-8628-05def8372fdc" (UID: "820969fa-17ed-4e6c-8628-05def8372fdc"). InnerVolumeSpecName "kube-api-access-tvhxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:26:18.066792 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.066756    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-dshm" pod "820969fa-17ed-4e6c-8628-05def8372fdc" (UID: "820969fa-17ed-4e6c-8628-05def8372fdc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:18.067618 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.067595    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820969fa-17ed-4e6c-8628-05def8372fdc-tls-certs" pod "820969fa-17ed-4e6c-8628-05def8372fdc" (UID: "820969fa-17ed-4e6c-8628-05def8372fdc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:26:18.165457 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.165427    5076 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-dshm\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:18.165457 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.165455    5076 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/820969fa-17ed-4e6c-8628-05def8372fdc-tmp-dir\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:18.165457 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.165465    5076 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/820969fa-17ed-4e6c-8628-05def8372fdc-tls-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:18.165685 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.165474    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvhxg\" (UniqueName: \"kubernetes.io/projected/820969fa-17ed-4e6c-8628-05def8372fdc-kube-api-access-tvhxg\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:18.365072 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.365039    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:18.459813 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.459727    5076 generic.go:356] "Generic (PLEG): container finished" podID="820969fa-17ed-4e6c-8628-05def8372fdc" containerID="d0c5855e4b16a60e8a718447f1e447d6ad74ab4917ec568a639af56b505dbcad" exitCode=0
Nov 02 22:26:18.459813 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.459778    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"
Nov 02 22:26:18.460027 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.459807    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" event={"ID":"820969fa-17ed-4e6c-8628-05def8372fdc","Type":"ContainerDied","Data":"d0c5855e4b16a60e8a718447f1e447d6ad74ab4917ec568a639af56b505dbcad"}
Nov 02 22:26:18.460027 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.459853    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d" event={"ID":"820969fa-17ed-4e6c-8628-05def8372fdc","Type":"ContainerDied","Data":"622ac4631eb8f47d494634e52b9cf9126ff1cf148bfe98f9e00b5fff538433f4"}
Nov 02 22:26:18.460027 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.459873    5076 scope.go:122] "RemoveContainer" containerID="d0c5855e4b16a60e8a718447f1e447d6ad74ab4917ec568a639af56b505dbcad"
Nov 02 22:26:18.464756 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.464728    5076 generic.go:356] "Generic (PLEG): container finished" podID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerID="58f9c23fb9d4c2ff125d2dd72d5c97766c1e690489e1ce8cd8dc63d8b60d7400" exitCode=0
Nov 02 22:26:18.464896 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.464783    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"
Nov 02 22:26:18.464896 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.464809    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" event={"ID":"6b055e70-1c04-48f7-a96e-68ac94b0b283","Type":"ContainerDied","Data":"58f9c23fb9d4c2ff125d2dd72d5c97766c1e690489e1ce8cd8dc63d8b60d7400"}
Nov 02 22:26:18.464896 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.464843    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh" event={"ID":"6b055e70-1c04-48f7-a96e-68ac94b0b283","Type":"ContainerDied","Data":"794b3bcf61d0747695ea61b74b1344c05332d4b83345c94d87f4b97c3640e746"}
Nov 02 22:26:18.474256 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.473352    5076 scope.go:122] "RemoveContainer" containerID="d0c5855e4b16a60e8a718447f1e447d6ad74ab4917ec568a639af56b505dbcad"
Nov 02 22:26:18.483116 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:26:18.481992    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0c5855e4b16a60e8a718447f1e447d6ad74ab4917ec568a639af56b505dbcad\": container with ID starting with d0c5855e4b16a60e8a718447f1e447d6ad74ab4917ec568a639af56b505dbcad not found: ID does not exist" containerID="d0c5855e4b16a60e8a718447f1e447d6ad74ab4917ec568a639af56b505dbcad"
Nov 02 22:26:18.483116 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.482028    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0c5855e4b16a60e8a718447f1e447d6ad74ab4917ec568a639af56b505dbcad"} err="failed to get container status \"d0c5855e4b16a60e8a718447f1e447d6ad74ab4917ec568a639af56b505dbcad\": rpc error: code = NotFound desc = could not find container \"d0c5855e4b16a60e8a718447f1e447d6ad74ab4917ec568a639af56b505dbcad\": container with ID starting with d0c5855e4b16a60e8a718447f1e447d6ad74ab4917ec568a639af56b505dbcad not found: ID does not exist"
Nov 02 22:26:18.483116 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.482053    5076 scope.go:122] "RemoveContainer" containerID="58f9c23fb9d4c2ff125d2dd72d5c97766c1e690489e1ce8cd8dc63d8b60d7400"
Nov 02 22:26:18.486273 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.486250    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"]
Nov 02 22:26:18.491161 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.491139    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-719012/simulator-w3-719012-kserve-f4cbcd86d-rxt7d"]
Nov 02 22:26:18.492617 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.492589    5076 scope.go:122] "RemoveContainer" containerID="58f9c23fb9d4c2ff125d2dd72d5c97766c1e690489e1ce8cd8dc63d8b60d7400"
Nov 02 22:26:18.493059 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:26:18.493023    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58f9c23fb9d4c2ff125d2dd72d5c97766c1e690489e1ce8cd8dc63d8b60d7400\": container with ID starting with 58f9c23fb9d4c2ff125d2dd72d5c97766c1e690489e1ce8cd8dc63d8b60d7400 not found: ID does not exist" containerID="58f9c23fb9d4c2ff125d2dd72d5c97766c1e690489e1ce8cd8dc63d8b60d7400"
Nov 02 22:26:18.493124 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.493081    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58f9c23fb9d4c2ff125d2dd72d5c97766c1e690489e1ce8cd8dc63d8b60d7400"} err="failed to get container status \"58f9c23fb9d4c2ff125d2dd72d5c97766c1e690489e1ce8cd8dc63d8b60d7400\": rpc error: code = NotFound desc = could not find container \"58f9c23fb9d4c2ff125d2dd72d5c97766c1e690489e1ce8cd8dc63d8b60d7400\": container with ID starting with 58f9c23fb9d4c2ff125d2dd72d5c97766c1e690489e1ce8cd8dc63d8b60d7400 not found: ID does not exist"
Nov 02 22:26:18.501876 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.501856    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"]
Nov 02 22:26:18.504059 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.504035    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-719012/distinct-2-w3-719012-kserve-c7bdf68f9-wn6hh"]
Nov 02 22:26:18.979783 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:18.979748    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:19.059936 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:19.059902    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" path="/var/lib/kubelet/pods/6b055e70-1c04-48f7-a96e-68ac94b0b283/volumes"
Nov 02 22:26:19.060553 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:19.060532    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" path="/var/lib/kubelet/pods/820969fa-17ed-4e6c-8628-05def8372fdc/volumes"
Nov 02 22:26:19.574329 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:19.574298    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:20.003162 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.003134    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:20.103472 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.103434    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:20.273653 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.273563    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:20.481286 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.481253    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:20.802644 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.802602    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f"]
Nov 02 22:26:20.803299 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803273    5076 cpu_manager.go:414] "containerMap: removing container" podUID="7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" containerName="istio-proxy"
Nov 02 22:26:20.803356 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803301    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" containerName="istio-proxy"
Nov 02 22:26:20.803356 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803321    5076 cpu_manager.go:414] "containerMap: removing container" podUID="db7c9431-656a-4ff5-9ee6-bbdf456ec5fa" containerName="discovery"
Nov 02 22:26:20.803356 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803329    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="db7c9431-656a-4ff5-9ee6-bbdf456ec5fa" containerName="discovery"
Nov 02 22:26:20.803356 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803340    5076 cpu_manager.go:414] "containerMap: removing container" podUID="5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" containerName="istio-proxy"
Nov 02 22:26:20.803356 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803349    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" containerName="istio-proxy"
Nov 02 22:26:20.803509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803359    5076 cpu_manager.go:414] "containerMap: removing container" podUID="75affa76-6588-4026-bb96-573b65ea5ce8" containerName="istio-proxy"
Nov 02 22:26:20.803509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803367    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75affa76-6588-4026-bb96-573b65ea5ce8" containerName="istio-proxy"
Nov 02 22:26:20.803509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803380    5076 cpu_manager.go:414] "containerMap: removing container" podUID="c90a5e2d-6ada-450f-b930-5ba0fe60b1c5" containerName="maas-api"
Nov 02 22:26:20.803509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803387    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c90a5e2d-6ada-450f-b930-5ba0fe60b1c5" containerName="maas-api"
Nov 02 22:26:20.803509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803397    5076 cpu_manager.go:414] "containerMap: removing container" podUID="db7c9431-656a-4ff5-9ee6-bbdf456ec5fa" containerName="discovery"
Nov 02 22:26:20.803509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803404    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="db7c9431-656a-4ff5-9ee6-bbdf456ec5fa" containerName="discovery"
Nov 02 22:26:20.803509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803416    5076 cpu_manager.go:414] "containerMap: removing container" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main"
Nov 02 22:26:20.803509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803423    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main"
Nov 02 22:26:20.803509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803433    5076 cpu_manager.go:414] "containerMap: removing container" podUID="6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476" containerName="maas-api"
Nov 02 22:26:20.803509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803440    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476" containerName="maas-api"
Nov 02 22:26:20.803509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803455    5076 cpu_manager.go:414] "containerMap: removing container" podUID="b57e9830-dbca-4612-b162-f7dbfafe7d3a" containerName="maas-api"
Nov 02 22:26:20.803509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803462    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b57e9830-dbca-4612-b162-f7dbfafe7d3a" containerName="maas-api"
Nov 02 22:26:20.803509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803482    5076 cpu_manager.go:414] "containerMap: removing container" podUID="c29d7205-65d5-49f9-8e49-834671694b92" containerName="istio-proxy"
Nov 02 22:26:20.803509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803489    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c29d7205-65d5-49f9-8e49-834671694b92" containerName="istio-proxy"
Nov 02 22:26:20.803509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803501    5076 cpu_manager.go:414] "containerMap: removing container" podUID="0252ac19-8757-4b54-9d18-79342afbc0b7" containerName="maas-api"
Nov 02 22:26:20.803509 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803508    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0252ac19-8757-4b54-9d18-79342afbc0b7" containerName="maas-api"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803520    5076 cpu_manager.go:414] "containerMap: removing container" podUID="a35fda59-30bb-45f0-b723-a917027ad697" containerName="main"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803526    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a35fda59-30bb-45f0-b723-a917027ad697" containerName="main"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803540    5076 cpu_manager.go:414] "containerMap: removing container" podUID="c9896887-2ff5-4567-a650-6de8c5f25135" containerName="istio-proxy"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803547    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c9896887-2ff5-4567-a650-6de8c5f25135" containerName="istio-proxy"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803556    5076 cpu_manager.go:414] "containerMap: removing container" podUID="a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" containerName="istio-proxy"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803563    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" containerName="istio-proxy"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803573    5076 cpu_manager.go:414] "containerMap: removing container" podUID="065ff515-e8ec-4d5d-9bc4-161017ebc705" containerName="maas-api"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803581    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="065ff515-e8ec-4d5d-9bc4-161017ebc705" containerName="maas-api"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803610    5076 cpu_manager.go:414] "containerMap: removing container" podUID="15d4c979-5871-42fa-9cb4-10ca87638d95" containerName="istio-proxy"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803617    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="15d4c979-5871-42fa-9cb4-10ca87638d95" containerName="istio-proxy"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803627    5076 cpu_manager.go:414] "containerMap: removing container" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803633    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803644    5076 cpu_manager.go:414] "containerMap: removing container" podUID="6b001b82-1101-4177-af42-7636d39d53be" containerName="maas-api"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803650    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6b001b82-1101-4177-af42-7636d39d53be" containerName="maas-api"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803660    5076 cpu_manager.go:414] "containerMap: removing container" podUID="a3737eb7-9ed7-4193-a612-3fb38cade513" containerName="maas-api"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803667    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a3737eb7-9ed7-4193-a612-3fb38cade513" containerName="maas-api"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803677    5076 cpu_manager.go:414] "containerMap: removing container" podUID="35ee896c-9d7e-4b87-aaf7-c000622f208e" containerName="istio-proxy"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803684    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="35ee896c-9d7e-4b87-aaf7-c000622f208e" containerName="istio-proxy"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803698    5076 cpu_manager.go:414] "containerMap: removing container" podUID="9164f6d8-20d6-4051-af7a-ea57cafff9a2" containerName="maas-api"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803704    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9164f6d8-20d6-4051-af7a-ea57cafff9a2" containerName="maas-api"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803827    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="7c3afa50-8fb1-44e5-ab90-d7c6a48a124c" containerName="istio-proxy"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803841    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="db7c9431-656a-4ff5-9ee6-bbdf456ec5fa" containerName="discovery"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803849    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="5d4a7334-30f4-4b93-ac4d-edfda88cf5d6" containerName="istio-proxy"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803859    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="75affa76-6588-4026-bb96-573b65ea5ce8" containerName="istio-proxy"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803869    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="c90a5e2d-6ada-450f-b930-5ba0fe60b1c5" containerName="maas-api"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803878    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="db7c9431-656a-4ff5-9ee6-bbdf456ec5fa" containerName="discovery"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803887    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="820969fa-17ed-4e6c-8628-05def8372fdc" containerName="main"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803896    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="6d7ed6f8-f0de-48d6-9172-a0cdb3bc0476" containerName="maas-api"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803906    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="b57e9830-dbca-4612-b162-f7dbfafe7d3a" containerName="maas-api"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803917    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="c29d7205-65d5-49f9-8e49-834671694b92" containerName="istio-proxy"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803927    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="0252ac19-8757-4b54-9d18-79342afbc0b7" containerName="maas-api"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803934    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="a35fda59-30bb-45f0-b723-a917027ad697" containerName="main"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803942    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="c9896887-2ff5-4567-a650-6de8c5f25135" containerName="istio-proxy"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803950    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="a7ef9602-dd0b-44fd-b422-d9b6bc0829c7" containerName="istio-proxy"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803960    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="065ff515-e8ec-4d5d-9bc4-161017ebc705" containerName="maas-api"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803971    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="15d4c979-5871-42fa-9cb4-10ca87638d95" containerName="istio-proxy"
Nov 02 22:26:20.803969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803979    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="6b055e70-1c04-48f7-a96e-68ac94b0b283" containerName="main"
Nov 02 22:26:20.805037 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803987    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="6b001b82-1101-4177-af42-7636d39d53be" containerName="maas-api"
Nov 02 22:26:20.805037 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.803994    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="a3737eb7-9ed7-4193-a612-3fb38cade513" containerName="maas-api"
Nov 02 22:26:20.805037 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.804002    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="35ee896c-9d7e-4b87-aaf7-c000622f208e" containerName="istio-proxy"
Nov 02 22:26:20.805037 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.804011    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="9164f6d8-20d6-4051-af7a-ea57cafff9a2" containerName="maas-api"
Nov 02 22:26:20.809320 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.809292    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f"
Nov 02 22:26:20.812600 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.812567    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f"]
Nov 02 22:26:20.843458 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.843433    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 02 22:26:20.843581 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.843480    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n7t66\""
Nov 02 22:26:20.895896 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.895870    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t25wb\" (UniqueName: \"kubernetes.io/projected/e4f20388-87bb-4591-bee6-bedbf14d05a6-kube-api-access-t25wb\") pod \"maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f\" (UID: \"e4f20388-87bb-4591-bee6-bedbf14d05a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f"
Nov 02 22:26:20.896016 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.895918    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e4f20388-87bb-4591-bee6-bedbf14d05a6-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f\" (UID: \"e4f20388-87bb-4591-bee6-bedbf14d05a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f"
Nov 02 22:26:20.896054 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.896015    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e4f20388-87bb-4591-bee6-bedbf14d05a6-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f\" (UID: \"e4f20388-87bb-4591-bee6-bedbf14d05a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f"
Nov 02 22:26:20.997388 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.997352    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t25wb\" (UniqueName: \"kubernetes.io/projected/e4f20388-87bb-4591-bee6-bedbf14d05a6-kube-api-access-t25wb\") pod \"maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f\" (UID: \"e4f20388-87bb-4591-bee6-bedbf14d05a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f"
Nov 02 22:26:20.997540 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.997427    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e4f20388-87bb-4591-bee6-bedbf14d05a6-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f\" (UID: \"e4f20388-87bb-4591-bee6-bedbf14d05a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f"
Nov 02 22:26:20.997540 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.997489    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e4f20388-87bb-4591-bee6-bedbf14d05a6-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f\" (UID: \"e4f20388-87bb-4591-bee6-bedbf14d05a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f"
Nov 02 22:26:20.998320 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.998296    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e4f20388-87bb-4591-bee6-bedbf14d05a6-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f\" (UID: \"e4f20388-87bb-4591-bee6-bedbf14d05a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f"
Nov 02 22:26:20.999894 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:20.999862    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e4f20388-87bb-4591-bee6-bedbf14d05a6-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f\" (UID: \"e4f20388-87bb-4591-bee6-bedbf14d05a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f"
Nov 02 22:26:21.004999 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:21.004972    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t25wb\" (UniqueName: \"kubernetes.io/projected/e4f20388-87bb-4591-bee6-bedbf14d05a6-kube-api-access-t25wb\") pod \"maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f\" (UID: \"e4f20388-87bb-4591-bee6-bedbf14d05a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f"
Nov 02 22:26:21.126966 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:21.126933    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f"
Nov 02 22:26:21.259928 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:21.259899    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:21.408543 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:21.408504    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f"]
Nov 02 22:26:21.409554 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:26:21.409527    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4f20388_87bb_4591_bee6_bedbf14d05a6.slice/crio-5f47f6c79ffe585898e30b7422e87d94815354a994d6ff09ab37a4f8a08e44bb WatchSource:0}: Error finding container 5f47f6c79ffe585898e30b7422e87d94815354a994d6ff09ab37a4f8a08e44bb: Status 404 returned error can't find the container with id 5f47f6c79ffe585898e30b7422e87d94815354a994d6ff09ab37a4f8a08e44bb
Nov 02 22:26:21.494717 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:21.494685    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f" event={"ID":"e4f20388-87bb-4591-bee6-bedbf14d05a6","Type":"ContainerStarted","Data":"5f47f6c79ffe585898e30b7422e87d94815354a994d6ff09ab37a4f8a08e44bb"}
Nov 02 22:26:21.757281 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:21.757196    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:21.856820 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:21.856781    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:22.057205 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:22.057123    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:22.504676 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:22.504640    5076 generic.go:356] "Generic (PLEG): container finished" podID="e4f20388-87bb-4591-bee6-bedbf14d05a6" containerID="ce072cef93f0c5a4af52560dde99e19f9d811302c659e126b160f8e80101f8fd" exitCode=0
Nov 02 22:26:22.505088 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:22.504735    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f" event={"ID":"e4f20388-87bb-4591-bee6-bedbf14d05a6","Type":"ContainerDied","Data":"ce072cef93f0c5a4af52560dde99e19f9d811302c659e126b160f8e80101f8fd"}
Nov 02 22:26:22.903646 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:22.903610    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:23.570717 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:23.570679    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:23.771780 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:23.771645    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:23.786253 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:23.785994    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f"
Nov 02 22:26:23.869749 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:23.869702    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e4f20388-87bb-4591-bee6-bedbf14d05a6-kube-api-access-t25wb\" (UniqueName: \"kubernetes.io/projected/e4f20388-87bb-4591-bee6-bedbf14d05a6-kube-api-access-t25wb\") pod \"e4f20388-87bb-4591-bee6-bedbf14d05a6\" (UID: \"e4f20388-87bb-4591-bee6-bedbf14d05a6\") "
Nov 02 22:26:23.870126 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:23.870105    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e4f20388-87bb-4591-bee6-bedbf14d05a6-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e4f20388-87bb-4591-bee6-bedbf14d05a6-maas-api-openshift-ca\") pod \"e4f20388-87bb-4591-bee6-bedbf14d05a6\" (UID: \"e4f20388-87bb-4591-bee6-bedbf14d05a6\") "
Nov 02 22:26:23.870348 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:23.870318    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e4f20388-87bb-4591-bee6-bedbf14d05a6-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e4f20388-87bb-4591-bee6-bedbf14d05a6-maas-api-xks-ca\") pod \"e4f20388-87bb-4591-bee6-bedbf14d05a6\" (UID: \"e4f20388-87bb-4591-bee6-bedbf14d05a6\") "
Nov 02 22:26:23.871775 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:23.871735    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4f20388-87bb-4591-bee6-bedbf14d05a6-maas-api-openshift-ca" pod "e4f20388-87bb-4591-bee6-bedbf14d05a6" (UID: "e4f20388-87bb-4591-bee6-bedbf14d05a6"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:26:23.923752 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:23.923713    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4f20388-87bb-4591-bee6-bedbf14d05a6-maas-api-xks-ca" pod "e4f20388-87bb-4591-bee6-bedbf14d05a6" (UID: "e4f20388-87bb-4591-bee6-bedbf14d05a6"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:26:23.924085 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:23.924025    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4f20388-87bb-4591-bee6-bedbf14d05a6-kube-api-access-t25wb" pod "e4f20388-87bb-4591-bee6-bedbf14d05a6" (UID: "e4f20388-87bb-4591-bee6-bedbf14d05a6"). InnerVolumeSpecName "kube-api-access-t25wb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:26:23.972211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:23.972167    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t25wb\" (UniqueName: \"kubernetes.io/projected/e4f20388-87bb-4591-bee6-bedbf14d05a6-kube-api-access-t25wb\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:23.972211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:23.972207    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e4f20388-87bb-4591-bee6-bedbf14d05a6-maas-api-openshift-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:23.972424 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:23.972242    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e4f20388-87bb-4591-bee6-bedbf14d05a6-maas-api-xks-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:24.058861 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:24.058773    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:24.156268 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:24.156192    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:24.475668 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:24.475638    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:24.518796 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:24.518764    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f"
Nov 02 22:26:24.518796 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:24.518787    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f" event={"ID":"e4f20388-87bb-4591-bee6-bedbf14d05a6","Type":"ContainerDied","Data":"5f47f6c79ffe585898e30b7422e87d94815354a994d6ff09ab37a4f8a08e44bb"}
Nov 02 22:26:24.518987 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:24.518840    5076 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f47f6c79ffe585898e30b7422e87d94815354a994d6ff09ab37a4f8a08e44bb"
Nov 02 22:26:24.694986 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:24.694939    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:24.795937 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:24.795844    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:24.912207 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:24.912171    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:25.587790 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:25.587761    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:26.284378 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:26.284349    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:26.988104 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:26.988071    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:27.583069 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:27.583038    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:28.187370 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:28.187332    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:28.829826 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:28.829796    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:29.535918 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:29.535635    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:29.889762 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:26:29.889730    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:26:30.286181 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:30.286094    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:30.531190 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:30.531156    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:30.628705 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:30.628673    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:30.849929 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:30.849891    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"]
Nov 02 22:26:30.850444 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:30.850391    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw" podUID="f964213a-023a-415b-b5f7-012677864849" containerName="istio-proxy" containerID="cri-o://b6129150c5242f5d559e61d58cbd79233df0c8294bf79d6616315b2bc4e8ebda" gracePeriod=30
Nov 02 22:26:30.879039 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:30.878962    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:30.997901 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:30.997866    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:31.095035 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.094999    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:31.336511 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.336426    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main" containerID="cri-o://e2469626a51ea0933eaa5a11cd0f5e9598662c8870cd1847daa47194378f8acf" gracePeriod=45
Nov 02 22:26:31.566381 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.566350    5076 generic.go:356] "Generic (PLEG): container finished" podID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerID="e2469626a51ea0933eaa5a11cd0f5e9598662c8870cd1847daa47194378f8acf" exitCode=0
Nov 02 22:26:31.566558 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.566390    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" event={"ID":"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca","Type":"ContainerDied","Data":"e2469626a51ea0933eaa5a11cd0f5e9598662c8870cd1847daa47194378f8acf"}
Nov 02 22:26:31.611505 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.611478    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:26:31.683971 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.683851    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:31.760749 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.760715    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-dshm\") pod \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") "
Nov 02 22:26:31.760946 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.760834    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-tls-certs\" (UniqueName: \"kubernetes.io/secret/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-tls-certs\") pod \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") "
Nov 02 22:26:31.760946 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.760898    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-home\" (UniqueName: \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-home\") pod \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") "
Nov 02 22:26:31.761100 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.760947    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-kube-api-access-8prpf\" (UniqueName: \"kubernetes.io/projected/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-kube-api-access-8prpf\") pod \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") "
Nov 02 22:26:31.761100 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.761017    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-tmp-dir\") pod \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") "
Nov 02 22:26:31.761100 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.761051    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-model-cache\") pod \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\" (UID: \"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca\") "
Nov 02 22:26:31.761287 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.761193    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-home" pod "4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" (UID: "4dc91fc4-af6f-4f19-87e5-1a2d4db152ca"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:31.761485 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.761460    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-tmp-dir" pod "4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" (UID: "4dc91fc4-af6f-4f19-87e5-1a2d4db152ca"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:31.761485 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.761469    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-model-cache" pod "4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" (UID: "4dc91fc4-af6f-4f19-87e5-1a2d4db152ca"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:31.761641 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.761544    5076 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-home\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:31.763479 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.763445    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-kube-api-access-8prpf" pod "4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" (UID: "4dc91fc4-af6f-4f19-87e5-1a2d4db152ca"). InnerVolumeSpecName "kube-api-access-8prpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:26:31.763581 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.763475    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-tls-certs" pod "4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" (UID: "4dc91fc4-af6f-4f19-87e5-1a2d4db152ca"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:26:31.763581 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.763513    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-dshm" pod "4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" (UID: "4dc91fc4-af6f-4f19-87e5-1a2d4db152ca"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:31.867072 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.867025    5076 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-tmp-dir\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:31.867072 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.867075    5076 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-model-cache\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:31.867367 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.867095    5076 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-dshm\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:31.867367 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.867114    5076 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-tls-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:31.867367 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:31.867132    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8prpf\" (UniqueName: \"kubernetes.io/projected/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca-kube-api-access-8prpf\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:32.366241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:32.364927    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:32.565241 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:32.564912    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:32.580090 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:32.580055    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4" event={"ID":"4dc91fc4-af6f-4f19-87e5-1a2d4db152ca","Type":"ContainerDied","Data":"a92404ea8ba4f89495c85a65e36f57ba259be26c934e53497e6b099915393083"}
Nov 02 22:26:32.580336 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:32.580118    5076 scope.go:122] "RemoveContainer" containerID="e2469626a51ea0933eaa5a11cd0f5e9598662c8870cd1847daa47194378f8acf"
Nov 02 22:26:32.580336 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:32.580298    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"
Nov 02 22:26:32.626144 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:32.625945    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"]
Nov 02 22:26:32.641613 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:32.641572    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-2532af/premium-w2-2532af-kserve-55ffd9578f-drqv4"]
Nov 02 22:26:32.765362 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:32.765329    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:32.867394 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:32.867359    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:33.053704 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:33.053620    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" path="/var/lib/kubelet/pods/4dc91fc4-af6f-4f19-87e5-1a2d4db152ca/volumes"
Nov 02 22:26:33.149489 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:33.149452    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:33.586333 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:33.586297    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"]
Nov 02 22:26:33.586813 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:33.586600    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5" podUID="c057d328-8578-49a1-bf23-07616e8ed3ff" containerName="maas-api" containerID="cri-o://24240caafc958c9d3ce59979825c031d39961b78fcccb82c093a63abbc3c5290" gracePeriod=30
Nov 02 22:26:33.623420 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:33.623383    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:33.742251 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:33.740304    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"]
Nov 02 22:26:33.742251 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:33.740822    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn" podUID="2b47428d-5d2c-4d14-94dd-8f251e5b5e93" containerName="maas-api" containerID="cri-o://6cc2d34e859aa13ebb9af663d8e1014bfc692122a9649457ead63435a598c8e0" gracePeriod=30
Nov 02 22:26:33.781989 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:33.781847    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:33.884534 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:33.882639    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:34.047405 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.046980    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"
Nov 02 22:26:34.227617 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.227579    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c057d328-8578-49a1-bf23-07616e8ed3ff-metrics-certs\" (UniqueName: \"kubernetes.io/secret/c057d328-8578-49a1-bf23-07616e8ed3ff-metrics-certs\") pod \"c057d328-8578-49a1-bf23-07616e8ed3ff\" (UID: \"c057d328-8578-49a1-bf23-07616e8ed3ff\") "
Nov 02 22:26:34.227808 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.227640    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c057d328-8578-49a1-bf23-07616e8ed3ff-kube-api-access-twvzm\" (UniqueName: \"kubernetes.io/projected/c057d328-8578-49a1-bf23-07616e8ed3ff-kube-api-access-twvzm\") pod \"c057d328-8578-49a1-bf23-07616e8ed3ff\" (UID: \"c057d328-8578-49a1-bf23-07616e8ed3ff\") "
Nov 02 22:26:34.227808 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.227684    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c057d328-8578-49a1-bf23-07616e8ed3ff-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c057d328-8578-49a1-bf23-07616e8ed3ff-openshift-service-ca\") pod \"c057d328-8578-49a1-bf23-07616e8ed3ff\" (UID: \"c057d328-8578-49a1-bf23-07616e8ed3ff\") "
Nov 02 22:26:34.227808 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.227739    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c057d328-8578-49a1-bf23-07616e8ed3ff-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c057d328-8578-49a1-bf23-07616e8ed3ff-maas-api-tls\") pod \"c057d328-8578-49a1-bf23-07616e8ed3ff\" (UID: \"c057d328-8578-49a1-bf23-07616e8ed3ff\") "
Nov 02 22:26:34.230899 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.230849    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c057d328-8578-49a1-bf23-07616e8ed3ff-maas-api-tls" pod "c057d328-8578-49a1-bf23-07616e8ed3ff" (UID: "c057d328-8578-49a1-bf23-07616e8ed3ff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:26:34.233084 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.233056    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c057d328-8578-49a1-bf23-07616e8ed3ff-kube-api-access-twvzm" pod "c057d328-8578-49a1-bf23-07616e8ed3ff" (UID: "c057d328-8578-49a1-bf23-07616e8ed3ff"). InnerVolumeSpecName "kube-api-access-twvzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:26:34.233872 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.233847    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c057d328-8578-49a1-bf23-07616e8ed3ff-metrics-certs" pod "c057d328-8578-49a1-bf23-07616e8ed3ff" (UID: "c057d328-8578-49a1-bf23-07616e8ed3ff"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:26:34.233994 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.233968    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c057d328-8578-49a1-bf23-07616e8ed3ff-openshift-service-ca" pod "c057d328-8578-49a1-bf23-07616e8ed3ff" (UID: "c057d328-8578-49a1-bf23-07616e8ed3ff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:26:34.277575 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.277543    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"
Nov 02 22:26:34.285139 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.285112    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:34.330306 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.329547    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c057d328-8578-49a1-bf23-07616e8ed3ff-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:34.330306 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.329581    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twvzm\" (UniqueName: \"kubernetes.io/projected/c057d328-8578-49a1-bf23-07616e8ed3ff-kube-api-access-twvzm\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:34.330306 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.329597    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c057d328-8578-49a1-bf23-07616e8ed3ff-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:34.330306 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.329612    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c057d328-8578-49a1-bf23-07616e8ed3ff-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:34.366411 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.366379    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f"]
Nov 02 22:26:34.369202 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.369176    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-a3713a-jp76f"]
Nov 02 22:26:34.374038 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.374008    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:34.430298 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.430197    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-kube-api-access-rdfkk\" (UniqueName: \"kubernetes.io/projected/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-kube-api-access-rdfkk\") pod \"2b47428d-5d2c-4d14-94dd-8f251e5b5e93\" (UID: \"2b47428d-5d2c-4d14-94dd-8f251e5b5e93\") "
Nov 02 22:26:34.430298 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.430261    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-metrics-certs\") pod \"2b47428d-5d2c-4d14-94dd-8f251e5b5e93\" (UID: \"2b47428d-5d2c-4d14-94dd-8f251e5b5e93\") "
Nov 02 22:26:34.430298 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.430289    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-maas-api-tls\") pod \"2b47428d-5d2c-4d14-94dd-8f251e5b5e93\" (UID: \"2b47428d-5d2c-4d14-94dd-8f251e5b5e93\") "
Nov 02 22:26:34.430571 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.430443    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-openshift-service-ca\") pod \"2b47428d-5d2c-4d14-94dd-8f251e5b5e93\" (UID: \"2b47428d-5d2c-4d14-94dd-8f251e5b5e93\") "
Nov 02 22:26:34.430818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.430788    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-openshift-service-ca" pod "2b47428d-5d2c-4d14-94dd-8f251e5b5e93" (UID: "2b47428d-5d2c-4d14-94dd-8f251e5b5e93"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:26:34.430948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.430894    5076 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-openshift-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:34.432519 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.432480    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-maas-api-tls" pod "2b47428d-5d2c-4d14-94dd-8f251e5b5e93" (UID: "2b47428d-5d2c-4d14-94dd-8f251e5b5e93"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:26:34.432859 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.432831    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-metrics-certs" pod "2b47428d-5d2c-4d14-94dd-8f251e5b5e93" (UID: "2b47428d-5d2c-4d14-94dd-8f251e5b5e93"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:26:34.432970 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.432835    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-kube-api-access-rdfkk" pod "2b47428d-5d2c-4d14-94dd-8f251e5b5e93" (UID: "2b47428d-5d2c-4d14-94dd-8f251e5b5e93"). InnerVolumeSpecName "kube-api-access-rdfkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:26:34.473808 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.473709    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:34.531711 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.531672    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdfkk\" (UniqueName: \"kubernetes.io/projected/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-kube-api-access-rdfkk\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:34.531711 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.531702    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:34.531711 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.531711    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b47428d-5d2c-4d14-94dd-8f251e5b5e93-maas-api-tls\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:34.604883 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.604842    5076 generic.go:356] "Generic (PLEG): container finished" podID="2b47428d-5d2c-4d14-94dd-8f251e5b5e93" containerID="6cc2d34e859aa13ebb9af663d8e1014bfc692122a9649457ead63435a598c8e0" exitCode=0
Nov 02 22:26:34.605338 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.604896    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"
Nov 02 22:26:34.605338 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.604937    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn" event={"ID":"2b47428d-5d2c-4d14-94dd-8f251e5b5e93","Type":"ContainerDied","Data":"6cc2d34e859aa13ebb9af663d8e1014bfc692122a9649457ead63435a598c8e0"}
Nov 02 22:26:34.605338 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.605003    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn" event={"ID":"2b47428d-5d2c-4d14-94dd-8f251e5b5e93","Type":"ContainerDied","Data":"603bd86083aa139f7c9e02e4a270ebdcc1550023fbb8dfc61633072860072375"}
Nov 02 22:26:34.605338 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.605030    5076 scope.go:122] "RemoveContainer" containerID="6cc2d34e859aa13ebb9af663d8e1014bfc692122a9649457ead63435a598c8e0"
Nov 02 22:26:34.606601 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.606580    5076 generic.go:356] "Generic (PLEG): container finished" podID="c057d328-8578-49a1-bf23-07616e8ed3ff" containerID="24240caafc958c9d3ce59979825c031d39961b78fcccb82c093a63abbc3c5290" exitCode=0
Nov 02 22:26:34.606686 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.606626    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"
Nov 02 22:26:34.606686 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.606670    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5" event={"ID":"c057d328-8578-49a1-bf23-07616e8ed3ff","Type":"ContainerDied","Data":"24240caafc958c9d3ce59979825c031d39961b78fcccb82c093a63abbc3c5290"}
Nov 02 22:26:34.606771 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.606728    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5" event={"ID":"c057d328-8578-49a1-bf23-07616e8ed3ff","Type":"ContainerDied","Data":"5d94e36ec187ca3de2f99368866ca2355f2a56df6e94abe70db4b910be689bc6"}
Nov 02 22:26:34.617861 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.617845    5076 scope.go:122] "RemoveContainer" containerID="6cc2d34e859aa13ebb9af663d8e1014bfc692122a9649457ead63435a598c8e0"
Nov 02 22:26:34.618203 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:26:34.618176    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cc2d34e859aa13ebb9af663d8e1014bfc692122a9649457ead63435a598c8e0\": container with ID starting with 6cc2d34e859aa13ebb9af663d8e1014bfc692122a9649457ead63435a598c8e0 not found: ID does not exist" containerID="6cc2d34e859aa13ebb9af663d8e1014bfc692122a9649457ead63435a598c8e0"
Nov 02 22:26:34.618325 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.618242    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cc2d34e859aa13ebb9af663d8e1014bfc692122a9649457ead63435a598c8e0"} err="failed to get container status \"6cc2d34e859aa13ebb9af663d8e1014bfc692122a9649457ead63435a598c8e0\": rpc error: code = NotFound desc = could not find container \"6cc2d34e859aa13ebb9af663d8e1014bfc692122a9649457ead63435a598c8e0\": container with ID starting with 6cc2d34e859aa13ebb9af663d8e1014bfc692122a9649457ead63435a598c8e0 not found: ID does not exist"
Nov 02 22:26:34.618325 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.618267    5076 scope.go:122] "RemoveContainer" containerID="24240caafc958c9d3ce59979825c031d39961b78fcccb82c093a63abbc3c5290"
Nov 02 22:26:34.627107 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.627085    5076 scope.go:122] "RemoveContainer" containerID="24240caafc958c9d3ce59979825c031d39961b78fcccb82c093a63abbc3c5290"
Nov 02 22:26:34.627406 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:26:34.627388    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24240caafc958c9d3ce59979825c031d39961b78fcccb82c093a63abbc3c5290\": container with ID starting with 24240caafc958c9d3ce59979825c031d39961b78fcccb82c093a63abbc3c5290 not found: ID does not exist" containerID="24240caafc958c9d3ce59979825c031d39961b78fcccb82c093a63abbc3c5290"
Nov 02 22:26:34.627475 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.627413    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24240caafc958c9d3ce59979825c031d39961b78fcccb82c093a63abbc3c5290"} err="failed to get container status \"24240caafc958c9d3ce59979825c031d39961b78fcccb82c093a63abbc3c5290\": rpc error: code = NotFound desc = could not find container \"24240caafc958c9d3ce59979825c031d39961b78fcccb82c093a63abbc3c5290\": container with ID starting with 24240caafc958c9d3ce59979825c031d39961b78fcccb82c093a63abbc3c5290 not found: ID does not exist"
Nov 02 22:26:34.631432 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.631412    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"]
Nov 02 22:26:34.639625 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.639588    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-a3713a-99476d488-k7xzn"]
Nov 02 22:26:34.651411 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.651382    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"]
Nov 02 22:26:34.658680 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.658614    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-2532af-c47f49fdd-jsjq5"]
Nov 02 22:26:34.712600 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.712486    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:34.916171 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:34.916115    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:35.053356 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:35.053278    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2b47428d-5d2c-4d14-94dd-8f251e5b5e93" path="/var/lib/kubelet/pods/2b47428d-5d2c-4d14-94dd-8f251e5b5e93/volumes"
Nov 02 22:26:35.053731 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:35.053717    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c057d328-8578-49a1-bf23-07616e8ed3ff" path="/var/lib/kubelet/pods/c057d328-8578-49a1-bf23-07616e8ed3ff/volumes"
Nov 02 22:26:35.054178 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:35.054157    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e4f20388-87bb-4591-bee6-bedbf14d05a6" path="/var/lib/kubelet/pods/e4f20388-87bb-4591-bee6-bedbf14d05a6/volumes"
Nov 02 22:26:35.204239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:35.204143    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:35.905394 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:35.905365    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:36.314844 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.314511    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:26:36.468613 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.466332    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-credential-socket\") pod \"f964213a-023a-415b-b5f7-012677864849\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") "
Nov 02 22:26:36.468613 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.466409    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f964213a-023a-415b-b5f7-012677864849-kube-api-access-h4m74\" (UniqueName: \"kubernetes.io/projected/f964213a-023a-415b-b5f7-012677864849-kube-api-access-h4m74\") pod \"f964213a-023a-415b-b5f7-012677864849\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") "
Nov 02 22:26:36.468613 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.466447    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-istio-data\") pod \"f964213a-023a-415b-b5f7-012677864849\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") "
Nov 02 22:26:36.468613 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.466495    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f964213a-023a-415b-b5f7-012677864849-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f964213a-023a-415b-b5f7-012677864849-istio-podinfo\") pod \"f964213a-023a-415b-b5f7-012677864849\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") "
Nov 02 22:26:36.468613 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.466555    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-workload-socket\") pod \"f964213a-023a-415b-b5f7-012677864849\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") "
Nov 02 22:26:36.468613 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.467431    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-workload-certs\") pod \"f964213a-023a-415b-b5f7-012677864849\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") "
Nov 02 22:26:36.468613 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.467490    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f964213a-023a-415b-b5f7-012677864849-istio-token\" (UniqueName: \"kubernetes.io/projected/f964213a-023a-415b-b5f7-012677864849-istio-token\") pod \"f964213a-023a-415b-b5f7-012677864849\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") "
Nov 02 22:26:36.468613 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.467582    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f964213a-023a-415b-b5f7-012677864849-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f964213a-023a-415b-b5f7-012677864849-istiod-ca-cert\") pod \"f964213a-023a-415b-b5f7-012677864849\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") "
Nov 02 22:26:36.468613 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.467616    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-istio-envoy\") pod \"f964213a-023a-415b-b5f7-012677864849\" (UID: \"f964213a-023a-415b-b5f7-012677864849\") "
Nov 02 22:26:36.469846 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.469412    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-workload-certs" pod "f964213a-023a-415b-b5f7-012677864849" (UID: "f964213a-023a-415b-b5f7-012677864849"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:36.469846 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.469593    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-workload-socket" pod "f964213a-023a-415b-b5f7-012677864849" (UID: "f964213a-023a-415b-b5f7-012677864849"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:36.471488 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.471458    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-istio-envoy" pod "f964213a-023a-415b-b5f7-012677864849" (UID: "f964213a-023a-415b-b5f7-012677864849"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:36.472738 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.472709    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-istio-data" pod "f964213a-023a-415b-b5f7-012677864849" (UID: "f964213a-023a-415b-b5f7-012677864849"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:36.473393 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.473194    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f964213a-023a-415b-b5f7-012677864849-kube-api-access-h4m74" pod "f964213a-023a-415b-b5f7-012677864849" (UID: "f964213a-023a-415b-b5f7-012677864849"). InnerVolumeSpecName "kube-api-access-h4m74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:26:36.473393 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.473199    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f964213a-023a-415b-b5f7-012677864849-istiod-ca-cert" pod "f964213a-023a-415b-b5f7-012677864849" (UID: "f964213a-023a-415b-b5f7-012677864849"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:26:36.473668 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.473620    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-credential-socket" pod "f964213a-023a-415b-b5f7-012677864849" (UID: "f964213a-023a-415b-b5f7-012677864849"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:36.474205 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.473802    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f964213a-023a-415b-b5f7-012677864849-istio-token" pod "f964213a-023a-415b-b5f7-012677864849" (UID: "f964213a-023a-415b-b5f7-012677864849"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:26:36.482280 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.482027    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f964213a-023a-415b-b5f7-012677864849-istio-podinfo" pod "f964213a-023a-415b-b5f7-012677864849" (UID: "f964213a-023a-415b-b5f7-012677864849"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:26:36.569647 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.569601    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f964213a-023a-415b-b5f7-012677864849-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:36.569647 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.569638    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:36.569647 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.569651    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:36.569903 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.569691    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4m74\" (UniqueName: \"kubernetes.io/projected/f964213a-023a-415b-b5f7-012677864849-kube-api-access-h4m74\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:36.569903 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.569708    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:36.569903 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.569721    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f964213a-023a-415b-b5f7-012677864849-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:36.569903 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.569734    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:36.569903 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.569746    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f964213a-023a-415b-b5f7-012677864849-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:36.569903 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.569758    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f964213a-023a-415b-b5f7-012677864849-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:36.623367 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.623330    5076 generic.go:356] "Generic (PLEG): container finished" podID="f964213a-023a-415b-b5f7-012677864849" containerID="b6129150c5242f5d559e61d58cbd79233df0c8294bf79d6616315b2bc4e8ebda" exitCode=0
Nov 02 22:26:36.623531 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.623406    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"
Nov 02 22:26:36.623531 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.623417    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw" event={"ID":"f964213a-023a-415b-b5f7-012677864849","Type":"ContainerDied","Data":"b6129150c5242f5d559e61d58cbd79233df0c8294bf79d6616315b2bc4e8ebda"}
Nov 02 22:26:36.623531 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.623507    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw" event={"ID":"f964213a-023a-415b-b5f7-012677864849","Type":"ContainerDied","Data":"c0d80bb4b9e08761f45bab25e304b04fc060182eb0c487326c0c1dfc03a1e67b"}
Nov 02 22:26:36.623531 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.623531    5076 scope.go:122] "RemoveContainer" containerID="b6129150c5242f5d559e61d58cbd79233df0c8294bf79d6616315b2bc4e8ebda"
Nov 02 22:26:36.633796 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.633776    5076 scope.go:122] "RemoveContainer" containerID="b6129150c5242f5d559e61d58cbd79233df0c8294bf79d6616315b2bc4e8ebda"
Nov 02 22:26:36.634211 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:26:36.634189    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6129150c5242f5d559e61d58cbd79233df0c8294bf79d6616315b2bc4e8ebda\": container with ID starting with b6129150c5242f5d559e61d58cbd79233df0c8294bf79d6616315b2bc4e8ebda not found: ID does not exist" containerID="b6129150c5242f5d559e61d58cbd79233df0c8294bf79d6616315b2bc4e8ebda"
Nov 02 22:26:36.634329 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.634257    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6129150c5242f5d559e61d58cbd79233df0c8294bf79d6616315b2bc4e8ebda"} err="failed to get container status \"b6129150c5242f5d559e61d58cbd79233df0c8294bf79d6616315b2bc4e8ebda\": rpc error: code = NotFound desc = could not find container \"b6129150c5242f5d559e61d58cbd79233df0c8294bf79d6616315b2bc4e8ebda\": container with ID starting with b6129150c5242f5d559e61d58cbd79233df0c8294bf79d6616315b2bc4e8ebda not found: ID does not exist"
Nov 02 22:26:36.651514 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.651480    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"]
Nov 02 22:26:36.657572 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.657549    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-719012-openshift-default-88dc6759f-phjxw"]
Nov 02 22:26:36.782495 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:36.782402    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:37.054273 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:37.054187    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f964213a-023a-415b-b5f7-012677864849" path="/var/lib/kubelet/pods/f964213a-023a-415b-b5f7-012677864849/volumes"
Nov 02 22:26:37.470531 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:37.470498    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:38.088233 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:38.088189    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:38.749153 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:38.749120    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:39.546650 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:39.546615    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:39.650988 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:39.650881    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:39.759691 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:39.759642    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:39.945053 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:39.945021    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:40.050661 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:40.050625    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:40.393871 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:40.393837    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:41.036779 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:41.036750    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:41.161806 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:41.161772    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:41.298370 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:41.298294    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"]
Nov 02 22:26:41.298812 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:41.298785    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w" podUID="ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" containerName="istio-proxy" containerID="cri-o://d45f38988796d32f5b4448702eef681140286f4a8b753a759e8a55a0a079c22a" gracePeriod=30
Nov 02 22:26:41.363810 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:41.363777    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:41.930866 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:41.930837    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:42.031569 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:42.031537    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:42.133795 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:42.133756    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:42.319462 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:42.319369    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"]
Nov 02 22:26:42.319695 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:42.319666    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz" podUID="edb6e916-cc3b-40f3-8f88-80ec1411a271" containerName="istio-proxy" containerID="cri-o://c5e679f384e3a96daaf2243e451945b85cbd4225c0f3c74d3c74f07a217cc179" gracePeriod=30
Nov 02 22:26:42.321531 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:42.321508    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"]
Nov 02 22:26:42.321763 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:42.321740    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv" podUID="d16ff19e-c9b6-4157-91fb-d4d605a78839" containerName="istio-proxy" containerID="cri-o://f5b5435ab187289381095e6591c2890b8ba05991d863ca5b5dbd81115451bdc9" gracePeriod=30
Nov 02 22:26:42.348802 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:42.348761    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:42.632444 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:42.632413    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:42.732714 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:42.732667    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:42.834367 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:42.834324    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:42.953190 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:42.953113    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:43.422868 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:43.422829    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:43.553167 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:43.553124    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:44.512011 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:44.511980    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:45.340320 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:45.340276    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:46.073821 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.073785    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:46.576307 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.576281    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:26:46.645410 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.645357    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:46.683517 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.683486    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-token\" (UniqueName: \"kubernetes.io/projected/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-token\") pod \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") "
Nov 02 22:26:46.683517 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.683520    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istiod-ca-cert\") pod \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") "
Nov 02 22:26:46.683780 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.683543    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-credential-socket\") pod \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") "
Nov 02 22:26:46.683780 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.683580    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-data\") pod \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") "
Nov 02 22:26:46.683780 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.683640    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-kube-api-access-zcp42\" (UniqueName: \"kubernetes.io/projected/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-kube-api-access-zcp42\") pod \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") "
Nov 02 22:26:46.683780 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.683688    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-podinfo\") pod \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") "
Nov 02 22:26:46.683780 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.683742    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-workload-certs\") pod \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") "
Nov 02 22:26:46.684095 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.683802    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-envoy\") pod \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") "
Nov 02 22:26:46.684095 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.683909    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-workload-socket\") pod \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\" (UID: \"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc\") "
Nov 02 22:26:46.684095 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.683916    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-credential-socket" pod "ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" (UID: "ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:46.684095 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.683953    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-data" pod "ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" (UID: "ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:46.684095 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.683969    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istiod-ca-cert" pod "ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" (UID: "ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:26:46.684396 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.684202    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-workload-certs" pod "ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" (UID: "ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:46.684396 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.684263    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:46.684396 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.684284    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:46.684396 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.684298    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:46.684731 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.684708    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-workload-socket" pod "ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" (UID: "ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:46.686775 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.686750    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-podinfo" pod "ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" (UID: "ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:26:46.687831 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.687807    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-envoy" pod "ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" (UID: "ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:46.687942 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.687918    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-kube-api-access-zcp42" pod "ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" (UID: "ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc"). InnerVolumeSpecName "kube-api-access-zcp42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:26:46.689651 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.689463    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-token" pod "ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" (UID: "ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:26:46.701818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.701790    5076 generic.go:356] "Generic (PLEG): container finished" podID="ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" containerID="d45f38988796d32f5b4448702eef681140286f4a8b753a759e8a55a0a079c22a" exitCode=0
Nov 02 22:26:46.701936 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.701846    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"
Nov 02 22:26:46.701936 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.701858    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w" event={"ID":"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc","Type":"ContainerDied","Data":"d45f38988796d32f5b4448702eef681140286f4a8b753a759e8a55a0a079c22a"}
Nov 02 22:26:46.701936 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.701909    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w" event={"ID":"ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc","Type":"ContainerDied","Data":"7186acd7a7f2c150fdf211232e4b8bcb6a07634ec140cda522567464c4d6cb43"}
Nov 02 22:26:46.702088 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.701938    5076 scope.go:122] "RemoveContainer" containerID="d45f38988796d32f5b4448702eef681140286f4a8b753a759e8a55a0a079c22a"
Nov 02 22:26:46.713753 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.713733    5076 scope.go:122] "RemoveContainer" containerID="d45f38988796d32f5b4448702eef681140286f4a8b753a759e8a55a0a079c22a"
Nov 02 22:26:46.714041 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:26:46.714022    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d45f38988796d32f5b4448702eef681140286f4a8b753a759e8a55a0a079c22a\": container with ID starting with d45f38988796d32f5b4448702eef681140286f4a8b753a759e8a55a0a079c22a not found: ID does not exist" containerID="d45f38988796d32f5b4448702eef681140286f4a8b753a759e8a55a0a079c22a"
Nov 02 22:26:46.714081 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.714049    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d45f38988796d32f5b4448702eef681140286f4a8b753a759e8a55a0a079c22a"} err="failed to get container status \"d45f38988796d32f5b4448702eef681140286f4a8b753a759e8a55a0a079c22a\": rpc error: code = NotFound desc = could not find container \"d45f38988796d32f5b4448702eef681140286f4a8b753a759e8a55a0a079c22a\": container with ID starting with d45f38988796d32f5b4448702eef681140286f4a8b753a759e8a55a0a079c22a not found: ID does not exist"
Nov 02 22:26:46.728270 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.728248    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"]
Nov 02 22:26:46.732052 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.732026    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:46.738146 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.738124    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-310bb3-openshift-default-559d54dd7f-v727w"]
Nov 02 22:26:46.785802 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.785779    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcp42\" (UniqueName: \"kubernetes.io/projected/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-kube-api-access-zcp42\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:46.785802 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.785801    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:46.785904 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.785812    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:46.785904 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.785821    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:46.785904 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.785830    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:46.785904 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.785838    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:46.883078 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:46.883046    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:47.054976 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.054906    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" path="/var/lib/kubelet/pods/ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc/volumes"
Nov 02 22:26:47.615130 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.615105    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:26:47.643684 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.643660    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:26:47.698484 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.698448    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-podinfo\") pod \"edb6e916-cc3b-40f3-8f88-80ec1411a271\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") "
Nov 02 22:26:47.698723 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.698530    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-credential-socket\") pod \"d16ff19e-c9b6-4157-91fb-d4d605a78839\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") "
Nov 02 22:26:47.698723 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.698585    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-token\" (UniqueName: \"kubernetes.io/projected/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-token\") pod \"edb6e916-cc3b-40f3-8f88-80ec1411a271\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") "
Nov 02 22:26:47.698723 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.698614    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-workload-certs\") pod \"edb6e916-cc3b-40f3-8f88-80ec1411a271\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") "
Nov 02 22:26:47.698723 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.698654    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-workload-certs\") pod \"d16ff19e-c9b6-4157-91fb-d4d605a78839\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") "
Nov 02 22:26:47.698723 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.698691    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-data\") pod \"d16ff19e-c9b6-4157-91fb-d4d605a78839\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") "
Nov 02 22:26:47.698723 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.698729    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d16ff19e-c9b6-4157-91fb-d4d605a78839-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d16ff19e-c9b6-4157-91fb-d4d605a78839-istiod-ca-cert\") pod \"d16ff19e-c9b6-4157-91fb-d4d605a78839\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") "
Nov 02 22:26:47.699164 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.698761    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-envoy\") pod \"d16ff19e-c9b6-4157-91fb-d4d605a78839\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") "
Nov 02 22:26:47.699164 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.698803    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-credential-socket\") pod \"edb6e916-cc3b-40f3-8f88-80ec1411a271\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") "
Nov 02 22:26:47.699164 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.698832    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-envoy\") pod \"edb6e916-cc3b-40f3-8f88-80ec1411a271\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") "
Nov 02 22:26:47.700022 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.699720    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-workload-socket\") pod \"edb6e916-cc3b-40f3-8f88-80ec1411a271\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") "
Nov 02 22:26:47.700022 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.699785    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-credential-socket" pod "edb6e916-cc3b-40f3-8f88-80ec1411a271" (UID: "edb6e916-cc3b-40f3-8f88-80ec1411a271"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:47.700022 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.699795    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-data\") pod \"edb6e916-cc3b-40f3-8f88-80ec1411a271\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") "
Nov 02 22:26:47.700022 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.699856    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-workload-certs" pod "d16ff19e-c9b6-4157-91fb-d4d605a78839" (UID: "d16ff19e-c9b6-4157-91fb-d4d605a78839"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:47.700022 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.699901    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-data" pod "d16ff19e-c9b6-4157-91fb-d4d605a78839" (UID: "d16ff19e-c9b6-4157-91fb-d4d605a78839"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:47.700022 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.699907    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/edb6e916-cc3b-40f3-8f88-80ec1411a271-kube-api-access-fmfxl\" (UniqueName: \"kubernetes.io/projected/edb6e916-cc3b-40f3-8f88-80ec1411a271-kube-api-access-fmfxl\") pod \"edb6e916-cc3b-40f3-8f88-80ec1411a271\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") "
Nov 02 22:26:47.700022 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.699819    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-credential-socket" pod "d16ff19e-c9b6-4157-91fb-d4d605a78839" (UID: "d16ff19e-c9b6-4157-91fb-d4d605a78839"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:47.700022 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.699994    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-token\" (UniqueName: \"kubernetes.io/projected/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-token\") pod \"d16ff19e-c9b6-4157-91fb-d4d605a78839\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") "
Nov 02 22:26:47.702518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.700050    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-podinfo\") pod \"d16ff19e-c9b6-4157-91fb-d4d605a78839\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") "
Nov 02 22:26:47.702518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.700085    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d16ff19e-c9b6-4157-91fb-d4d605a78839-kube-api-access-fvz4c\" (UniqueName: \"kubernetes.io/projected/d16ff19e-c9b6-4157-91fb-d4d605a78839-kube-api-access-fvz4c\") pod \"d16ff19e-c9b6-4157-91fb-d4d605a78839\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") "
Nov 02 22:26:47.702518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.700147    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/edb6e916-cc3b-40f3-8f88-80ec1411a271-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edb6e916-cc3b-40f3-8f88-80ec1411a271-istiod-ca-cert\") pod \"edb6e916-cc3b-40f3-8f88-80ec1411a271\" (UID: \"edb6e916-cc3b-40f3-8f88-80ec1411a271\") "
Nov 02 22:26:47.702518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.700187    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-workload-socket\") pod \"d16ff19e-c9b6-4157-91fb-d4d605a78839\" (UID: \"d16ff19e-c9b6-4157-91fb-d4d605a78839\") "
Nov 02 22:26:47.702518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.700433    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d16ff19e-c9b6-4157-91fb-d4d605a78839-istiod-ca-cert" pod "d16ff19e-c9b6-4157-91fb-d4d605a78839" (UID: "d16ff19e-c9b6-4157-91fb-d4d605a78839"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:26:47.702518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.700702    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:47.702518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.701131    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:47.702518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.701153    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:47.702518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.701166    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d16ff19e-c9b6-4157-91fb-d4d605a78839-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:47.702518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.701182    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:47.702518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.701510    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-workload-socket" pod "d16ff19e-c9b6-4157-91fb-d4d605a78839" (UID: "d16ff19e-c9b6-4157-91fb-d4d605a78839"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:47.702518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.701579    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-data" pod "edb6e916-cc3b-40f3-8f88-80ec1411a271" (UID: "edb6e916-cc3b-40f3-8f88-80ec1411a271"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:47.702518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.701620    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-envoy" pod "edb6e916-cc3b-40f3-8f88-80ec1411a271" (UID: "edb6e916-cc3b-40f3-8f88-80ec1411a271"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:47.702518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.701800    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-workload-socket" pod "edb6e916-cc3b-40f3-8f88-80ec1411a271" (UID: "edb6e916-cc3b-40f3-8f88-80ec1411a271"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:47.702518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.702127    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edb6e916-cc3b-40f3-8f88-80ec1411a271-istiod-ca-cert" pod "edb6e916-cc3b-40f3-8f88-80ec1411a271" (UID: "edb6e916-cc3b-40f3-8f88-80ec1411a271"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:26:47.702518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.702253    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-token" pod "edb6e916-cc3b-40f3-8f88-80ec1411a271" (UID: "edb6e916-cc3b-40f3-8f88-80ec1411a271"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:26:47.702518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.702332    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-workload-certs" pod "edb6e916-cc3b-40f3-8f88-80ec1411a271" (UID: "edb6e916-cc3b-40f3-8f88-80ec1411a271"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:47.703567 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.703539    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-envoy" pod "d16ff19e-c9b6-4157-91fb-d4d605a78839" (UID: "d16ff19e-c9b6-4157-91fb-d4d605a78839"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:26:47.705348 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.705309    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edb6e916-cc3b-40f3-8f88-80ec1411a271-kube-api-access-fmfxl" pod "edb6e916-cc3b-40f3-8f88-80ec1411a271" (UID: "edb6e916-cc3b-40f3-8f88-80ec1411a271"). InnerVolumeSpecName "kube-api-access-fmfxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:26:47.706282 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.706256    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-token" pod "d16ff19e-c9b6-4157-91fb-d4d605a78839" (UID: "d16ff19e-c9b6-4157-91fb-d4d605a78839"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:26:47.706446 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.706293    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:47.706567 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.706537    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-podinfo" pod "d16ff19e-c9b6-4157-91fb-d4d605a78839" (UID: "d16ff19e-c9b6-4157-91fb-d4d605a78839"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:26:47.707982 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.707957    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-podinfo" pod "edb6e916-cc3b-40f3-8f88-80ec1411a271" (UID: "edb6e916-cc3b-40f3-8f88-80ec1411a271"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:26:47.708300 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.708280    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d16ff19e-c9b6-4157-91fb-d4d605a78839-kube-api-access-fvz4c" pod "d16ff19e-c9b6-4157-91fb-d4d605a78839" (UID: "d16ff19e-c9b6-4157-91fb-d4d605a78839"). InnerVolumeSpecName "kube-api-access-fvz4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:26:47.712943 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.712920    5076 generic.go:356] "Generic (PLEG): container finished" podID="d16ff19e-c9b6-4157-91fb-d4d605a78839" containerID="f5b5435ab187289381095e6591c2890b8ba05991d863ca5b5dbd81115451bdc9" exitCode=0
Nov 02 22:26:47.713025 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.712971    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"
Nov 02 22:26:47.713025 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.712996    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv" event={"ID":"d16ff19e-c9b6-4157-91fb-d4d605a78839","Type":"ContainerDied","Data":"f5b5435ab187289381095e6591c2890b8ba05991d863ca5b5dbd81115451bdc9"}
Nov 02 22:26:47.713135 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.713052    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv" event={"ID":"d16ff19e-c9b6-4157-91fb-d4d605a78839","Type":"ContainerDied","Data":"94c530538868a7dcd6a9fee133c2fbe7907ed2b05e82fe7858e4536258619969"}
Nov 02 22:26:47.713135 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.713074    5076 scope.go:122] "RemoveContainer" containerID="f5b5435ab187289381095e6591c2890b8ba05991d863ca5b5dbd81115451bdc9"
Nov 02 22:26:47.714645 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.714623    5076 generic.go:356] "Generic (PLEG): container finished" podID="edb6e916-cc3b-40f3-8f88-80ec1411a271" containerID="c5e679f384e3a96daaf2243e451945b85cbd4225c0f3c74d3c74f07a217cc179" exitCode=0
Nov 02 22:26:47.714819 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.714707    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"
Nov 02 22:26:47.714819 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.714776    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz" event={"ID":"edb6e916-cc3b-40f3-8f88-80ec1411a271","Type":"ContainerDied","Data":"c5e679f384e3a96daaf2243e451945b85cbd4225c0f3c74d3c74f07a217cc179"}
Nov 02 22:26:47.714993 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.714820    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz" event={"ID":"edb6e916-cc3b-40f3-8f88-80ec1411a271","Type":"ContainerDied","Data":"298f98c16c10e3ba9fd145f5131df97b497e6192808b0600d6383a528f381c72"}
Nov 02 22:26:47.726450 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.726385    5076 scope.go:122] "RemoveContainer" containerID="f5b5435ab187289381095e6591c2890b8ba05991d863ca5b5dbd81115451bdc9"
Nov 02 22:26:47.726670 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:26:47.726646    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5b5435ab187289381095e6591c2890b8ba05991d863ca5b5dbd81115451bdc9\": container with ID starting with f5b5435ab187289381095e6591c2890b8ba05991d863ca5b5dbd81115451bdc9 not found: ID does not exist" containerID="f5b5435ab187289381095e6591c2890b8ba05991d863ca5b5dbd81115451bdc9"
Nov 02 22:26:47.726777 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.726678    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5b5435ab187289381095e6591c2890b8ba05991d863ca5b5dbd81115451bdc9"} err="failed to get container status \"f5b5435ab187289381095e6591c2890b8ba05991d863ca5b5dbd81115451bdc9\": rpc error: code = NotFound desc = could not find container \"f5b5435ab187289381095e6591c2890b8ba05991d863ca5b5dbd81115451bdc9\": container with ID starting with f5b5435ab187289381095e6591c2890b8ba05991d863ca5b5dbd81115451bdc9 not found: ID does not exist"
Nov 02 22:26:47.726777 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.726701    5076 scope.go:122] "RemoveContainer" containerID="c5e679f384e3a96daaf2243e451945b85cbd4225c0f3c74d3c74f07a217cc179"
Nov 02 22:26:47.736167 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.736147    5076 scope.go:122] "RemoveContainer" containerID="c5e679f384e3a96daaf2243e451945b85cbd4225c0f3c74d3c74f07a217cc179"
Nov 02 22:26:47.736481 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:26:47.736459    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5e679f384e3a96daaf2243e451945b85cbd4225c0f3c74d3c74f07a217cc179\": container with ID starting with c5e679f384e3a96daaf2243e451945b85cbd4225c0f3c74d3c74f07a217cc179 not found: ID does not exist" containerID="c5e679f384e3a96daaf2243e451945b85cbd4225c0f3c74d3c74f07a217cc179"
Nov 02 22:26:47.736558 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.736486    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5e679f384e3a96daaf2243e451945b85cbd4225c0f3c74d3c74f07a217cc179"} err="failed to get container status \"c5e679f384e3a96daaf2243e451945b85cbd4225c0f3c74d3c74f07a217cc179\": rpc error: code = NotFound desc = could not find container \"c5e679f384e3a96daaf2243e451945b85cbd4225c0f3c74d3c74f07a217cc179\": container with ID starting with c5e679f384e3a96daaf2243e451945b85cbd4225c0f3c74d3c74f07a217cc179 not found: ID does not exist"
Nov 02 22:26:47.740999 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.740970    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"]
Nov 02 22:26:47.746366 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.746342    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-szwxv"]
Nov 02 22:26:47.761971 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.761948    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"]
Nov 02 22:26:47.766079 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.766059    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-2532af-openshift-default-d47659495-k25gz"]
Nov 02 22:26:47.802727 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.802690    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:47.802727 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.802726    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvz4c\" (UniqueName: \"kubernetes.io/projected/d16ff19e-c9b6-4157-91fb-d4d605a78839-kube-api-access-fvz4c\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:47.802902 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.802744    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edb6e916-cc3b-40f3-8f88-80ec1411a271-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:47.802902 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.802759    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:47.802902 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.802773    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:47.802902 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.802786    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:47.802902 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.802799    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:47.802902 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.802812    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:47.802902 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.802825    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:47.802902 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.802839    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:47.802902 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.802851    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edb6e916-cc3b-40f3-8f88-80ec1411a271-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:47.802902 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.802866    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmfxl\" (UniqueName: \"kubernetes.io/projected/edb6e916-cc3b-40f3-8f88-80ec1411a271-kube-api-access-fmfxl\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:47.802902 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:47.802897    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d16ff19e-c9b6-4157-91fb-d4d605a78839-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:48.502133 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:48.502095    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"]
Nov 02 22:26:48.641483 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:48.641401    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:48.724339 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:48.724308    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:49.055777 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:49.055706    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d16ff19e-c9b6-4157-91fb-d4d605a78839" path="/var/lib/kubelet/pods/d16ff19e-c9b6-4157-91fb-d4d605a78839/volumes"
Nov 02 22:26:49.056245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:49.056199    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="edb6e916-cc3b-40f3-8f88-80ec1411a271" path="/var/lib/kubelet/pods/edb6e916-cc3b-40f3-8f88-80ec1411a271/volumes"
Nov 02 22:26:49.561849 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:49.561814    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:49.950533 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:49.950485    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:50.157743 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:50.157706    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:50.272485 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:50.272387    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:50.970590 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:50.970552    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:51.676417 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:51.676368    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:52.478368 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:52.478332    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:52.578653 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:52.578614    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:52.678414 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:52.678382    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:53.085467 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:53.085367    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:53.835870 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:53.835827    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:53.938431 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:53.938400    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:54.337384 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.337354    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt"]
Nov 02 22:26:54.337925 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.337901    5076 cpu_manager.go:414] "containerMap: removing container" podUID="ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" containerName="istio-proxy"
Nov 02 22:26:54.337925 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.337925    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" containerName="istio-proxy"
Nov 02 22:26:54.338121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.337941    5076 cpu_manager.go:414] "containerMap: removing container" podUID="edb6e916-cc3b-40f3-8f88-80ec1411a271" containerName="istio-proxy"
Nov 02 22:26:54.338121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.337949    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="edb6e916-cc3b-40f3-8f88-80ec1411a271" containerName="istio-proxy"
Nov 02 22:26:54.338121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.337964    5076 cpu_manager.go:414] "containerMap: removing container" podUID="f964213a-023a-415b-b5f7-012677864849" containerName="istio-proxy"
Nov 02 22:26:54.338121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.337972    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f964213a-023a-415b-b5f7-012677864849" containerName="istio-proxy"
Nov 02 22:26:54.338121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.337982    5076 cpu_manager.go:414] "containerMap: removing container" podUID="d16ff19e-c9b6-4157-91fb-d4d605a78839" containerName="istio-proxy"
Nov 02 22:26:54.338121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.337989    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d16ff19e-c9b6-4157-91fb-d4d605a78839" containerName="istio-proxy"
Nov 02 22:26:54.338121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.338001    5076 cpu_manager.go:414] "containerMap: removing container" podUID="e4f20388-87bb-4591-bee6-bedbf14d05a6" containerName="revoke-keys"
Nov 02 22:26:54.338121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.338007    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e4f20388-87bb-4591-bee6-bedbf14d05a6" containerName="revoke-keys"
Nov 02 22:26:54.338121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.338021    5076 cpu_manager.go:414] "containerMap: removing container" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main"
Nov 02 22:26:54.338121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.338028    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main"
Nov 02 22:26:54.338121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.338036    5076 cpu_manager.go:414] "containerMap: removing container" podUID="2b47428d-5d2c-4d14-94dd-8f251e5b5e93" containerName="maas-api"
Nov 02 22:26:54.338121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.338043    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2b47428d-5d2c-4d14-94dd-8f251e5b5e93" containerName="maas-api"
Nov 02 22:26:54.338121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.338058    5076 cpu_manager.go:414] "containerMap: removing container" podUID="c057d328-8578-49a1-bf23-07616e8ed3ff" containerName="maas-api"
Nov 02 22:26:54.338121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.338064    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c057d328-8578-49a1-bf23-07616e8ed3ff" containerName="maas-api"
Nov 02 22:26:54.338815 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.338174    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="4dc91fc4-af6f-4f19-87e5-1a2d4db152ca" containerName="main"
Nov 02 22:26:54.338815 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.338190    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="2b47428d-5d2c-4d14-94dd-8f251e5b5e93" containerName="maas-api"
Nov 02 22:26:54.338815 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.338200    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="c057d328-8578-49a1-bf23-07616e8ed3ff" containerName="maas-api"
Nov 02 22:26:54.338815 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.338229    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee3dbee5-3c45-4cc0-8540-ae039e7ebdbc" containerName="istio-proxy"
Nov 02 22:26:54.338815 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.338237    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="edb6e916-cc3b-40f3-8f88-80ec1411a271" containerName="istio-proxy"
Nov 02 22:26:54.338815 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.338248    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="f964213a-023a-415b-b5f7-012677864849" containerName="istio-proxy"
Nov 02 22:26:54.338815 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.338256    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="d16ff19e-c9b6-4157-91fb-d4d605a78839" containerName="istio-proxy"
Nov 02 22:26:54.338815 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.338267    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="e4f20388-87bb-4591-bee6-bedbf14d05a6" containerName="revoke-keys"
Nov 02 22:26:54.343590 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.343564    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt"
Nov 02 22:26:54.350934 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.350909    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt"]
Nov 02 22:26:54.440886 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.440858    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 02 22:26:54.441047 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.440925    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n7t66\""
Nov 02 22:26:54.480185 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.480155    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-84818322-pm7rt\" (UID: \"ae86c7dc-3a6d-403a-a4ae-330cd360e72b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt"
Nov 02 22:26:54.480365 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.480249    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6phg\" (UniqueName: \"kubernetes.io/projected/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-kube-api-access-b6phg\") pod \"maas-api-revoke-sub-84818322-pm7rt\" (UID: \"ae86c7dc-3a6d-403a-a4ae-330cd360e72b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt"
Nov 02 22:26:54.480450 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.480404    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-84818322-pm7rt\" (UID: \"ae86c7dc-3a6d-403a-a4ae-330cd360e72b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt"
Nov 02 22:26:54.581963 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.581927    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-84818322-pm7rt\" (UID: \"ae86c7dc-3a6d-403a-a4ae-330cd360e72b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt"
Nov 02 22:26:54.582128 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.582046    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6phg\" (UniqueName: \"kubernetes.io/projected/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-kube-api-access-b6phg\") pod \"maas-api-revoke-sub-84818322-pm7rt\" (UID: \"ae86c7dc-3a6d-403a-a4ae-330cd360e72b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt"
Nov 02 22:26:54.582128 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.582100    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-84818322-pm7rt\" (UID: \"ae86c7dc-3a6d-403a-a4ae-330cd360e72b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt"
Nov 02 22:26:54.583254 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.583203    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-84818322-pm7rt\" (UID: \"ae86c7dc-3a6d-403a-a4ae-330cd360e72b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt"
Nov 02 22:26:54.584827 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.584799    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-84818322-pm7rt\" (UID: \"ae86c7dc-3a6d-403a-a4ae-330cd360e72b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt"
Nov 02 22:26:54.589964 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.589910    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6phg\" (UniqueName: \"kubernetes.io/projected/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-kube-api-access-b6phg\") pod \"maas-api-revoke-sub-84818322-pm7rt\" (UID: \"ae86c7dc-3a6d-403a-a4ae-330cd360e72b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt"
Nov 02 22:26:54.637808 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.637779    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:54.661881 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.661851    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt"
Nov 02 22:26:54.934178 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:54.934156    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt"]
Nov 02 22:26:54.936068 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:26:54.936029    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae86c7dc_3a6d_403a_a4ae_330cd360e72b.slice/crio-99237e8459fe575c31b6d9e583dda853f4221a2b6ac4f07c1d3dbd4f72719fd3 WatchSource:0}: Error finding container 99237e8459fe575c31b6d9e583dda853f4221a2b6ac4f07c1d3dbd4f72719fd3: Status 404 returned error can't find the container with id 99237e8459fe575c31b6d9e583dda853f4221a2b6ac4f07c1d3dbd4f72719fd3
Nov 02 22:26:55.772677 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:55.772642    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt" event={"ID":"ae86c7dc-3a6d-403a-a4ae-330cd360e72b","Type":"ContainerStarted","Data":"54fb2a8e288c446e4073efabeeb964cecd35f398e43292e373a82deb72741cc8"}
Nov 02 22:26:55.772792 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:55.772714    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt" event={"ID":"ae86c7dc-3a6d-403a-a4ae-330cd360e72b","Type":"ContainerStarted","Data":"99237e8459fe575c31b6d9e583dda853f4221a2b6ac4f07c1d3dbd4f72719fd3"}
Nov 02 22:26:55.790718 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:55.790670    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt" podStartSLOduration=1.790656614 podStartE2EDuration="1.790656614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:26:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:26:55.788138743 +0000 UTC m=+1724.844473127" watchObservedRunningTime="2026-11-02 22:26:55.790656614 +0000 UTC m=+1724.846990995"
Nov 02 22:26:56.238232 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:56.238196    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:56.780305 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:56.780267    5076 generic.go:356] "Generic (PLEG): container finished" podID="ae86c7dc-3a6d-403a-a4ae-330cd360e72b" containerID="54fb2a8e288c446e4073efabeeb964cecd35f398e43292e373a82deb72741cc8" exitCode=0
Nov 02 22:26:56.780486 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:56.780360    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt" event={"ID":"ae86c7dc-3a6d-403a-a4ae-330cd360e72b","Type":"ContainerDied","Data":"54fb2a8e288c446e4073efabeeb964cecd35f398e43292e373a82deb72741cc8"}
Nov 02 22:26:57.931416 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:57.931392    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt"
Nov 02 22:26:58.030058 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:58.030011    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-maas-api-xks-ca\") pod \"ae86c7dc-3a6d-403a-a4ae-330cd360e72b\" (UID: \"ae86c7dc-3a6d-403a-a4ae-330cd360e72b\") "
Nov 02 22:26:58.030268 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:58.030104    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-maas-api-openshift-ca\") pod \"ae86c7dc-3a6d-403a-a4ae-330cd360e72b\" (UID: \"ae86c7dc-3a6d-403a-a4ae-330cd360e72b\") "
Nov 02 22:26:58.030268 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:58.030255    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-kube-api-access-b6phg\" (UniqueName: \"kubernetes.io/projected/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-kube-api-access-b6phg\") pod \"ae86c7dc-3a6d-403a-a4ae-330cd360e72b\" (UID: \"ae86c7dc-3a6d-403a-a4ae-330cd360e72b\") "
Nov 02 22:26:58.030552 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:58.030519    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-maas-api-openshift-ca" pod "ae86c7dc-3a6d-403a-a4ae-330cd360e72b" (UID: "ae86c7dc-3a6d-403a-a4ae-330cd360e72b"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:26:58.032381 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:58.032351    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-maas-api-xks-ca" pod "ae86c7dc-3a6d-403a-a4ae-330cd360e72b" (UID: "ae86c7dc-3a6d-403a-a4ae-330cd360e72b"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:26:58.032494 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:58.032439    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-kube-api-access-b6phg" pod "ae86c7dc-3a6d-403a-a4ae-330cd360e72b" (UID: "ae86c7dc-3a6d-403a-a4ae-330cd360e72b"). InnerVolumeSpecName "kube-api-access-b6phg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:26:58.132187 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:58.132148    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6phg\" (UniqueName: \"kubernetes.io/projected/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-kube-api-access-b6phg\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:58.132187 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:58.132184    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-maas-api-xks-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:58.132417 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:58.132198    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ae86c7dc-3a6d-403a-a4ae-330cd360e72b-maas-api-openshift-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:26:58.753321 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:58.753283    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:58.797710 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:58.797682    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt"
Nov 02 22:26:58.797863 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:58.797713    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt" event={"ID":"ae86c7dc-3a6d-403a-a4ae-330cd360e72b","Type":"ContainerDied","Data":"99237e8459fe575c31b6d9e583dda853f4221a2b6ac4f07c1d3dbd4f72719fd3"}
Nov 02 22:26:58.797863 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:58.797771    5076 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99237e8459fe575c31b6d9e583dda853f4221a2b6ac4f07c1d3dbd4f72719fd3"
Nov 02 22:26:58.891072 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:26:58.891024    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:26:59.887180 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:26:59.887143    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:27:00.391969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:00.391935    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:03.522783 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.522720    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main" containerID="cri-o://28530220c11d71d979739e9563495db0bddb83faf6c58df75674018f792c8222" gracePeriod=45
Nov 02 22:27:03.793846 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.793782    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:27:03.830582 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.830539    5076 generic.go:356] "Generic (PLEG): container finished" podID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerID="28530220c11d71d979739e9563495db0bddb83faf6c58df75674018f792c8222" exitCode=0
Nov 02 22:27:03.830769 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.830692    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" event={"ID":"92accb71-73cc-48ce-ae62-14aa8e1742a9","Type":"ContainerDied","Data":"28530220c11d71d979739e9563495db0bddb83faf6c58df75674018f792c8222"}
Nov 02 22:27:03.830769 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.830718    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5" event={"ID":"92accb71-73cc-48ce-ae62-14aa8e1742a9","Type":"ContainerDied","Data":"9d601f2e4f4fc4f91f1efe1e35c23ad831d78f4384348c315c235ba4be4fd2db"}
Nov 02 22:27:03.830769 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.830737    5076 scope.go:122] "RemoveContainer" containerID="28530220c11d71d979739e9563495db0bddb83faf6c58df75674018f792c8222"
Nov 02 22:27:03.830946 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.830861    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"
Nov 02 22:27:03.842103 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.842078    5076 scope.go:122] "RemoveContainer" containerID="28530220c11d71d979739e9563495db0bddb83faf6c58df75674018f792c8222"
Nov 02 22:27:03.842503 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:27:03.842477    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28530220c11d71d979739e9563495db0bddb83faf6c58df75674018f792c8222\": container with ID starting with 28530220c11d71d979739e9563495db0bddb83faf6c58df75674018f792c8222 not found: ID does not exist" containerID="28530220c11d71d979739e9563495db0bddb83faf6c58df75674018f792c8222"
Nov 02 22:27:03.842591 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.842516    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28530220c11d71d979739e9563495db0bddb83faf6c58df75674018f792c8222"} err="failed to get container status \"28530220c11d71d979739e9563495db0bddb83faf6c58df75674018f792c8222\": rpc error: code = NotFound desc = could not find container \"28530220c11d71d979739e9563495db0bddb83faf6c58df75674018f792c8222\": container with ID starting with 28530220c11d71d979739e9563495db0bddb83faf6c58df75674018f792c8222 not found: ID does not exist"
Nov 02 22:27:03.887810 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.887779    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-model-cache\") pod \"92accb71-73cc-48ce-ae62-14aa8e1742a9\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") "
Nov 02 22:27:03.887930 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.887844    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-dshm\" (UniqueName: \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-dshm\") pod \"92accb71-73cc-48ce-ae62-14aa8e1742a9\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") "
Nov 02 22:27:03.887930 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.887908    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92accb71-73cc-48ce-ae62-14aa8e1742a9-tls-certs\" (UniqueName: \"kubernetes.io/secret/92accb71-73cc-48ce-ae62-14aa8e1742a9-tls-certs\") pod \"92accb71-73cc-48ce-ae62-14aa8e1742a9\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") "
Nov 02 22:27:03.888041 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.887965    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-home\" (UniqueName: \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-home\") pod \"92accb71-73cc-48ce-ae62-14aa8e1742a9\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") "
Nov 02 22:27:03.888110 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.888035    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-tmp-dir\") pod \"92accb71-73cc-48ce-ae62-14aa8e1742a9\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") "
Nov 02 22:27:03.888110 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.888037    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-model-cache" pod "92accb71-73cc-48ce-ae62-14aa8e1742a9" (UID: "92accb71-73cc-48ce-ae62-14aa8e1742a9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:27:03.888213 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.888116    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/92accb71-73cc-48ce-ae62-14aa8e1742a9-kube-api-access-vxdpr\" (UniqueName: \"kubernetes.io/projected/92accb71-73cc-48ce-ae62-14aa8e1742a9-kube-api-access-vxdpr\") pod \"92accb71-73cc-48ce-ae62-14aa8e1742a9\" (UID: \"92accb71-73cc-48ce-ae62-14aa8e1742a9\") "
Nov 02 22:27:03.888321 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.888298    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-home" pod "92accb71-73cc-48ce-ae62-14aa8e1742a9" (UID: "92accb71-73cc-48ce-ae62-14aa8e1742a9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:27:03.888369 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.888341    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-tmp-dir" pod "92accb71-73cc-48ce-ae62-14aa8e1742a9" (UID: "92accb71-73cc-48ce-ae62-14aa8e1742a9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:27:03.888531 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.888511    5076 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-model-cache\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:03.888592 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.888538    5076 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-home\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:03.888592 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.888580    5076 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-tmp-dir\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:03.890158 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.890136    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92accb71-73cc-48ce-ae62-14aa8e1742a9-kube-api-access-vxdpr" pod "92accb71-73cc-48ce-ae62-14aa8e1742a9" (UID: "92accb71-73cc-48ce-ae62-14aa8e1742a9"). InnerVolumeSpecName "kube-api-access-vxdpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:27:03.890158 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.890146    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92accb71-73cc-48ce-ae62-14aa8e1742a9-tls-certs" pod "92accb71-73cc-48ce-ae62-14aa8e1742a9" (UID: "92accb71-73cc-48ce-ae62-14aa8e1742a9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:27:03.890158 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.890136    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-dshm" pod "92accb71-73cc-48ce-ae62-14aa8e1742a9" (UID: "92accb71-73cc-48ce-ae62-14aa8e1742a9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:27:03.990094 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.990059    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxdpr\" (UniqueName: \"kubernetes.io/projected/92accb71-73cc-48ce-ae62-14aa8e1742a9-kube-api-access-vxdpr\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:03.990094 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.990088    5076 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92accb71-73cc-48ce-ae62-14aa8e1742a9-dshm\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:03.990094 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:03.990099    5076 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92accb71-73cc-48ce-ae62-14aa8e1742a9-tls-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:04.154649 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:04.154616    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"]
Nov 02 22:27:04.157924 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:04.157894    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-361a44/simulator-w5-361a44-kserve-74c7bf5fb9-4dng5"]
Nov 02 22:27:05.052797 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:05.052765    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" path="/var/lib/kubelet/pods/92accb71-73cc-48ce-ae62-14aa8e1742a9/volumes"
Nov 02 22:27:09.415515 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:09.415478    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:09.557261 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:09.557210    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:09.658435 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:09.655859    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:10.055698 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:10.055666    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:14.619530 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:14.619456    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:14.721095 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:14.721063    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:14.839187 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:14.839155    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:16.190956 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:16.190918    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:16.290697 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:16.290666    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:16.482405 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:16.482307    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"]
Nov 02 22:27:16.482599 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:16.482571    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl" podUID="d5e06138-82b8-492e-bd2c-e7098ace48cd" containerName="istio-proxy" containerID="cri-o://7c188d9dcbd1ed5370fc15b9a8d15a574abe1a466ba77bee57551caf792c1a28" gracePeriod=30
Nov 02 22:27:16.484953 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:16.484893    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"]
Nov 02 22:27:16.485374 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:16.485348    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9" podUID="8221cfb2-2c27-4949-9b2d-1f48aef1c671" containerName="istio-proxy" containerID="cri-o://0babf08727b81862915bfc4639a7e03c61f5b56057982cb9e94d8e087396e93a" gracePeriod=30
Nov 02 22:27:16.507002 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:16.506971    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:19.067742 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.067706    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68bfb5556c-4kwpw"]
Nov 02 22:27:19.068557 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.067988    5076 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-68bfb5556c-4kwpw" podUID="85552a19-8cc3-48b4-9a5d-a3a5885c3222" containerName="manager" containerID="cri-o://15dd09d969dcbe763099ff50ae83120382b8cf0e4f21e08a7a056ef5ce87d003" gracePeriod=30
Nov 02 22:27:19.318692 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.318639    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68bfb5556c-4kwpw"
Nov 02 22:27:19.436315 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.436282    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/85552a19-8cc3-48b4-9a5d-a3a5885c3222-webhook-cert\" (UniqueName: \"kubernetes.io/secret/85552a19-8cc3-48b4-9a5d-a3a5885c3222-webhook-cert\") pod \"85552a19-8cc3-48b4-9a5d-a3a5885c3222\" (UID: \"85552a19-8cc3-48b4-9a5d-a3a5885c3222\") "
Nov 02 22:27:19.436485 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.436401    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/85552a19-8cc3-48b4-9a5d-a3a5885c3222-kube-api-access-8v66d\" (UniqueName: \"kubernetes.io/projected/85552a19-8cc3-48b4-9a5d-a3a5885c3222-kube-api-access-8v66d\") pod \"85552a19-8cc3-48b4-9a5d-a3a5885c3222\" (UID: \"85552a19-8cc3-48b4-9a5d-a3a5885c3222\") "
Nov 02 22:27:19.436485 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.436443    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/85552a19-8cc3-48b4-9a5d-a3a5885c3222-metrics-certs\" (UniqueName: \"kubernetes.io/secret/85552a19-8cc3-48b4-9a5d-a3a5885c3222-metrics-certs\") pod \"85552a19-8cc3-48b4-9a5d-a3a5885c3222\" (UID: \"85552a19-8cc3-48b4-9a5d-a3a5885c3222\") "
Nov 02 22:27:19.438322 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.438293    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85552a19-8cc3-48b4-9a5d-a3a5885c3222-webhook-cert" pod "85552a19-8cc3-48b4-9a5d-a3a5885c3222" (UID: "85552a19-8cc3-48b4-9a5d-a3a5885c3222"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:27:19.438452 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.438417    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85552a19-8cc3-48b4-9a5d-a3a5885c3222-kube-api-access-8v66d" pod "85552a19-8cc3-48b4-9a5d-a3a5885c3222" (UID: "85552a19-8cc3-48b4-9a5d-a3a5885c3222"). InnerVolumeSpecName "kube-api-access-8v66d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:27:19.438505 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.438449    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85552a19-8cc3-48b4-9a5d-a3a5885c3222-metrics-certs" pod "85552a19-8cc3-48b4-9a5d-a3a5885c3222" (UID: "85552a19-8cc3-48b4-9a5d-a3a5885c3222"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 22:27:19.537132 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.537095    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v66d\" (UniqueName: \"kubernetes.io/projected/85552a19-8cc3-48b4-9a5d-a3a5885c3222-kube-api-access-8v66d\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:19.537132 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.537128    5076 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85552a19-8cc3-48b4-9a5d-a3a5885c3222-metrics-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:19.537132 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.537138    5076 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85552a19-8cc3-48b4-9a5d-a3a5885c3222-webhook-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:19.928910 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.928879    5076 generic.go:356] "Generic (PLEG): container finished" podID="85552a19-8cc3-48b4-9a5d-a3a5885c3222" containerID="15dd09d969dcbe763099ff50ae83120382b8cf0e4f21e08a7a056ef5ce87d003" exitCode=0
Nov 02 22:27:19.929084 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.928920    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68bfb5556c-4kwpw" event={"ID":"85552a19-8cc3-48b4-9a5d-a3a5885c3222","Type":"ContainerDied","Data":"15dd09d969dcbe763099ff50ae83120382b8cf0e4f21e08a7a056ef5ce87d003"}
Nov 02 22:27:19.929084 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.928926    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68bfb5556c-4kwpw"
Nov 02 22:27:19.929084 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.928962    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68bfb5556c-4kwpw" event={"ID":"85552a19-8cc3-48b4-9a5d-a3a5885c3222","Type":"ContainerDied","Data":"2fe01f2e1cfe82ce22aa3329977636c9cd357a4fd1c03ca2ebb9d79bd8d1fe1a"}
Nov 02 22:27:19.929084 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.928985    5076 scope.go:122] "RemoveContainer" containerID="15dd09d969dcbe763099ff50ae83120382b8cf0e4f21e08a7a056ef5ce87d003"
Nov 02 22:27:19.939341 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.939322    5076 scope.go:122] "RemoveContainer" containerID="d298a6c2d917cd759c09c712884a651eb50847fae8ac9130c4e6b09cb3eb73c2"
Nov 02 22:27:19.947332 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.947311    5076 scope.go:122] "RemoveContainer" containerID="15dd09d969dcbe763099ff50ae83120382b8cf0e4f21e08a7a056ef5ce87d003"
Nov 02 22:27:19.947614 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:27:19.947596    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15dd09d969dcbe763099ff50ae83120382b8cf0e4f21e08a7a056ef5ce87d003\": container with ID starting with 15dd09d969dcbe763099ff50ae83120382b8cf0e4f21e08a7a056ef5ce87d003 not found: ID does not exist" containerID="15dd09d969dcbe763099ff50ae83120382b8cf0e4f21e08a7a056ef5ce87d003"
Nov 02 22:27:19.947682 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.947621    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15dd09d969dcbe763099ff50ae83120382b8cf0e4f21e08a7a056ef5ce87d003"} err="failed to get container status \"15dd09d969dcbe763099ff50ae83120382b8cf0e4f21e08a7a056ef5ce87d003\": rpc error: code = NotFound desc = could not find container \"15dd09d969dcbe763099ff50ae83120382b8cf0e4f21e08a7a056ef5ce87d003\": container with ID starting with 15dd09d969dcbe763099ff50ae83120382b8cf0e4f21e08a7a056ef5ce87d003 not found: ID does not exist"
Nov 02 22:27:19.947682 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.947639    5076 scope.go:122] "RemoveContainer" containerID="d298a6c2d917cd759c09c712884a651eb50847fae8ac9130c4e6b09cb3eb73c2"
Nov 02 22:27:19.947909 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:27:19.947891    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d298a6c2d917cd759c09c712884a651eb50847fae8ac9130c4e6b09cb3eb73c2\": container with ID starting with d298a6c2d917cd759c09c712884a651eb50847fae8ac9130c4e6b09cb3eb73c2 not found: ID does not exist" containerID="d298a6c2d917cd759c09c712884a651eb50847fae8ac9130c4e6b09cb3eb73c2"
Nov 02 22:27:19.947951 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.947915    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d298a6c2d917cd759c09c712884a651eb50847fae8ac9130c4e6b09cb3eb73c2"} err="failed to get container status \"d298a6c2d917cd759c09c712884a651eb50847fae8ac9130c4e6b09cb3eb73c2\": rpc error: code = NotFound desc = could not find container \"d298a6c2d917cd759c09c712884a651eb50847fae8ac9130c4e6b09cb3eb73c2\": container with ID starting with d298a6c2d917cd759c09c712884a651eb50847fae8ac9130c4e6b09cb3eb73c2 not found: ID does not exist"
Nov 02 22:27:19.951352 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.951328    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68bfb5556c-4kwpw"]
Nov 02 22:27:19.958897 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:19.958872    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68bfb5556c-4kwpw"]
Nov 02 22:27:21.054844 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.054809    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="85552a19-8cc3-48b4-9a5d-a3a5885c3222" path="/var/lib/kubelet/pods/85552a19-8cc3-48b4-9a5d-a3a5885c3222/volumes"
Nov 02 22:27:21.802335 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.802049    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:27:21.849402 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.849378    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:27:21.860366 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.860336    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-credential-socket\") pod \"d5e06138-82b8-492e-bd2c-e7098ace48cd\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") "
Nov 02 22:27:21.860460 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.860415    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-workload-certs\") pod \"d5e06138-82b8-492e-bd2c-e7098ace48cd\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") "
Nov 02 22:27:21.860516 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.860462    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-token\" (UniqueName: \"kubernetes.io/projected/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-token\") pod \"d5e06138-82b8-492e-bd2c-e7098ace48cd\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") "
Nov 02 22:27:21.860516 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.860492    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-data\") pod \"d5e06138-82b8-492e-bd2c-e7098ace48cd\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") "
Nov 02 22:27:21.860625 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.860526    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-workload-socket\") pod \"d5e06138-82b8-492e-bd2c-e7098ace48cd\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") "
Nov 02 22:27:21.860625 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.860559    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d5e06138-82b8-492e-bd2c-e7098ace48cd-kube-api-access-x8gx7\" (UniqueName: \"kubernetes.io/projected/d5e06138-82b8-492e-bd2c-e7098ace48cd-kube-api-access-x8gx7\") pod \"d5e06138-82b8-492e-bd2c-e7098ace48cd\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") "
Nov 02 22:27:21.860625 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.860581    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-envoy\") pod \"d5e06138-82b8-492e-bd2c-e7098ace48cd\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") "
Nov 02 22:27:21.860625 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.860605    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d5e06138-82b8-492e-bd2c-e7098ace48cd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5e06138-82b8-492e-bd2c-e7098ace48cd-istiod-ca-cert\") pod \"d5e06138-82b8-492e-bd2c-e7098ace48cd\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") "
Nov 02 22:27:21.860625 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.860626    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-podinfo\") pod \"d5e06138-82b8-492e-bd2c-e7098ace48cd\" (UID: \"d5e06138-82b8-492e-bd2c-e7098ace48cd\") "
Nov 02 22:27:21.860900 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.860642    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-credential-socket" pod "d5e06138-82b8-492e-bd2c-e7098ace48cd" (UID: "d5e06138-82b8-492e-bd2c-e7098ace48cd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:27:21.860900 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.860750    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-workload-certs" pod "d5e06138-82b8-492e-bd2c-e7098ace48cd" (UID: "d5e06138-82b8-492e-bd2c-e7098ace48cd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:27:21.860900 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.860895    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:21.861058 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.860916    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:21.861115 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.861086    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-data" pod "d5e06138-82b8-492e-bd2c-e7098ace48cd" (UID: "d5e06138-82b8-492e-bd2c-e7098ace48cd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:27:21.861183 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.861148    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-workload-socket" pod "d5e06138-82b8-492e-bd2c-e7098ace48cd" (UID: "d5e06138-82b8-492e-bd2c-e7098ace48cd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:27:21.861183 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.861178    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5e06138-82b8-492e-bd2c-e7098ace48cd-istiod-ca-cert" pod "d5e06138-82b8-492e-bd2c-e7098ace48cd" (UID: "d5e06138-82b8-492e-bd2c-e7098ace48cd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:27:21.863251 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.863210    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-podinfo" pod "d5e06138-82b8-492e-bd2c-e7098ace48cd" (UID: "d5e06138-82b8-492e-bd2c-e7098ace48cd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:27:21.863439 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.863421    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5e06138-82b8-492e-bd2c-e7098ace48cd-kube-api-access-x8gx7" pod "d5e06138-82b8-492e-bd2c-e7098ace48cd" (UID: "d5e06138-82b8-492e-bd2c-e7098ace48cd"). InnerVolumeSpecName "kube-api-access-x8gx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:27:21.863439 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.863427    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-envoy" pod "d5e06138-82b8-492e-bd2c-e7098ace48cd" (UID: "d5e06138-82b8-492e-bd2c-e7098ace48cd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:27:21.863569 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.863495    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-token" pod "d5e06138-82b8-492e-bd2c-e7098ace48cd" (UID: "d5e06138-82b8-492e-bd2c-e7098ace48cd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:27:21.942879 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.942847    5076 generic.go:356] "Generic (PLEG): container finished" podID="d5e06138-82b8-492e-bd2c-e7098ace48cd" containerID="7c188d9dcbd1ed5370fc15b9a8d15a574abe1a466ba77bee57551caf792c1a28" exitCode=0
Nov 02 22:27:21.943067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.942902    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"
Nov 02 22:27:21.943067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.942935    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl" event={"ID":"d5e06138-82b8-492e-bd2c-e7098ace48cd","Type":"ContainerDied","Data":"7c188d9dcbd1ed5370fc15b9a8d15a574abe1a466ba77bee57551caf792c1a28"}
Nov 02 22:27:21.943067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.942990    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl" event={"ID":"d5e06138-82b8-492e-bd2c-e7098ace48cd","Type":"ContainerDied","Data":"4e2133aaf1da8dc38dff062441ba75685e3abd173bee3d02e4eb684e528db09c"}
Nov 02 22:27:21.943067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.943021    5076 scope.go:122] "RemoveContainer" containerID="7c188d9dcbd1ed5370fc15b9a8d15a574abe1a466ba77bee57551caf792c1a28"
Nov 02 22:27:21.944344 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.944317    5076 generic.go:356] "Generic (PLEG): container finished" podID="8221cfb2-2c27-4949-9b2d-1f48aef1c671" containerID="0babf08727b81862915bfc4639a7e03c61f5b56057982cb9e94d8e087396e93a" exitCode=0
Nov 02 22:27:21.944468 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.944368    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"
Nov 02 22:27:21.944468 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.944416    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9" event={"ID":"8221cfb2-2c27-4949-9b2d-1f48aef1c671","Type":"ContainerDied","Data":"0babf08727b81862915bfc4639a7e03c61f5b56057982cb9e94d8e087396e93a"}
Nov 02 22:27:21.944552 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.944467    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9" event={"ID":"8221cfb2-2c27-4949-9b2d-1f48aef1c671","Type":"ContainerDied","Data":"43b45826cfece5fff1be565b374cb74ca0e0f031b4e272a6f43a9032f3c415e1"}
Nov 02 22:27:21.954937 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.954275    5076 scope.go:122] "RemoveContainer" containerID="7c188d9dcbd1ed5370fc15b9a8d15a574abe1a466ba77bee57551caf792c1a28"
Nov 02 22:27:21.954937 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:27:21.954640    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c188d9dcbd1ed5370fc15b9a8d15a574abe1a466ba77bee57551caf792c1a28\": container with ID starting with 7c188d9dcbd1ed5370fc15b9a8d15a574abe1a466ba77bee57551caf792c1a28 not found: ID does not exist" containerID="7c188d9dcbd1ed5370fc15b9a8d15a574abe1a466ba77bee57551caf792c1a28"
Nov 02 22:27:21.954937 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.954678    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c188d9dcbd1ed5370fc15b9a8d15a574abe1a466ba77bee57551caf792c1a28"} err="failed to get container status \"7c188d9dcbd1ed5370fc15b9a8d15a574abe1a466ba77bee57551caf792c1a28\": rpc error: code = NotFound desc = could not find container \"7c188d9dcbd1ed5370fc15b9a8d15a574abe1a466ba77bee57551caf792c1a28\": container with ID starting with 7c188d9dcbd1ed5370fc15b9a8d15a574abe1a466ba77bee57551caf792c1a28 not found: ID does not exist"
Nov 02 22:27:21.954937 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.954704    5076 scope.go:122] "RemoveContainer" containerID="0babf08727b81862915bfc4639a7e03c61f5b56057982cb9e94d8e087396e93a"
Nov 02 22:27:21.962104 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.962082    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-workload-socket\") pod \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") "
Nov 02 22:27:21.962238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.962167    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-token\" (UniqueName: \"kubernetes.io/projected/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-token\") pod \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") "
Nov 02 22:27:21.962238 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.962197    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-credential-socket\") pod \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") "
Nov 02 22:27:21.962364 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.962260    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-podinfo\") pod \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") "
Nov 02 22:27:21.962364 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.962294    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-workload-certs\") pod \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") "
Nov 02 22:27:21.962470 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.962366    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istiod-ca-cert\") pod \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") "
Nov 02 22:27:21.962470 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.962377    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-workload-socket" pod "8221cfb2-2c27-4949-9b2d-1f48aef1c671" (UID: "8221cfb2-2c27-4949-9b2d-1f48aef1c671"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:27:21.962470 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.962408    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-envoy\") pod \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") "
Nov 02 22:27:21.962470 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.962443    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8221cfb2-2c27-4949-9b2d-1f48aef1c671-kube-api-access-xvwh2\" (UniqueName: \"kubernetes.io/projected/8221cfb2-2c27-4949-9b2d-1f48aef1c671-kube-api-access-xvwh2\") pod \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") "
Nov 02 22:27:21.962681 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.962495    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-data\") pod \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\" (UID: \"8221cfb2-2c27-4949-9b2d-1f48aef1c671\") "
Nov 02 22:27:21.962818 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.962801    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:21.962890 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.962824    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:21.962890 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.962840    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:21.962890 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.962856    5076 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-workload-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:21.962890 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.962871    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8gx7\" (UniqueName: \"kubernetes.io/projected/d5e06138-82b8-492e-bd2c-e7098ace48cd-kube-api-access-x8gx7\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:21.963099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.962886    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:21.963099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.962902    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5e06138-82b8-492e-bd2c-e7098ace48cd-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:21.963099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.962917    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5e06138-82b8-492e-bd2c-e7098ace48cd-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:21.963099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.963067    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-credential-socket" pod "8221cfb2-2c27-4949-9b2d-1f48aef1c671" (UID: "8221cfb2-2c27-4949-9b2d-1f48aef1c671"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:27:21.963336 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.963157    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-data" pod "8221cfb2-2c27-4949-9b2d-1f48aef1c671" (UID: "8221cfb2-2c27-4949-9b2d-1f48aef1c671"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:27:21.963336 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.963254    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istiod-ca-cert" pod "8221cfb2-2c27-4949-9b2d-1f48aef1c671" (UID: "8221cfb2-2c27-4949-9b2d-1f48aef1c671"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:27:21.963546 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.963521    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-workload-certs" pod "8221cfb2-2c27-4949-9b2d-1f48aef1c671" (UID: "8221cfb2-2c27-4949-9b2d-1f48aef1c671"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:27:21.964699 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.964674    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-podinfo" pod "8221cfb2-2c27-4949-9b2d-1f48aef1c671" (UID: "8221cfb2-2c27-4949-9b2d-1f48aef1c671"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 22:27:21.964777 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.964687    5076 scope.go:122] "RemoveContainer" containerID="0babf08727b81862915bfc4639a7e03c61f5b56057982cb9e94d8e087396e93a"
Nov 02 22:27:21.964777 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.964695    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-token" pod "8221cfb2-2c27-4949-9b2d-1f48aef1c671" (UID: "8221cfb2-2c27-4949-9b2d-1f48aef1c671"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:27:21.965016 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:27:21.964991    5076 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0babf08727b81862915bfc4639a7e03c61f5b56057982cb9e94d8e087396e93a\": container with ID starting with 0babf08727b81862915bfc4639a7e03c61f5b56057982cb9e94d8e087396e93a not found: ID does not exist" containerID="0babf08727b81862915bfc4639a7e03c61f5b56057982cb9e94d8e087396e93a"
Nov 02 22:27:21.965108 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.965024    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-envoy" pod "8221cfb2-2c27-4949-9b2d-1f48aef1c671" (UID: "8221cfb2-2c27-4949-9b2d-1f48aef1c671"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 22:27:21.965108 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.965025    5076 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0babf08727b81862915bfc4639a7e03c61f5b56057982cb9e94d8e087396e93a"} err="failed to get container status \"0babf08727b81862915bfc4639a7e03c61f5b56057982cb9e94d8e087396e93a\": rpc error: code = NotFound desc = could not find container \"0babf08727b81862915bfc4639a7e03c61f5b56057982cb9e94d8e087396e93a\": container with ID starting with 0babf08727b81862915bfc4639a7e03c61f5b56057982cb9e94d8e087396e93a not found: ID does not exist"
Nov 02 22:27:21.965267 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.965250    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8221cfb2-2c27-4949-9b2d-1f48aef1c671-kube-api-access-xvwh2" pod "8221cfb2-2c27-4949-9b2d-1f48aef1c671" (UID: "8221cfb2-2c27-4949-9b2d-1f48aef1c671"). InnerVolumeSpecName "kube-api-access-xvwh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:27:21.972425 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.972385    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"]
Nov 02 22:27:21.976494 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:21.976465    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8skpl"]
Nov 02 22:27:22.064343 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:22.064261    5076 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-envoy\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:22.064343 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:22.064302    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvwh2\" (UniqueName: \"kubernetes.io/projected/8221cfb2-2c27-4949-9b2d-1f48aef1c671-kube-api-access-xvwh2\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:22.064343 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:22.064314    5076 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-data\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:22.064343 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:22.064322    5076 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-token\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:22.064343 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:22.064331    5076 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-credential-socket\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:22.064343 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:22.064339    5076 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istio-podinfo\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:22.064343 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:22.064348    5076 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8221cfb2-2c27-4949-9b2d-1f48aef1c671-workload-certs\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:22.064343 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:22.064356    5076 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8221cfb2-2c27-4949-9b2d-1f48aef1c671-istiod-ca-cert\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:27:22.268011 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:22.267985    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"]
Nov 02 22:27:22.280014 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:22.279975    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-361a44-openshift-default-86959d977-8mtd9"]
Nov 02 22:27:23.052417 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:23.052388    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8221cfb2-2c27-4949-9b2d-1f48aef1c671" path="/var/lib/kubelet/pods/8221cfb2-2c27-4949-9b2d-1f48aef1c671/volumes"
Nov 02 22:27:23.052811 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:23.052799    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d5e06138-82b8-492e-bd2c-e7098ace48cd" path="/var/lib/kubelet/pods/d5e06138-82b8-492e-bd2c-e7098ace48cd/volumes"
Nov 02 22:27:24.076317 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:24.076276    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:24.152898 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:24.152868    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:24.776280 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:24.776248    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:24.876418 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:24.876385    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:26.328444 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:26.328411    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:29.366211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:29.366169    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:29.886914 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:27:29.886881    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:27:32.126636 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:32.126601    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:34.774360 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:34.774323    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:36.101276 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.101241    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"]
Nov 02 22:27:36.101855 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.101834    5076 cpu_manager.go:414] "containerMap: removing container" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main"
Nov 02 22:27:36.101939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.101858    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main"
Nov 02 22:27:36.101939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.101873    5076 cpu_manager.go:414] "containerMap: removing container" podUID="ae86c7dc-3a6d-403a-a4ae-330cd360e72b" containerName="revoke-keys"
Nov 02 22:27:36.101939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.101880    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae86c7dc-3a6d-403a-a4ae-330cd360e72b" containerName="revoke-keys"
Nov 02 22:27:36.101939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.101897    5076 cpu_manager.go:414] "containerMap: removing container" podUID="85552a19-8cc3-48b4-9a5d-a3a5885c3222" containerName="manager"
Nov 02 22:27:36.101939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.101905    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="85552a19-8cc3-48b4-9a5d-a3a5885c3222" containerName="manager"
Nov 02 22:27:36.101939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.101931    5076 cpu_manager.go:414] "containerMap: removing container" podUID="d5e06138-82b8-492e-bd2c-e7098ace48cd" containerName="istio-proxy"
Nov 02 22:27:36.101939 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.101938    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d5e06138-82b8-492e-bd2c-e7098ace48cd" containerName="istio-proxy"
Nov 02 22:27:36.102211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.101951    5076 cpu_manager.go:414] "containerMap: removing container" podUID="85552a19-8cc3-48b4-9a5d-a3a5885c3222" containerName="manager"
Nov 02 22:27:36.102211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.101958    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="85552a19-8cc3-48b4-9a5d-a3a5885c3222" containerName="manager"
Nov 02 22:27:36.102211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.101971    5076 cpu_manager.go:414] "containerMap: removing container" podUID="8221cfb2-2c27-4949-9b2d-1f48aef1c671" containerName="istio-proxy"
Nov 02 22:27:36.102211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.101977    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8221cfb2-2c27-4949-9b2d-1f48aef1c671" containerName="istio-proxy"
Nov 02 22:27:36.102211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.102076    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="d5e06138-82b8-492e-bd2c-e7098ace48cd" containerName="istio-proxy"
Nov 02 22:27:36.102211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.102085    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="85552a19-8cc3-48b4-9a5d-a3a5885c3222" containerName="manager"
Nov 02 22:27:36.102211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.102092    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="8221cfb2-2c27-4949-9b2d-1f48aef1c671" containerName="istio-proxy"
Nov 02 22:27:36.102211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.102104    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="92accb71-73cc-48ce-ae62-14aa8e1742a9" containerName="main"
Nov 02 22:27:36.102211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.102112    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae86c7dc-3a6d-403a-a4ae-330cd360e72b" containerName="revoke-keys"
Nov 02 22:27:36.102211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.102121    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="85552a19-8cc3-48b4-9a5d-a3a5885c3222" containerName="manager"
Nov 02 22:27:36.105577 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.105551    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.122506 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.122477    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"]
Nov 02 22:27:36.195709 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.195685    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfa6e173-901f-4dc4-8d9e-889c395a26df-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.195842 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.195712    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa6e173-901f-4dc4-8d9e-889c395a26df-credential-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.195842 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.195731    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8rbg\" (UniqueName: \"kubernetes.io/projected/bfa6e173-901f-4dc4-8d9e-889c395a26df-kube-api-access-j8rbg\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.195842 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.195749    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfa6e173-901f-4dc4-8d9e-889c395a26df-istio-token\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.195842 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.195819    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfa6e173-901f-4dc4-8d9e-889c395a26df-istio-data\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.196012 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.195884    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa6e173-901f-4dc4-8d9e-889c395a26df-workload-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.196012 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.195909    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfa6e173-901f-4dc4-8d9e-889c395a26df-istio-podinfo\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.196012 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.195932    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfa6e173-901f-4dc4-8d9e-889c395a26df-workload-certs\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.196121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.196050    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfa6e173-901f-4dc4-8d9e-889c395a26df-istio-envoy\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.296510 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.296480    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfa6e173-901f-4dc4-8d9e-889c395a26df-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.296643 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.296516    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa6e173-901f-4dc4-8d9e-889c395a26df-credential-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.296643 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.296538    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8rbg\" (UniqueName: \"kubernetes.io/projected/bfa6e173-901f-4dc4-8d9e-889c395a26df-kube-api-access-j8rbg\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.296643 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.296567    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfa6e173-901f-4dc4-8d9e-889c395a26df-istio-token\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.296643 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.296592    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfa6e173-901f-4dc4-8d9e-889c395a26df-istio-data\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.296643 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.296619    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa6e173-901f-4dc4-8d9e-889c395a26df-workload-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.296947 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.296652    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfa6e173-901f-4dc4-8d9e-889c395a26df-istio-podinfo\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.297006 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.296952    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa6e173-901f-4dc4-8d9e-889c395a26df-credential-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.297070 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.297043    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfa6e173-901f-4dc4-8d9e-889c395a26df-istio-data\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.297115 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.297087    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa6e173-901f-4dc4-8d9e-889c395a26df-workload-socket\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.297115 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.297098    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfa6e173-901f-4dc4-8d9e-889c395a26df-workload-certs\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.297189 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.297123    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfa6e173-901f-4dc4-8d9e-889c395a26df-workload-certs\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.297251 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.297195    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfa6e173-901f-4dc4-8d9e-889c395a26df-istio-envoy\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.297388 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.297368    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfa6e173-901f-4dc4-8d9e-889c395a26df-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.299205 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.299185    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfa6e173-901f-4dc4-8d9e-889c395a26df-istio-podinfo\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.299285 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.299190    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfa6e173-901f-4dc4-8d9e-889c395a26df-istio-envoy\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.303928 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.303904    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfa6e173-901f-4dc4-8d9e-889c395a26df-istio-token\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.304043 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.304026    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8rbg\" (UniqueName: \"kubernetes.io/projected/bfa6e173-901f-4dc4-8d9e-889c395a26df-kube-api-access-j8rbg\") pod \"maas-default-gateway-openshift-default-696f47c6c-zwt7j\" (UID: \"bfa6e173-901f-4dc4-8d9e-889c395a26df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.424669 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.424637    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:36.703364 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.701131    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"]
Nov 02 22:27:36.704758 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:27:36.704725    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfa6e173_901f_4dc4_8d9e_889c395a26df.slice/crio-85dfad82f3b096ce8907c2af777c8944183637b6bbc33d86fc7fa251266696a1 WatchSource:0}: Error finding container 85dfad82f3b096ce8907c2af777c8944183637b6bbc33d86fc7fa251266696a1: Status 404 returned error can't find the container with id 85dfad82f3b096ce8907c2af777c8944183637b6bbc33d86fc7fa251266696a1
Nov 02 22:27:36.706881 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.706851    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:27:36.706968 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.706916    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:27:36.706968 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:36.706952    5076 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 02 22:27:37.030519 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:37.030440    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j" event={"ID":"bfa6e173-901f-4dc4-8d9e-889c395a26df","Type":"ContainerStarted","Data":"5bbd416367c30babaeb8760309a08042e64474223c64d1153edd35cb963e7245"}
Nov 02 22:27:37.030519 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:37.030498    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j" event={"ID":"bfa6e173-901f-4dc4-8d9e-889c395a26df","Type":"ContainerStarted","Data":"85dfad82f3b096ce8907c2af777c8944183637b6bbc33d86fc7fa251266696a1"}
Nov 02 22:27:37.052582 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:37.052538    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j" podStartSLOduration=1.052523698 podStartE2EDuration="1.052523698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:27:37.049829419 +0000 UTC m=+1766.106163800" watchObservedRunningTime="2026-11-02 22:27:37.052523698 +0000 UTC m=+1766.108858136"
Nov 02 22:27:37.424763 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:37.424726    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:37.426410 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:37.426383    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-zwt7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Nov 02 22:27:37.426552 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:37.426449    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j" podUID="bfa6e173-901f-4dc4-8d9e-889c395a26df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Nov 02 22:27:38.425826 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:38.425791    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-zwt7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Nov 02 22:27:38.426247 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:38.425841    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j" podUID="bfa6e173-901f-4dc4-8d9e-889c395a26df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Nov 02 22:27:39.425786 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:39.425748    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-zwt7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Nov 02 22:27:39.425968 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:39.425816    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j" podUID="bfa6e173-901f-4dc4-8d9e-889c395a26df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Nov 02 22:27:40.425456 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:40.425422    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-zwt7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Nov 02 22:27:40.425643 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:40.425473    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j" podUID="bfa6e173-901f-4dc4-8d9e-889c395a26df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Nov 02 22:27:41.425913 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:41.425871    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-zwt7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Nov 02 22:27:41.426353 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:41.425932    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j" podUID="bfa6e173-901f-4dc4-8d9e-889c395a26df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Nov 02 22:27:42.425851 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:42.425818    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-zwt7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Nov 02 22:27:42.426043 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:42.425885    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j" podUID="bfa6e173-901f-4dc4-8d9e-889c395a26df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Nov 02 22:27:43.425139 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:43.425107    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-zwt7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Nov 02 22:27:43.425331 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:43.425171    5076 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j" podUID="bfa6e173-901f-4dc4-8d9e-889c395a26df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Nov 02 22:27:45.025407 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:45.025372    5076 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:45.025889 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:45.025711    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:45.026455 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:45.026434    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-zwt7j"
Nov 02 22:27:53.209399 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:53.209354    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:53.310303 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:53.310270    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:55.474510 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:55.474479    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:57.326144 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:27:57.326111    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:27:59.887680 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:27:59.887637    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:28:12.889878 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:28:12.889841    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:28:12.975957 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:28:12.975924    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:28:29.887865 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:28:29.887786    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:28:34.854938 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:28:34.854901    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:28:54.073045 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:28:54.073009    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:28:59.888703 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:28:59.888667    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:29:11.020165 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:29:11.020128    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:29:11.121134 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:29:11.121103    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:29:28.098322 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:29:28.098285    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:29:29.887322 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:29:29.887285    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:29:34.868198 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:29:34.868165    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:29:59.887513 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:29:59.887436    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:30:00.129921 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:00.129888    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr"]
Nov 02 22:30:00.133503 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:00.133486    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr"
Nov 02 22:30:00.138948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:00.138778    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n7t66\""
Nov 02 22:30:00.140497 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:00.140459    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr"]
Nov 02 22:30:00.221977 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:00.221944    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k47df\" (UniqueName: \"kubernetes.io/projected/a6a64fae-cc2c-4a65-bbeb-86462194979e-kube-api-access-k47df\") pod \"maas-api-key-cleanup-29894310-dl8xr\" (UID: \"a6a64fae-cc2c-4a65-bbeb-86462194979e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr"
Nov 02 22:30:00.221977 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:00.221980    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6a64fae-cc2c-4a65-bbeb-86462194979e-maas-api-service-ca\") pod \"maas-api-key-cleanup-29894310-dl8xr\" (UID: \"a6a64fae-cc2c-4a65-bbeb-86462194979e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr"
Nov 02 22:30:00.323076 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:00.323043    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k47df\" (UniqueName: \"kubernetes.io/projected/a6a64fae-cc2c-4a65-bbeb-86462194979e-kube-api-access-k47df\") pod \"maas-api-key-cleanup-29894310-dl8xr\" (UID: \"a6a64fae-cc2c-4a65-bbeb-86462194979e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr"
Nov 02 22:30:00.323258 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:00.323082    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6a64fae-cc2c-4a65-bbeb-86462194979e-maas-api-service-ca\") pod \"maas-api-key-cleanup-29894310-dl8xr\" (UID: \"a6a64fae-cc2c-4a65-bbeb-86462194979e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr"
Nov 02 22:30:00.323727 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:00.323707    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6a64fae-cc2c-4a65-bbeb-86462194979e-maas-api-service-ca\") pod \"maas-api-key-cleanup-29894310-dl8xr\" (UID: \"a6a64fae-cc2c-4a65-bbeb-86462194979e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr"
Nov 02 22:30:00.331735 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:00.331704    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k47df\" (UniqueName: \"kubernetes.io/projected/a6a64fae-cc2c-4a65-bbeb-86462194979e-kube-api-access-k47df\") pod \"maas-api-key-cleanup-29894310-dl8xr\" (UID: \"a6a64fae-cc2c-4a65-bbeb-86462194979e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr"
Nov 02 22:30:00.450585 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:00.450529    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr"
Nov 02 22:30:00.722441 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:00.722416    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr"]
Nov 02 22:30:00.724166 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:30:00.724140    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6a64fae_cc2c_4a65_bbeb_86462194979e.slice/crio-bc981efac78b9b3325513a43b9f3110649af4512963223793be8b6a0ac04d740 WatchSource:0}: Error finding container bc981efac78b9b3325513a43b9f3110649af4512963223793be8b6a0ac04d740: Status 404 returned error can't find the container with id bc981efac78b9b3325513a43b9f3110649af4512963223793be8b6a0ac04d740
Nov 02 22:30:00.880283 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:00.880249    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr" event={"ID":"a6a64fae-cc2c-4a65-bbeb-86462194979e","Type":"ContainerStarted","Data":"bc981efac78b9b3325513a43b9f3110649af4512963223793be8b6a0ac04d740"}
Nov 02 22:30:01.887143 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:01.887105    5076 generic.go:356] "Generic (PLEG): container finished" podID="a6a64fae-cc2c-4a65-bbeb-86462194979e" containerID="9d935bc72a352b21a8f0cfb4b293df077804cf75d95355ec0d569c0b64abf8b4" exitCode=60
Nov 02 22:30:01.887585 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:01.887196    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr" event={"ID":"a6a64fae-cc2c-4a65-bbeb-86462194979e","Type":"ContainerDied","Data":"9d935bc72a352b21a8f0cfb4b293df077804cf75d95355ec0d569c0b64abf8b4"}
Nov 02 22:30:01.887585 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:01.887449    5076 scope.go:122] "RemoveContainer" containerID="9d935bc72a352b21a8f0cfb4b293df077804cf75d95355ec0d569c0b64abf8b4"
Nov 02 22:30:02.894264 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:02.894212    5076 generic.go:356] "Generic (PLEG): container finished" podID="a6a64fae-cc2c-4a65-bbeb-86462194979e" containerID="db62a789bf914bbd1f8dcd79134e29146a32ed0401339a9f6e309069b995b2a0" exitCode=60
Nov 02 22:30:02.894668 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:02.894260    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr" event={"ID":"a6a64fae-cc2c-4a65-bbeb-86462194979e","Type":"ContainerDied","Data":"db62a789bf914bbd1f8dcd79134e29146a32ed0401339a9f6e309069b995b2a0"}
Nov 02 22:30:02.894668 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:02.894371    5076 scope.go:122] "RemoveContainer" containerID="9d935bc72a352b21a8f0cfb4b293df077804cf75d95355ec0d569c0b64abf8b4"
Nov 02 22:30:02.894668 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:02.894584    5076 scope.go:122] "RemoveContainer" containerID="db62a789bf914bbd1f8dcd79134e29146a32ed0401339a9f6e309069b995b2a0"
Nov 02 22:30:02.894832 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:30:02.894816    5076 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29894310-dl8xr_odh-ai-gateway-infra(a6a64fae-cc2c-4a65-bbeb-86462194979e)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr" podUID="a6a64fae-cc2c-4a65-bbeb-86462194979e"
Nov 02 22:30:03.901590 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:03.901558    5076 scope.go:122] "RemoveContainer" containerID="db62a789bf914bbd1f8dcd79134e29146a32ed0401339a9f6e309069b995b2a0"
Nov 02 22:30:03.901996 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:30:03.901770    5076 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29894310-dl8xr_odh-ai-gateway-infra(a6a64fae-cc2c-4a65-bbeb-86462194979e)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr" podUID="a6a64fae-cc2c-4a65-bbeb-86462194979e"
Nov 02 22:30:13.797242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:13.797004    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:30:13.926327 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:13.926276    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:30:16.047116 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:16.047086    5076 scope.go:122] "RemoveContainer" containerID="db62a789bf914bbd1f8dcd79134e29146a32ed0401339a9f6e309069b995b2a0"
Nov 02 22:30:16.975689 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:16.975660    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr" event={"ID":"a6a64fae-cc2c-4a65-bbeb-86462194979e","Type":"ContainerStarted","Data":"408fae9cb62845782bf36f610ad5b720b29cde1b5f9df2fd4a1c7a99ffc0548d"}
Nov 02 22:30:16.993061 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:16.993017    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr" podStartSLOduration=16.993002978 podStartE2EDuration="16.993002978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:30:16.991835395 +0000 UTC m=+1926.048169791" watchObservedRunningTime="2026-11-02 22:30:16.993002978 +0000 UTC m=+1926.049337357"
Nov 02 22:30:17.984648 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:17.984614    5076 generic.go:356] "Generic (PLEG): container finished" podID="a6a64fae-cc2c-4a65-bbeb-86462194979e" containerID="408fae9cb62845782bf36f610ad5b720b29cde1b5f9df2fd4a1c7a99ffc0548d" exitCode=60
Nov 02 22:30:17.985127 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:17.984663    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr" event={"ID":"a6a64fae-cc2c-4a65-bbeb-86462194979e","Type":"ContainerDied","Data":"408fae9cb62845782bf36f610ad5b720b29cde1b5f9df2fd4a1c7a99ffc0548d"}
Nov 02 22:30:17.985127 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:17.984731    5076 scope.go:122] "RemoveContainer" containerID="db62a789bf914bbd1f8dcd79134e29146a32ed0401339a9f6e309069b995b2a0"
Nov 02 22:30:17.985287 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:17.985133    5076 scope.go:122] "RemoveContainer" containerID="408fae9cb62845782bf36f610ad5b720b29cde1b5f9df2fd4a1c7a99ffc0548d"
Nov 02 22:30:17.985499 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:30:17.985472    5076 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29894310-dl8xr_odh-ai-gateway-infra(a6a64fae-cc2c-4a65-bbeb-86462194979e)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr" podUID="a6a64fae-cc2c-4a65-bbeb-86462194979e"
Nov 02 22:30:18.008352 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:18.008324    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr"]
Nov 02 22:30:19.121632 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:19.121606    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr"
Nov 02 22:30:19.199341 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:19.199307    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6a64fae-cc2c-4a65-bbeb-86462194979e-kube-api-access-k47df\" (UniqueName: \"kubernetes.io/projected/a6a64fae-cc2c-4a65-bbeb-86462194979e-kube-api-access-k47df\") pod \"a6a64fae-cc2c-4a65-bbeb-86462194979e\" (UID: \"a6a64fae-cc2c-4a65-bbeb-86462194979e\") "
Nov 02 22:30:19.199504 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:19.199396    5076 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a6a64fae-cc2c-4a65-bbeb-86462194979e-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6a64fae-cc2c-4a65-bbeb-86462194979e-maas-api-service-ca\") pod \"a6a64fae-cc2c-4a65-bbeb-86462194979e\" (UID: \"a6a64fae-cc2c-4a65-bbeb-86462194979e\") "
Nov 02 22:30:19.199733 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:19.199703    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6a64fae-cc2c-4a65-bbeb-86462194979e-maas-api-service-ca" pod "a6a64fae-cc2c-4a65-bbeb-86462194979e" (UID: "a6a64fae-cc2c-4a65-bbeb-86462194979e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 22:30:19.201414 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:19.201381    5076 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6a64fae-cc2c-4a65-bbeb-86462194979e-kube-api-access-k47df" pod "a6a64fae-cc2c-4a65-bbeb-86462194979e" (UID: "a6a64fae-cc2c-4a65-bbeb-86462194979e"). InnerVolumeSpecName "kube-api-access-k47df". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 22:30:19.301258 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:19.301145    5076 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6a64fae-cc2c-4a65-bbeb-86462194979e-maas-api-service-ca\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:30:19.301258 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:19.301187    5076 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k47df\" (UniqueName: \"kubernetes.io/projected/a6a64fae-cc2c-4a65-bbeb-86462194979e-kube-api-access-k47df\") on node \"ip-10-0-142-132.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 22:30:19.998092 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:19.998059    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr" event={"ID":"a6a64fae-cc2c-4a65-bbeb-86462194979e","Type":"ContainerDied","Data":"bc981efac78b9b3325513a43b9f3110649af4512963223793be8b6a0ac04d740"}
Nov 02 22:30:19.998279 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:19.998092    5076 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr"
Nov 02 22:30:19.998279 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:19.998121    5076 scope.go:122] "RemoveContainer" containerID="408fae9cb62845782bf36f610ad5b720b29cde1b5f9df2fd4a1c7a99ffc0548d"
Nov 02 22:30:20.020741 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:20.020717    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr"]
Nov 02 22:30:20.026387 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:20.026366    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29894310-dl8xr"]
Nov 02 22:30:21.053163 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:21.053130    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a6a64fae-cc2c-4a65-bbeb-86462194979e" path="/var/lib/kubelet/pods/a6a64fae-cc2c-4a65-bbeb-86462194979e/volumes"
Nov 02 22:30:29.887974 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:30:29.887933    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:30:33.187734 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:33.187320    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-wxsbd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:30:33.187734 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:33.187385    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd" podUID="c0d2ada9-88d6-40b1-96d3-ef5d72c48295" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:30:34.929761 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:34.929721    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:30:35.080502 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:30:35.080449    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:30:59.887414 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:30:59.887372    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:31:29.886952 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:31:29.886858    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:31:34.949862 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:31:34.949813    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:31:36.203167 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:31:36.203117    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:31:58.031242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:31:58.031061    5076 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt"]
Nov 02 22:31:58.038861 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:31:58.038700    5076 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-84818322-pm7rt"]
Nov 02 22:31:59.052814 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:31:59.052771    5076 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ae86c7dc-3a6d-403a-a4ae-330cd360e72b" path="/var/lib/kubelet/pods/ae86c7dc-3a6d-403a-a4ae-330cd360e72b/volumes"
Nov 02 22:31:59.887736 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:31:59.887701    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:32:29.084767 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:29.084727    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:29.547138 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:29.547109    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:29.675265 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:29.675123    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:29.887106 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:32:29.887072    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:32:32.831838 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:32.831806    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:32.929489 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:32.929456    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:34.014317 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:34.014280    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:34.122243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:34.122194    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:34.224139 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:34.224087    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:34.916563 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:34.916531    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:35.012966 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:35.012931    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:35.168317 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:35.168211    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:35.716651 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:35.716612    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:36.266990 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:36.266959    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:37.052365 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:37.052325    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:37.624065 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:37.624027    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:38.265363 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:38.265331    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:39.068142 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:39.068093    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:39.770045 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:39.770013    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:40.463983 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:40.463946    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:41.127156 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:41.127120    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:41.759443 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:41.759411    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:42.460303 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:42.460267    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:43.205244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:43.205202    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:43.863856 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:43.863826    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:44.467691 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:44.467650    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:45.126852 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:45.126685    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:45.809581 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:45.809542    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:46.544583 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:46.544549    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:47.153906 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:47.153877    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:47.834887 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:47.834852    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:47.939895 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:47.939860    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:48.489242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:48.489172    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:48.589187 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:48.589151    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:48.689145 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:48.689112    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:48.790746 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:48.790668    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:49.572868 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:49.572825    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:49.771247 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:49.771182    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:50.368256 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:50.368199    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:51.183579 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:51.183546    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:52.070243 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:52.070180    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:52.748966 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:52.748936    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:53.361743 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:53.361693    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:53.947596 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:53.947563    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:54.551478 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:54.551435    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:55.149348 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:55.149318    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:55.741650 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:55.741605    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:56.339943 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:56.339900    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:57.006630 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:57.006590    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:57.614593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:57.614159    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:58.147088 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:58.147058    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:58.743370 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:58.743340    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:59.349497 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:32:59.349464    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:32:59.887243 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:32:59.887186    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:33:00.037497 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:00.037462    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:00.649127 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:00.649090    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:01.334462 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:01.334419    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:01.942146 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:01.942111    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:02.554312 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:02.554276    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:03.156674 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:03.156643    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:03.854630 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:03.854590    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:04.462319 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:04.462284    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:05.161465 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:05.161428    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:05.854196 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:05.854166    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:06.445782 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:06.445741    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:07.040032 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:07.039996    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:07.844193 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:07.844144    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:08.447474 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:08.447439    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:09.149842 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:09.149796    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:09.772918 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:09.772881    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:10.434059 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:10.434019    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:11.056823 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:11.056790    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:11.647869 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:11.647827    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:12.243992 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:12.243965    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:12.563538 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:12.563460    5076 scope.go:122] "RemoveContainer" containerID="54fb2a8e288c446e4073efabeeb964cecd35f398e43292e373a82deb72741cc8"
Nov 02 22:33:12.572498 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:12.572478    5076 scope.go:122] "RemoveContainer" containerID="ce072cef93f0c5a4af52560dde99e19f9d811302c659e126b160f8e80101f8fd"
Nov 02 22:33:12.842764 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:12.842680    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:13.460608 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:13.460572    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:14.144036 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:14.143995    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:14.849385 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:14.849351    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:15.447432 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:15.447394    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:16.056983 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:16.056948    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:16.647961 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:16.647930    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:17.247161 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:17.247122    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:17.849688 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:17.849653    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:18.483914 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:18.483881    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:19.148917 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:19.148887    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:19.248891 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:19.248856    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:19.349557 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:19.349524    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:19.781857 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:19.781828    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:20.348418 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:20.348386    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:20.954083 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:20.954054    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:21.550121 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:21.550086    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:22.162696 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:22.162664    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:22.852131 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:22.852090    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:23.547538 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:23.547506    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:24.170525 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:24.170489    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:24.753935 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:24.753899    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:25.356681 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:25.356648    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:25.953244 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:25.953191    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:26.552785 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:26.552752    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:27.170641 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:27.170606    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:27.857381 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:27.857337    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:28.449402 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:28.449367    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:29.045211 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:29.045180    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:29.646900 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:29.646869    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:29.887359 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:33:29.887324    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:33:30.344754 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:30.344720    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:30.650482 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:30.650443    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:31.162766 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:31.162735    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:31.863171 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:31.863130    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:32.455757 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:32.455724    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:33.054058 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:33.054027    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:33.653105 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:33.653069    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:34.425703 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:34.425651    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:35.047480 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:35.047444    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:35.129482 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:35.129447    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:35.324686 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:35.324606    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:35.685262 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:35.685211    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:35.761870 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:35.761836    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:36.344757 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:36.344723    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:36.904957 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:36.904921    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:37.010055 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:37.010021    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:37.546033 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:37.545981    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:38.156725 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:38.156689    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:38.750530 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:38.750501    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:39.349754 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:39.349718    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:39.952575 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:39.952543    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:40.632671 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:40.632633    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:40.957654 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:40.957571    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:41.057748 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:41.057707    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:41.248047 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:41.247952    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:41.744089 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:41.744052    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:41.867448 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:41.867403    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:41.964271 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:41.964208    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:42.479713 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:42.479678    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:48.036444 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:48.036411    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:48.136192 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:48.136159    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:48.377324 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:33:48.377289    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:33:59.887588 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:33:59.887546    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:34:12.294299 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:34:12.294269    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:34:12.656161 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:34:12.656098    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:34:18.163299 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:34:18.163265    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:34:29.887196 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:34:29.887120    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:34:35.091903 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:34:35.091864    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:34:57.884551 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:34:57.884517    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:34:59.887574 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:34:59.887541    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:35:08.848925 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:35:08.848886    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:35:29.951858 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:35:29.951740    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:35:35.137346 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:35:35.137302    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:35:59.887140 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:35:59.887057    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:36:01.926992 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:01.926961    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:02.352689 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:02.352652    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:02.452378 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:02.452343    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:05.985687 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:05.985650    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:06.083315 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:06.083282    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:07.175443 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:07.175404    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:07.409931 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:07.409856    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:07.505399 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:07.505319    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:07.966043 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:07.966001    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:08.656867 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:08.656834    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:09.343754 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:09.343717    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:10.035932 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:10.035894    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:10.824831 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:10.824783    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:11.482988 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:11.482952    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:12.176420 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:12.176381    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:12.953535 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:12.953501    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:13.652753 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:13.652724    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:14.384876 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:14.384847    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:15.059676 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:15.059635    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:15.725555 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:15.725521    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:16.502275 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:16.502239    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:17.242281 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:17.242244    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:17.860759 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:17.860716    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:18.564292 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:18.564257    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:19.222101 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:19.222067    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:19.868833 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:19.868796    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:20.568934 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:20.568894    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:21.006595 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:21.006558    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:21.274601 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:21.274513    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:21.626696 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:21.626644    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:21.727021 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:21.726985    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:21.831335 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:21.831289    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:22.077866 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:22.077775    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:22.632098 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:22.632069    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:22.853891 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:22.853855    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:23.652078 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:23.652043    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:24.473111 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:24.473067    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:25.250379 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:25.250334    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:25.946036 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:25.945998    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:26.563986 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:26.563952    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:27.238285 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:27.238244    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:27.856049 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:27.856016    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:28.463974 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:28.463940    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:29.156847 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:29.156818    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:29.745889 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:29.745857    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:29.888685 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:36:29.888647    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:36:30.352638 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:30.352603    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:30.947490 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:30.947456    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:31.548119 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:31.548088    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:32.152892 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:32.152862    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:32.851159 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:32.851120    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:33.547879 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:33.547845    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:34.148042 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:34.148003    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:34.748285 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:34.748251    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:35.175757 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:35.175726    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:35.450201 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:35.450119    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:36.053964 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:36.053929    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:36.652228 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:36.652180    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:37.602036 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:37.601989    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:37.858696 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:37.858600    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:38.491784 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:38.491745    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:39.153282 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:39.153242    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:39.763263 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:39.763212    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:40.425001 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:40.424960    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:41.235452 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:41.235412    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:41.843134 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:41.843094    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:42.551478 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:42.551442    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:43.349201 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:43.349149    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:43.964018 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:43.963984    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:44.555073 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:44.555035    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:45.258284 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:45.258234    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:45.859910 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:45.859870    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:46.457122 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:46.457086    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:47.061034 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:47.060996    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:47.660421 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:47.660385    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:48.271837 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:48.271801    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:48.857685 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:48.857649    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:49.613634 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:49.613600    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:50.300179 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:50.300140    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:50.841901 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:50.841866    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:51.444913 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:51.444878    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:52.043744 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:52.043713    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:52.248696 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:52.248653    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:52.644140 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:52.644101    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:53.340085 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:53.340050    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:53.955075 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:53.955045    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:54.728256 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:54.728199    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:55.631389 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:55.631357    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:56.259734 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:56.259701    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:56.855187 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:56.855157    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:57.459159 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:57.459119    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:58.060876 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:58.060842    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:58.656658 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:58.656616    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:59.321575 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:36:59.321539    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:36:59.887267 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:36:59.887207    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:37:00.040846 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:00.040816    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:00.652882 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:00.652834    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:01.254989 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:01.254959    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:01.850013 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:01.849975    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:02.453931 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:02.453896    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:03.053931 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:03.053899    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:03.659966 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:03.659932    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:03.964719 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:03.964630    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:04.451646 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:04.451613    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:05.161984 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:05.161940    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:05.860824 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:05.860493    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:06.405551 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:06.405511    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:07.031078 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:07.031039    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:07.648641 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:07.648606    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:08.346140 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:08.346102    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:09.050034 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:09.049998    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:09.150960 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:09.150921    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:09.646051 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:09.646013    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:10.251571 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:10.251539    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:10.938444 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:10.938407    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:11.538191 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:11.538133    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:12.159436 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:12.159402    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:12.742961 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:12.742921    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:13.405610 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:13.405573    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:14.045274 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:14.045238    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:14.287502 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:14.287472    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:14.388496 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:14.388463    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:14.615135 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:14.615103    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:14.742584 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:14.742500    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:14.849790 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:14.849751    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:15.285760 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:15.285729    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:21.101835 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:21.101769    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:21.178498 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:21.178460    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:21.430344 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:21.430260    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:25.404544 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:25.404443    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:29.953972 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:37:29.953912    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:37:35.223660 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:35.223619    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:43.038253 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:43.038184    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:45.871242 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:45.871184    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:46.075596 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:46.075560    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:48.190402 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:48.190359    5076 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-696f47c6c-wxsbd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 22:37:48.191064 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:48.191027    5076 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-696f47c6c-wxsbd" podUID="c0d2ada9-88d6-40b1-96d3-ef5d72c48295" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 22:37:51.465364 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:37:51.465330    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:37:59.888414 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:37:59.888374    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:38:09.919837 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:09.919799    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:38:11.227833 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:11.227793    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:38:29.953075 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:38:29.953031    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:38:35.273967 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:35.273934    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:38:52.024445 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:52.024375    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:38:54.133563 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:54.133481    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:38:54.555021 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:54.554932    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:38:54.764754 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:54.764721    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:38:55.005729 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.005694    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7b994c7666-242bt"]
Nov 02 22:38:55.006096 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.006084    5076 cpu_manager.go:414] "containerMap: removing container" podUID="a6a64fae-cc2c-4a65-bbeb-86462194979e" containerName="cleanup"
Nov 02 22:38:55.006150 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.006098    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6a64fae-cc2c-4a65-bbeb-86462194979e" containerName="cleanup"
Nov 02 22:38:55.006150 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.006134    5076 cpu_manager.go:414] "containerMap: removing container" podUID="a6a64fae-cc2c-4a65-bbeb-86462194979e" containerName="cleanup"
Nov 02 22:38:55.006150 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.006139    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6a64fae-cc2c-4a65-bbeb-86462194979e" containerName="cleanup"
Nov 02 22:38:55.006263 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.006152    5076 cpu_manager.go:414] "containerMap: removing container" podUID="a6a64fae-cc2c-4a65-bbeb-86462194979e" containerName="cleanup"
Nov 02 22:38:55.006263 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.006159    5076 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6a64fae-cc2c-4a65-bbeb-86462194979e" containerName="cleanup"
Nov 02 22:38:55.006263 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.006237    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="a6a64fae-cc2c-4a65-bbeb-86462194979e" containerName="cleanup"
Nov 02 22:38:55.006263 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.006248    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="a6a64fae-cc2c-4a65-bbeb-86462194979e" containerName="cleanup"
Nov 02 22:38:55.009360 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.009345    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b994c7666-242bt"
Nov 02 22:38:55.015856 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.015796    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 02 22:38:55.016002 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.015970    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tcmbk\""
Nov 02 22:38:55.016061 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.016033    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Nov 02 22:38:55.018398 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.018371    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b994c7666-242bt"]
Nov 02 22:38:55.076500 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.076468    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7e573eb-3286-44b7-9e78-02672f61b9f3-maas-api-tls\") pod \"maas-api-7b994c7666-242bt\" (UID: \"d7e573eb-3286-44b7-9e78-02672f61b9f3\") " pod="odh-ai-gateway-infra/maas-api-7b994c7666-242bt"
Nov 02 22:38:55.076654 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.076578    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj82p\" (UniqueName: \"kubernetes.io/projected/d7e573eb-3286-44b7-9e78-02672f61b9f3-kube-api-access-xj82p\") pod \"maas-api-7b994c7666-242bt\" (UID: \"d7e573eb-3286-44b7-9e78-02672f61b9f3\") " pod="odh-ai-gateway-infra/maas-api-7b994c7666-242bt"
Nov 02 22:38:55.076654 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.076623    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7e573eb-3286-44b7-9e78-02672f61b9f3-metrics-certs\") pod \"maas-api-7b994c7666-242bt\" (UID: \"d7e573eb-3286-44b7-9e78-02672f61b9f3\") " pod="odh-ai-gateway-infra/maas-api-7b994c7666-242bt"
Nov 02 22:38:55.076771 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.076670    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e573eb-3286-44b7-9e78-02672f61b9f3-openshift-service-ca\") pod \"maas-api-7b994c7666-242bt\" (UID: \"d7e573eb-3286-44b7-9e78-02672f61b9f3\") " pod="odh-ai-gateway-infra/maas-api-7b994c7666-242bt"
Nov 02 22:38:55.177445 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.177404    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7e573eb-3286-44b7-9e78-02672f61b9f3-metrics-certs\") pod \"maas-api-7b994c7666-242bt\" (UID: \"d7e573eb-3286-44b7-9e78-02672f61b9f3\") " pod="odh-ai-gateway-infra/maas-api-7b994c7666-242bt"
Nov 02 22:38:55.177445 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.177446    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e573eb-3286-44b7-9e78-02672f61b9f3-openshift-service-ca\") pod \"maas-api-7b994c7666-242bt\" (UID: \"d7e573eb-3286-44b7-9e78-02672f61b9f3\") " pod="odh-ai-gateway-infra/maas-api-7b994c7666-242bt"
Nov 02 22:38:55.178016 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.177538    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7e573eb-3286-44b7-9e78-02672f61b9f3-maas-api-tls\") pod \"maas-api-7b994c7666-242bt\" (UID: \"d7e573eb-3286-44b7-9e78-02672f61b9f3\") " pod="odh-ai-gateway-infra/maas-api-7b994c7666-242bt"
Nov 02 22:38:55.178016 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.177724    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj82p\" (UniqueName: \"kubernetes.io/projected/d7e573eb-3286-44b7-9e78-02672f61b9f3-kube-api-access-xj82p\") pod \"maas-api-7b994c7666-242bt\" (UID: \"d7e573eb-3286-44b7-9e78-02672f61b9f3\") " pod="odh-ai-gateway-infra/maas-api-7b994c7666-242bt"
Nov 02 22:38:55.178325 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.178297    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e573eb-3286-44b7-9e78-02672f61b9f3-openshift-service-ca\") pod \"maas-api-7b994c7666-242bt\" (UID: \"d7e573eb-3286-44b7-9e78-02672f61b9f3\") " pod="odh-ai-gateway-infra/maas-api-7b994c7666-242bt"
Nov 02 22:38:55.179892 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.179868    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7e573eb-3286-44b7-9e78-02672f61b9f3-metrics-certs\") pod \"maas-api-7b994c7666-242bt\" (UID: \"d7e573eb-3286-44b7-9e78-02672f61b9f3\") " pod="odh-ai-gateway-infra/maas-api-7b994c7666-242bt"
Nov 02 22:38:55.179987 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.179943    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7e573eb-3286-44b7-9e78-02672f61b9f3-maas-api-tls\") pod \"maas-api-7b994c7666-242bt\" (UID: \"d7e573eb-3286-44b7-9e78-02672f61b9f3\") " pod="odh-ai-gateway-infra/maas-api-7b994c7666-242bt"
Nov 02 22:38:55.185280 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.185260    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj82p\" (UniqueName: \"kubernetes.io/projected/d7e573eb-3286-44b7-9e78-02672f61b9f3-kube-api-access-xj82p\") pod \"maas-api-7b994c7666-242bt\" (UID: \"d7e573eb-3286-44b7-9e78-02672f61b9f3\") " pod="odh-ai-gateway-infra/maas-api-7b994c7666-242bt"
Nov 02 22:38:55.323114 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.323026    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b994c7666-242bt"
Nov 02 22:38:55.603067 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.603042    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b994c7666-242bt"]
Nov 02 22:38:55.604261 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:38:55.604211    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7e573eb_3286_44b7_9e78_02672f61b9f3.slice/crio-18cf60a2b718d12c72c1504ce7d68100110f11c9a1b34933537c38c352aee1df WatchSource:0}: Error finding container 18cf60a2b718d12c72c1504ce7d68100110f11c9a1b34933537c38c352aee1df: Status 404 returned error can't find the container with id 18cf60a2b718d12c72c1504ce7d68100110f11c9a1b34933537c38c352aee1df
Nov 02 22:38:55.605884 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:55.605861    5076 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 22:38:56.120607 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:56.120573    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b994c7666-242bt" event={"ID":"d7e573eb-3286-44b7-9e78-02672f61b9f3","Type":"ContainerStarted","Data":"18cf60a2b718d12c72c1504ce7d68100110f11c9a1b34933537c38c352aee1df"}
Nov 02 22:38:57.127249 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:57.127197    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b994c7666-242bt" event={"ID":"d7e573eb-3286-44b7-9e78-02672f61b9f3","Type":"ContainerStarted","Data":"a8478c4e284574f67b297e097f6830a209473aedc48207033c4687c58fb29273"}
Nov 02 22:38:57.127656 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:57.127345    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7b994c7666-242bt"
Nov 02 22:38:57.145950 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:57.145907    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7b994c7666-242bt" podStartSLOduration=2.6858136 podStartE2EDuration="3.145896155s" totalImagesPullingTime="460.082555ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 22:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:38:57.144211227 +0000 UTC m=+2446.200545609" watchObservedRunningTime="2026-11-02 22:38:57.145896155 +0000 UTC m=+2446.202230535"
Nov 02 22:38:57.454803 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:57.454731    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:38:57.555141 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:57.555106    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:38:58.700769 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:58.700722    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:38:58.802558 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:58.802514    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:38:58.907062 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:58.906969    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:38:59.470518 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:38:59.470483    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:38:59.888749 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:38:59.888707    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:39:00.141884 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:00.141795    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:00.753932 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:00.753899    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:01.458355 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:01.458320    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:02.047066 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:02.047035    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:02.761120 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:02.761085    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:03.138205 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:03.138174    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7b994c7666-242bt"
Nov 02 22:39:03.468034 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:03.467948    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:04.160719 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:04.160683    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:04.858555 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:04.858518    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:05.554907 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:05.554867    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:06.176540 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:06.176502    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:06.859555 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:06.859520    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:07.707535 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:07.707502    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:08.351943 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:08.351910    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:08.963933 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:08.963896    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:09.564378 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:09.564345    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:10.165733 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:10.165698    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:10.828174 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:10.828129    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:11.436864 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:11.436833    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:12.169876 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:12.169845    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:12.901892 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:12.901859    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:13.831836 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:13.831798    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:14.582274 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:14.582236    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:15.274245 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:15.274192    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:15.972026 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:15.971986    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:16.708239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:16.708183    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:17.354302 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:17.354260    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:17.965412 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:17.965371    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:18.696737 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:18.696703    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:19.349309 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:19.349276    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:19.945021 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:19.944979    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:20.625892 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:20.625844    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:21.152508 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:21.152476    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:21.748404 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:21.748365    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:22.349730 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:22.349691    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:22.950399 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:22.950364    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:23.454041 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:23.454004    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:23.553664 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:23.553635    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:23.657173 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:23.657118    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:24.056058 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:24.056022    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:24.188239 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:24.188173    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:24.275588 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:24.275557    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:29.639021 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:29.638989    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:29.887337 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:39:29.887303    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:39:30.884980 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:30.884945    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:31.394839 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:31.394807    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:31.534254 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:31.534210    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:34.410338 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:34.410302    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:34.511565 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:34.511524    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:35.303595 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:35.303559    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:35.561728 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:35.561644    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:35.657298 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:35.657256    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:35.779919 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:35.779811    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:36.415050 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:36.415013    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:37.061269 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:37.061238    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:37.669761 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:37.669725    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:38.511969 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:38.511931    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:39.174628 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:39.174591    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:39.990388 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:39.990348    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:40.660471 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:40.660440    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:41.373147 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:41.373112    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:42.084460 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:42.084430    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:42.743738 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:42.743707    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:43.422300 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:43.422262    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:44.130642 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:44.130609    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:45.039531 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:45.039503    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:45.756178 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:45.756132    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:46.460938 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:46.460895    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:47.165231 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:47.165176    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:47.882190 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:47.882155    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:48.576607 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:48.576572    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:49.273626 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:49.273593    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:49.373544 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:49.373504    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:49.973819 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:49.973787    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:50.745591 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:50.745556    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:51.459572 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:51.459534    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:52.159062 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:52.159027    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:52.862714 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:52.862677    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:53.641506 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:53.641470    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:54.244982 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:54.244949    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:54.850488 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:54.850452    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:55.632647 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:55.632605    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:56.139589 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:56.139548    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:56.744294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:56.744259    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:57.355134 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:57.355088    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:57.946923 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:57.946890    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:58.546002 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:58.545965    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:59.151706 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:59.151665    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:59.752618 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:39:59.752582    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:39:59.887062 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:39:59.887022    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:40:00.448593 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:00.448561    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:01.060862 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:01.060810    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:01.642273 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:01.642236    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:02.323001 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:02.322959    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:02.878469 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:02.878428    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:03.446524 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:03.446490    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:04.041569 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:04.041537    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:04.755672 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:04.755637    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:05.343189 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:05.343158    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:06.043013 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:06.042972    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:06.647622 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:06.647590    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:07.250707 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:07.250674    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:07.849423 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:07.849395    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:08.450261 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:08.450203    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:09.056674 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:09.056635    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:09.711154 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:09.711122    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:10.357344 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:10.357307    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:10.956683 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:10.956651    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:11.649595 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:11.649564    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:12.255348 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:12.255317    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:12.870797 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:12.870758    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:13.541361 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:13.541330    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:14.239046 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:14.239004    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:14.753713 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:14.753682    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:15.354473 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:15.354439    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:15.955997 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:15.955963    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:16.555045 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:16.555008    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:17.165254 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:17.165192    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:17.751265 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:17.751205    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:18.351540 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:18.351495    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:18.948803 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:18.948755    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:19.154431 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:19.154400    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:19.255199 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:19.255102    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:19.544559 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:19.544472    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:20.151338 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:20.151300    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:20.775039 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:20.774989    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:21.459656 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:21.459620    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:22.043269 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:22.043204    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:22.654859 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:22.654832    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:23.238816 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:23.238786    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:23.846207 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:23.846168    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:24.451842 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:24.451811    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:25.123154 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:25.123107    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:25.751212 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:25.751178    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:26.448491 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:26.448458    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:27.191926 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:27.191889    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:27.958318 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:27.958280    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:28.609814 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:28.609770    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:29.247931 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:29.247897    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:29.886734 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:40:29.886698    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:40:29.956461 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:29.956338    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:30.551473 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:30.551439    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:31.154479 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:31.154445    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:31.759787 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:31.759751    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:32.446117 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:32.446078    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:33.053108 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:33.053064    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:33.653795 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:33.653755    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:34.250739 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:34.250704    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:34.902462 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:34.902427    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:35.343979 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:35.343903    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:35.457294 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:35.457260    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:36.059281 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:36.059248    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:36.658627 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:36.658594    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:37.295308 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:37.295275    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:37.949916 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:37.949881    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:38.544948 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:38.544909    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:39.225411 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:39.225316    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:39.880380 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:39.880346    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:40.461780 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:40.461750    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:41.153051 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:41.153017    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:41.854161 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:41.854130    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:42.453062 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:42.453031    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:43.135147 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:43.135111    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:43.744928 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:43.744893    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:44.449009 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:44.448969    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:45.049147 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:45.049113    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:45.644620 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:45.644588    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:46.241494 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:46.241465    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:46.856231 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:46.856196    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:47.454508 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:47.454473    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:48.059707 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:48.059674    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:48.750505 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:48.750467    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:49.347769 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:49.347734    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:49.956547 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:49.956514    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:50.644454 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:50.644421    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:51.251096 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:51.251065    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:51.948822 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:51.948789    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:52.548296 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:52.548260    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:53.154595 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:53.154559    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:53.753502 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:53.753470    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:54.341910 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:54.341870    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:54.947615 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:54.947584    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:55.607712 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:55.601817    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:56.144319 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:56.144285    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:56.742995 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:56.742963    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:57.343873 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:57.343832    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:57.958676 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:57.958640    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:58.543845 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:58.543812    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:59.254314 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:40:59.254281    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:40:59.888776 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:40:59.888740    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:41:00.061246 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:00.061197    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:00.644128 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:00.644096    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:01.244626 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:01.244589    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:01.848160 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:01.848099    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:02.462572 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:02.462536    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:03.051842 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:03.051805    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:03.657676 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:03.657624    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:04.262841 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:04.262808    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:04.851065 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:04.851031    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:05.452138 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:05.452100    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:06.123369 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:06.123334    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:06.655182 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:06.655138    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:07.333574 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:07.333538    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:08.025981 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:08.025946    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:08.558347 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:08.558308    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:09.160359 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:09.160324    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:09.930744 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:09.930710    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:10.548836 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:10.548801    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:11.149471 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:11.149437    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:11.755279 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:11.755243    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:12.358846 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:12.358802    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:12.965019 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:12.964981    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:13.562964 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:13.562927    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:14.158163 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:14.158129    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:14.761004 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:14.760967    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:15.357618 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:15.357582    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:15.948106 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:15.948071    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:16.551604 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:16.551571    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:17.266289 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:17.266251    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:17.865062 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:17.865018    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:18.552513 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:18.552478    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:19.164159 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:19.164116    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:19.393019 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:19.392986    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:19.493806 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:19.493722    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:19.773817 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:19.773740    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:24.683655 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:24.683622    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:25.291601 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:25.291563    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:25.391686 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:25.391651    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:25.495272 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:25.494148    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:25.922516 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:25.922480    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:29.887735 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:41:29.887701    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:41:31.424114 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:31.424081    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:31.525167 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:31.525136    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:31.807891 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:31.807806    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:35.502717 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:41:35.502683    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:41:59.888308 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:41:59.888200    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:42:20.962354 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:20.962320    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d4ff58769-mqmxp_303c9147-16d9-4b22-abb7-903102e1eeb2/authorino/0.log"
Nov 02 22:42:29.887982 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:42:29.887936    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:42:31.389340 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:31.389313    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-bdsrg_aabf1bfc-ffbc-4de0-a8e6-b2e45ef0204d/manager/0.log"
Nov 02 22:42:31.568168 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:31.568122    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-tpqbf_ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31/manager/0.log"
Nov 02 22:42:31.769997 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:31.769915    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-l22dn_6b1a4e54-df82-49c1-b146-eb1e1c4561ea/manager/0.log"
Nov 02 22:42:32.236197 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:32.236171    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-j9zmw_f60fe2c2-81e5-4f1e-8ca1-60158acf9278/server/0.log"
Nov 02 22:42:32.421837 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:32.421806    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-n2xfv_7453965d-d179-4e30-b187-5e0abf2a56f9/manager/0.log"
Nov 02 22:42:32.613056 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:32.613015    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-6qvf2_b256cdd6-7969-421d-9639-3287e938b8c7/proxy/0.log"
Nov 02 22:42:33.328723 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:33.328693    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7b994c7666-242bt_d7e573eb-3286-44b7-9e78-02672f61b9f3/maas-api/0.log"
Nov 02 22:42:34.731646 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:34.731616    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-pqk8j_62cbe7e8-f05e-4ecf-ae10-167a578170b0/postgres/0.log"
Nov 02 22:42:35.549558 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:35.549524    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:42:36.159496 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:36.159465    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d4ff58769-mqmxp_303c9147-16d9-4b22-abb7-903102e1eeb2/authorino/0.log"
Nov 02 22:42:36.395784 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:36.395754    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-6p4g4_8a3ea507-f664-4d36-b470-219f725b4022/manager/0.log"
Nov 02 22:42:36.570586 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:36.570512    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-fjj4r_4668a7b8-e3c2-4037-a38c-c21f0c7e0bc8/manager/0.log"
Nov 02 22:42:37.396792 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:37.396761    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-sdjbx_bc3565cb-9021-4e7c-bf61-70e83d593306/manager/0.log"
Nov 02 22:42:38.140040 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:38.140007    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-55fd48578969dh5_219c8f92-c6fd-406a-9472-a414db84d828/istio-proxy/0.log"
Nov 02 22:42:38.321566 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:38.321527    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-4vqfq_60f5227d-b77d-4544-8c7f-422667ffca6c/discovery/0.log"
Nov 02 22:42:39.415905 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:39.415873    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-696f47c6c-mfp5r_d92ea2e2-e37c-4eff-a390-4af247ab43ef/istio-proxy/0.log"
Nov 02 22:42:40.090315 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:40.090281    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-696f47c6c-wxsbd_c0d2ada9-88d6-40b1-96d3-ef5d72c48295/istio-proxy/1.log"
Nov 02 22:42:40.473209 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:40.473172    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-696f47c6c-zwt7j_bfa6e173-901f-4dc4-8d9e-889c395a26df/istio-proxy/0.log"
Nov 02 22:42:40.657792 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:40.657760    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj_fcdcd5b0-4a1c-4d67-a46e-ae643424c08a/istio-proxy/0.log"
Nov 02 22:42:41.582377 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:41.582347    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-696f47c6c-wxsbd_c0d2ada9-88d6-40b1-96d3-ef5d72c48295/istio-proxy/0.log"
Nov 02 22:42:42.363052 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:42.363015    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:42:44.221163 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:44.221131    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d4ff58769-mqmxp_303c9147-16d9-4b22-abb7-903102e1eeb2/authorino/0.log"
Nov 02 22:42:53.339256 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:53.339210    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-bdsrg_aabf1bfc-ffbc-4de0-a8e6-b2e45ef0204d/manager/0.log"
Nov 02 22:42:53.531879 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:53.531848    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-tpqbf_ccb79fe1-02f1-4cb1-a2e6-67852d4d9c31/manager/0.log"
Nov 02 22:42:53.729148 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:53.729115    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-l22dn_6b1a4e54-df82-49c1-b146-eb1e1c4561ea/manager/0.log"
Nov 02 22:42:54.140472 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:54.140436    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-j9zmw_f60fe2c2-81e5-4f1e-8ca1-60158acf9278/server/0.log"
Nov 02 22:42:54.342013 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:54.341985    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-n2xfv_7453965d-d179-4e30-b187-5e0abf2a56f9/manager/0.log"
Nov 02 22:42:54.543298 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:54.543204    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-6qvf2_b256cdd6-7969-421d-9639-3287e938b8c7/proxy/0.log"
Nov 02 22:42:55.062476 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:55.062442    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7b994c7666-242bt_d7e573eb-3286-44b7-9e78-02672f61b9f3/maas-api/0.log"
Nov 02 22:42:56.464808 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:56.464771    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-pqk8j_62cbe7e8-f05e-4ecf-ae10-167a578170b0/postgres/0.log"
Nov 02 22:42:57.594938 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:57.594907    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d4ff58769-mqmxp_303c9147-16d9-4b22-abb7-903102e1eeb2/authorino/0.log"
Nov 02 22:42:57.809479 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:57.809441    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-6p4g4_8a3ea507-f664-4d36-b470-219f725b4022/manager/0.log"
Nov 02 22:42:57.986636 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:57.986611    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-fjj4r_4668a7b8-e3c2-4037-a38c-c21f0c7e0bc8/manager/0.log"
Nov 02 22:42:58.724386 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:58.724341    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-sdjbx_bc3565cb-9021-4e7c-bf61-70e83d593306/manager/0.log"
Nov 02 22:42:59.235034 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:59.235001    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-55fd48578969dh5_219c8f92-c6fd-406a-9472-a414db84d828/istio-proxy/0.log"
Nov 02 22:42:59.428627 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:42:59.428593    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-4vqfq_60f5227d-b77d-4544-8c7f-422667ffca6c/discovery/0.log"
Nov 02 22:42:59.887445 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:42:59.887408    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:43:00.532182 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:43:00.532149    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-696f47c6c-mfp5r_d92ea2e2-e37c-4eff-a390-4af247ab43ef/istio-proxy/0.log"
Nov 02 22:43:01.250453 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:43:01.250411    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-696f47c6c-wxsbd_c0d2ada9-88d6-40b1-96d3-ef5d72c48295/istio-proxy/1.log"
Nov 02 22:43:01.598388 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:43:01.598304    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-696f47c6c-zwt7j_bfa6e173-901f-4dc4-8d9e-889c395a26df/istio-proxy/0.log"
Nov 02 22:43:01.782400 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:43:01.782373    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj_fcdcd5b0-4a1c-4d67-a46e-ae643424c08a/istio-proxy/0.log"
Nov 02 22:43:29.892308 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:43:29.892205    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:43:30.780721 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:43:30.780677    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:43:30.880971 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:43:30.880937    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:43:35.591099 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:43:35.591060    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:43:59.887353 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:43:59.887312    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:44:26.867176 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:26.867137    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:44:26.965953 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:26.965918    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:44:29.887356 ip-10-0-142-132 kubenswrapper[5076]: E1102 22:44:29.887314    5076 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ff49f" containerName="extractor"
Nov 02 22:44:30.072358 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:30.072331    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g8bvh_0ad960f5-ae8d-43ed-950f-b6f93be7e101/global-pull-secret-syncer/0.log"
Nov 02 22:44:30.256946 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:30.256854    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log"
Nov 02 22:44:30.430967 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:30.430940    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-132.us-east-2.compute.internal_3bcc33effb8bb32f83119c817ee77244/haproxy/0.log"
Nov 02 22:44:35.674169 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:35.674131    5076 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fssjr_79c8e674-3d99-4644-bf32-199d1de151a6/konnectivity-agent/0.log" limit=1024
Nov 02 22:44:37.490650 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:37.490610    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d4ff58769-mqmxp_303c9147-16d9-4b22-abb7-903102e1eeb2/authorino/0.log"
Nov 02 22:44:37.520701 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:37.520664    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-6p4g4_8a3ea507-f664-4d36-b470-219f725b4022/manager/0.log"
Nov 02 22:44:37.544556 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:37.544524    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-fjj4r_4668a7b8-e3c2-4037-a38c-c21f0c7e0bc8/manager/0.log"
Nov 02 22:44:37.765890 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:37.765819    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-sdjbx_bc3565cb-9021-4e7c-bf61-70e83d593306/manager/0.log"
Nov 02 22:44:39.309584 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:39.309543    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-2x96f_e9a7b55f-d4a3-48fe-8c1b-640483fd9bc4/monitoring-plugin/0.log"
Nov 02 22:44:39.407970 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:39.407942    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ngqs4_61ad6168-e16c-4985-83fa-0e1f83918a70/node-exporter/0.log"
Nov 02 22:44:39.427894 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:39.427872    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ngqs4_61ad6168-e16c-4985-83fa-0e1f83918a70/kube-rbac-proxy/0.log"
Nov 02 22:44:39.448871 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:39.448853    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ngqs4_61ad6168-e16c-4985-83fa-0e1f83918a70/init-textfile/0.log"
Nov 02 22:44:39.563110 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:39.563030    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-sq24j_38f59469-37aa-4519-bc84-9f2777b31ccf/kube-rbac-proxy-main/0.log"
Nov 02 22:44:39.585415 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:39.585385    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-sq24j_38f59469-37aa-4519-bc84-9f2777b31ccf/kube-rbac-proxy-self/0.log"
Nov 02 22:44:39.607468 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:39.607439    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-sq24j_38f59469-37aa-4519-bc84-9f2777b31ccf/openshift-state-metrics/0.log"
Nov 02 22:44:40.032605 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.032570    5076 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"]
Nov 02 22:44:40.033123 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.033103    5076 memory_manager.go:365] "RemoveStaleState removing state" podUID="a6a64fae-cc2c-4a65-bbeb-86462194979e" containerName="cleanup"
Nov 02 22:44:40.036290 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.036274    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"
Nov 02 22:44:40.045255 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.045166    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7zc4v\"/\"openshift-service-ca.crt\""
Nov 02 22:44:40.045388 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.045330    5076 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7zc4v\"/\"default-dockercfg-pw2c6\""
Nov 02 22:44:40.045465 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.045441    5076 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7zc4v\"/\"kube-root-ca.crt\""
Nov 02 22:44:40.048300 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.048273    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"]
Nov 02 22:44:40.114773 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.114739    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72a13aa8-21d2-4a6d-a3d5-7b0526babc02-proc\") pod \"perf-node-gather-daemonset-2s57l\" (UID: \"72a13aa8-21d2-4a6d-a3d5-7b0526babc02\") " pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"
Nov 02 22:44:40.114905 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.114803    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72a13aa8-21d2-4a6d-a3d5-7b0526babc02-lib-modules\") pod \"perf-node-gather-daemonset-2s57l\" (UID: \"72a13aa8-21d2-4a6d-a3d5-7b0526babc02\") " pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"
Nov 02 22:44:40.114905 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.114889    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72a13aa8-21d2-4a6d-a3d5-7b0526babc02-sys\") pod \"perf-node-gather-daemonset-2s57l\" (UID: \"72a13aa8-21d2-4a6d-a3d5-7b0526babc02\") " pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"
Nov 02 22:44:40.114998 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.114959    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72a13aa8-21d2-4a6d-a3d5-7b0526babc02-podres\") pod \"perf-node-gather-daemonset-2s57l\" (UID: \"72a13aa8-21d2-4a6d-a3d5-7b0526babc02\") " pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"
Nov 02 22:44:40.115047 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.115033    5076 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l898m\" (UniqueName: \"kubernetes.io/projected/72a13aa8-21d2-4a6d-a3d5-7b0526babc02-kube-api-access-l898m\") pod \"perf-node-gather-daemonset-2s57l\" (UID: \"72a13aa8-21d2-4a6d-a3d5-7b0526babc02\") " pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"
Nov 02 22:44:40.216549 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.216514    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72a13aa8-21d2-4a6d-a3d5-7b0526babc02-sys\") pod \"perf-node-gather-daemonset-2s57l\" (UID: \"72a13aa8-21d2-4a6d-a3d5-7b0526babc02\") " pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"
Nov 02 22:44:40.216549 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.216555    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72a13aa8-21d2-4a6d-a3d5-7b0526babc02-podres\") pod \"perf-node-gather-daemonset-2s57l\" (UID: \"72a13aa8-21d2-4a6d-a3d5-7b0526babc02\") " pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"
Nov 02 22:44:40.216784 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.216601    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l898m\" (UniqueName: \"kubernetes.io/projected/72a13aa8-21d2-4a6d-a3d5-7b0526babc02-kube-api-access-l898m\") pod \"perf-node-gather-daemonset-2s57l\" (UID: \"72a13aa8-21d2-4a6d-a3d5-7b0526babc02\") " pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"
Nov 02 22:44:40.216784 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.216620    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72a13aa8-21d2-4a6d-a3d5-7b0526babc02-proc\") pod \"perf-node-gather-daemonset-2s57l\" (UID: \"72a13aa8-21d2-4a6d-a3d5-7b0526babc02\") " pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"
Nov 02 22:44:40.216784 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.216646    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72a13aa8-21d2-4a6d-a3d5-7b0526babc02-sys\") pod \"perf-node-gather-daemonset-2s57l\" (UID: \"72a13aa8-21d2-4a6d-a3d5-7b0526babc02\") " pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"
Nov 02 22:44:40.216784 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.216659    5076 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72a13aa8-21d2-4a6d-a3d5-7b0526babc02-lib-modules\") pod \"perf-node-gather-daemonset-2s57l\" (UID: \"72a13aa8-21d2-4a6d-a3d5-7b0526babc02\") " pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"
Nov 02 22:44:40.216784 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.216704    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72a13aa8-21d2-4a6d-a3d5-7b0526babc02-proc\") pod \"perf-node-gather-daemonset-2s57l\" (UID: \"72a13aa8-21d2-4a6d-a3d5-7b0526babc02\") " pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"
Nov 02 22:44:40.216784 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.216715    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72a13aa8-21d2-4a6d-a3d5-7b0526babc02-podres\") pod \"perf-node-gather-daemonset-2s57l\" (UID: \"72a13aa8-21d2-4a6d-a3d5-7b0526babc02\") " pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"
Nov 02 22:44:40.216784 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.216750    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72a13aa8-21d2-4a6d-a3d5-7b0526babc02-lib-modules\") pod \"perf-node-gather-daemonset-2s57l\" (UID: \"72a13aa8-21d2-4a6d-a3d5-7b0526babc02\") " pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"
Nov 02 22:44:40.224304 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.224284    5076 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l898m\" (UniqueName: \"kubernetes.io/projected/72a13aa8-21d2-4a6d-a3d5-7b0526babc02-kube-api-access-l898m\") pod \"perf-node-gather-daemonset-2s57l\" (UID: \"72a13aa8-21d2-4a6d-a3d5-7b0526babc02\") " pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"
Nov 02 22:44:40.357639 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.357615    5076 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"
Nov 02 22:44:40.629443 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:40.629412    5076 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"]
Nov 02 22:44:40.630913 ip-10-0-142-132 kubenswrapper[5076]: W1102 22:44:40.630880    5076 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod72a13aa8_21d2_4a6d_a3d5_7b0526babc02.slice/crio-9ff77d10a5722e0df4cf67f591f21d9c3bdee474acf9be693fd104a62459c8e8 WatchSource:0}: Error finding container 9ff77d10a5722e0df4cf67f591f21d9c3bdee474acf9be693fd104a62459c8e8: Status 404 returned error can't find the container with id 9ff77d10a5722e0df4cf67f591f21d9c3bdee474acf9be693fd104a62459c8e8
Nov 02 22:44:41.177923 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:41.177880    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l" event={"ID":"72a13aa8-21d2-4a6d-a3d5-7b0526babc02","Type":"ContainerStarted","Data":"3390f2133bbaa5d603a3e10911e31fddb10cd033cfc7d6ee2e0740b72eacb257"}
Nov 02 22:44:41.178107 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:41.177940    5076 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l" event={"ID":"72a13aa8-21d2-4a6d-a3d5-7b0526babc02","Type":"ContainerStarted","Data":"9ff77d10a5722e0df4cf67f591f21d9c3bdee474acf9be693fd104a62459c8e8"}
Nov 02 22:44:41.178107 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:41.177961    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"
Nov 02 22:44:41.193716 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:41.193663    5076 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l" podStartSLOduration=1.193647419 podStartE2EDuration="1.193647419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 22:44:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 22:44:41.192616928 +0000 UTC m=+2790.248951309" watchObservedRunningTime="2026-11-02 22:44:41.193647419 +0000 UTC m=+2790.249981799"
Nov 02 22:44:42.441779 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:42.441746    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-559b7f869d-7ggrq_dc1e1250-aa56-4106-b9e4-0cea1bc51773/console/0.log"
Nov 02 22:44:44.265794 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:44.265759    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rjf77_39fb3387-3347-4028-837b-a93354d07835/dns/0.log"
Nov 02 22:44:44.285411 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:44.285390    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rjf77_39fb3387-3347-4028-837b-a93354d07835/kube-rbac-proxy/0.log"
Nov 02 22:44:44.331514 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:44.331495    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kk66k_8a7ce469-5b88-4552-bb1f-66a901701d43/dns-node-resolver/0.log"
Nov 02 22:44:44.942840 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:44.942808    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-65946b4b6f-qtvpw_932238d8-80c1-420e-b437-83525c2df2e8/registry/0.log"
Nov 02 22:44:45.016470 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:45.016444    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q9zww_2da733e7-c5c3-4170-b3c1-1817068ee620/node-ca/0.log"
Nov 02 22:44:46.099347 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:46.099309    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-55fd48578969dh5_219c8f92-c6fd-406a-9472-a414db84d828/istio-proxy/0.log"
Nov 02 22:44:47.195594 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:47.195554    5076 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7zc4v/perf-node-gather-daemonset-2s57l"
Nov 02 22:44:49.473258 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:49.473204    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-4vqfq_60f5227d-b77d-4544-8c7f-422667ffca6c/discovery/0.log"
Nov 02 22:44:49.662964 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:49.662935    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-696f47c6c-mfp5r_d92ea2e2-e37c-4eff-a390-4af247ab43ef/istio-proxy/0.log"
Nov 02 22:44:49.774702 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:49.774608    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-696f47c6c-wxsbd_c0d2ada9-88d6-40b1-96d3-ef5d72c48295/istio-proxy/0.log"
Nov 02 22:44:49.776835 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:49.776809    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-696f47c6c-wxsbd_c0d2ada9-88d6-40b1-96d3-ef5d72c48295/istio-proxy/1.log"
Nov 02 22:44:49.832943 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:49.832913    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-696f47c6c-zwt7j_bfa6e173-901f-4dc4-8d9e-889c395a26df/istio-proxy/0.log"
Nov 02 22:44:49.860413 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:49.860385    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj_fcdcd5b0-4a1c-4d67-a46e-ae643424c08a/istio-proxy/0.log"
Nov 02 22:44:50.229289 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:50.229256    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-55fd48578969dh5_219c8f92-c6fd-406a-9472-a414db84d828/istio-proxy/0.log"
Nov 02 22:44:51.790767 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:51.790735    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gkz57_36caef13-1364-4809-af05-58a3a2042ccc/serve-healthcheck-canary/0.log"
Nov 02 22:44:52.256645 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:52.256596    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ff49f_e2ba252e-e593-41ec-badb-6c7c98c725a2/kube-rbac-proxy/0.log"
Nov 02 22:44:52.279971 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:52.279945    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ff49f_e2ba252e-e593-41ec-badb-6c7c98c725a2/exporter/0.log"
Nov 02 22:44:52.303979 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:52.303945    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ff49f_e2ba252e-e593-41ec-badb-6c7c98c725a2/extractor/0.log"
Nov 02 22:44:52.485234 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:52.485199    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_periodic-gathering-7kp2p-ldjgk_c9754249-c79c-47f2-ab95-b4ef4ae80032/insights-gathering/0.log"
Nov 02 22:44:52.533429 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:52.533361    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_periodic-gathering-k9qbf-96c98_24a682dd-9873-4861-a837-3df17b108c00/insights-gathering/0.log"
Nov 02 22:44:53.633256 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:53.633164    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-4vqfq_60f5227d-b77d-4544-8c7f-422667ffca6c/discovery/0.log"
Nov 02 22:44:53.739323 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:53.739290    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-696f47c6c-mfp5r_d92ea2e2-e37c-4eff-a390-4af247ab43ef/istio-proxy/0.log"
Nov 02 22:44:53.807946 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:53.807917    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-696f47c6c-wxsbd_c0d2ada9-88d6-40b1-96d3-ef5d72c48295/istio-proxy/0.log"
Nov 02 22:44:53.809958 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:53.809933    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-696f47c6c-wxsbd_c0d2ada9-88d6-40b1-96d3-ef5d72c48295/istio-proxy/1.log"
Nov 02 22:44:53.848122 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:53.848097    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-696f47c6c-zwt7j_bfa6e173-901f-4dc4-8d9e-889c395a26df/istio-proxy/0.log"
Nov 02 22:44:53.866805 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:53.866782    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-648cc4b8c5-q5qjj_fcdcd5b0-4a1c-4d67-a46e-ae643424c08a/istio-proxy/0.log"
Nov 02 22:44:54.846753 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:54.846721    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr_2bf38393-9b8f-4bed-a3bb-13730a3c1c9c/manager/0.log"
Nov 02 22:44:54.874803 ip-10-0-142-132 kubenswrapper[5076]: I1102 22:44:54.874775    5076 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5c6f6f47c9-vwpbr_2bf38393-9b8f-4bed-a3bb-13730a3c1c9c/copy-manifests/0.log"