Oct 30 21:08:48.911751 ip-10-0-142-237 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Oct 30 21:08:48.911761 ip-10-0-142-237 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Oct 30 21:08:48.911768 ip-10-0-142-237 systemd[1]: kubelet.service: Failed with result 'resources'.
Oct 30 21:08:48.912002 ip-10-0-142-237 systemd[1]: Failed to start Kubernetes Kubelet.
Oct 30 21:08:58.946797 ip-10-0-142-237 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Oct 30 21:08:58.946817 ip-10-0-142-237 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 28efbb5891584657a7d77dde52667f67 --
Oct 30 21:10:48.737068 ip-10-0-142-237 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 21:10:49.102221 ip-10-0-142-237 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:10:49.102221 ip-10-0-142-237 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 21:10:49.102221 ip-10-0-142-237 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:10:49.102221 ip-10-0-142-237 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:10:49.107025 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.106937    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:10:49.107025 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107018    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:10:49.107025 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107022    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:10:49.107025 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107025    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:10:49.107025 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107029    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:10:49.107025 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107032    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:10:49.107025 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107035    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:10:49.107272 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107039    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:10:49.107272 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107041    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:10:49.107272 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107044    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:10:49.107272 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107047    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:10:49.107272 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107049    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:10:49.107272 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107052    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:10:49.107272 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107055    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:10:49.107272 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107057    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:10:49.107272 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107060    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:10:49.107272 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107063    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:10:49.107272 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107065    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:10:49.107272 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107068    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:10:49.107272 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107070    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:10:49.107272 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107073    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:10:49.107272 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107075    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:10:49.107272 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107077    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:10:49.107272 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107080    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:10:49.107272 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107082    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:10:49.107272 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107085    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:10:49.107272 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107088    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:10:49.107716 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107093    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:10:49.107716 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107096    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:10:49.107716 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107099    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:10:49.107716 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107101    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:10:49.107716 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107104    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:10:49.107716 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107108    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:10:49.107716 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107112    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:10:49.107716 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107115    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:10:49.107716 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107118    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:10:49.107716 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107120    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:10:49.107716 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107123    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:10:49.107716 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107125    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:10:49.107716 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107128    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:10:49.107716 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107132    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:10:49.107716 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107135    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:10:49.107716 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107137    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:10:49.107716 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107140    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:10:49.107716 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107142    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:10:49.108141 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107145    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:10:49.108141 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107147    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:10:49.108141 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107150    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:10:49.108141 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107152    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:10:49.108141 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107155    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:10:49.108141 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107158    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:10:49.108141 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107161    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:10:49.108141 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107163    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:10:49.108141 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107166    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:10:49.108141 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107168    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:10:49.108141 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107171    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:10:49.108141 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107173    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:10:49.108141 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107176    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:10:49.108141 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107178    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:10:49.108141 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107181    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:10:49.108141 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107183    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:10:49.108141 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107185    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:10:49.108141 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107188    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:10:49.108141 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107190    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:10:49.108141 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107193    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:10:49.108637 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107195    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:10:49.108637 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107198    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:10:49.108637 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107200    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:10:49.108637 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107203    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:10:49.108637 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107205    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:10:49.108637 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107208    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:10:49.108637 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107210    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:10:49.108637 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107213    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:10:49.108637 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107216    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:10:49.108637 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107218    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:10:49.108637 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107221    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:10:49.108637 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107223    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:10:49.108637 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107226    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:10:49.108637 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107228    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:10:49.108637 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107232    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:10:49.108637 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107234    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:10:49.108637 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107236    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:10:49.108637 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107239    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:10:49.108637 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107242    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:10:49.108637 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107245    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:10:49.109115 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107247    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:10:49.109115 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107250    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:10:49.109115 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107252    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:10:49.109115 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107255    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:10:49.109115 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107258    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:10:49.109115 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107260    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:10:49.109115 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107263    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:10:49.109115 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107267    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:10:49.109115 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107271    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:10:49.109115 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107275    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:10:49.109115 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107278    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:10:49.109115 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107280    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:10:49.109115 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107283    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:10:49.109115 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107286    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:10:49.109115 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107289    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:10:49.109115 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107291    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:10:49.109115 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107294    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:10:49.109115 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107296    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:10:49.109115 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107299    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:10:49.109546 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107302    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:10:49.109546 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.107305    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:10:49.109546 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108069    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:10:49.109546 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108076    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:10:49.109546 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108079    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:10:49.109546 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108082    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:10:49.109546 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108085    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:10:49.109546 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108087    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:10:49.109546 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108090    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:10:49.109546 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108092    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:10:49.109546 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108095    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:10:49.109546 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108098    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:10:49.109546 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108101    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:10:49.109546 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108103    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:10:49.109546 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108107    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:10:49.109546 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108111    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:10:49.109546 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108113    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:10:49.109546 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108116    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:10:49.109546 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108119    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:10:49.110007 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108122    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:10:49.110007 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108124    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:10:49.110007 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108127    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:10:49.110007 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108130    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:10:49.110007 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108133    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:10:49.110007 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108135    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:10:49.110007 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108138    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:10:49.110007 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108140    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:10:49.110007 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108143    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:10:49.110007 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108146    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:10:49.110007 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108148    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:10:49.110007 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108151    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:10:49.110007 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108154    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:10:49.110007 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108157    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:10:49.110007 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108160    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:10:49.110007 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108162    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:10:49.110007 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108165    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:10:49.110007 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108167    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:10:49.110007 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108170    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:10:49.110007 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108173    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:10:49.110476 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108175    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:10:49.110476 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108178    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:10:49.110476 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108180    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:10:49.110476 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108183    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:10:49.110476 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108185    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:10:49.110476 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108187    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:10:49.110476 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108191    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:10:49.110476 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108193    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:10:49.110476 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108196    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:10:49.110476 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108200    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:10:49.110476 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108203    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:10:49.110476 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108206    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:10:49.110476 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108209    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:10:49.110476 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108211    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:10:49.110476 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108214    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:10:49.110476 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108217    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:10:49.110476 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108219    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:10:49.110476 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108222    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:10:49.110476 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108224    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:10:49.110923 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108227    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:10:49.110923 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108229    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:10:49.110923 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108232    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:10:49.110923 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108234    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:10:49.110923 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108237    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:10:49.110923 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108239    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:10:49.110923 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108242    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:10:49.110923 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108245    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:10:49.110923 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108247    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:10:49.110923 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108250    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:10:49.110923 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108253    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:10:49.110923 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108256    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:10:49.110923 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108258    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:10:49.110923 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108261    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:10:49.110923 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108263    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:10:49.110923 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108266    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:10:49.110923 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108268    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:10:49.110923 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108270    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:10:49.110923 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108273    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:10:49.110923 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108275    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:10:49.111408 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108279    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:10:49.111408 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108281    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:10:49.111408 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108284    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:10:49.111408 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108287    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:10:49.111408 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108289    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:10:49.111408 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108292    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:10:49.111408 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108294    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:10:49.111408 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108297    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:10:49.111408 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108299    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:10:49.111408 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108301    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:10:49.111408 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108304    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:10:49.111408 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108307    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:10:49.111408 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108309    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:10:49.111408 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108312    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:10:49.111408 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108314    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:10:49.111408 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108316    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:10:49.111408 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108319    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:10:49.111408 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108322    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:10:49.111408 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108324    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:10:49.111408 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108326    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:10:49.111881 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108330    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:10:49.111881 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108335    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:10:49.111881 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108337    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:10:49.111881 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108340    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:10:49.111881 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108342    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:10:49.111881 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108345    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:10:49.111881 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108347    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:10:49.111881 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108350    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:10:49.111881 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108352    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:10:49.111881 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108355    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:10:49.111881 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108851    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:10:49.111881 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108857    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:10:49.111881 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108861    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:10:49.111881 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108863    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:10:49.111881 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108866    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:10:49.111881 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108868    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:10:49.111881 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108871    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:10:49.111881 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108875    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:10:49.111881 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108880    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:10:49.112316 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108883    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:10:49.112316 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108885    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:10:49.112316 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108888    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:10:49.112316 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108891    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:10:49.112316 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108894    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:10:49.112316 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108896    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:10:49.112316 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108899    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:10:49.112316 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108902    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:10:49.112316 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108905    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:10:49.112316 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108910    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:10:49.112316 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108913    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:10:49.112316 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108915    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:10:49.112316 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108918    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:10:49.112316 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108920    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:10:49.112316 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108924    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:10:49.112316 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108927    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:10:49.112316 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108930    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:10:49.112316 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108932    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:10:49.112316 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108935    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:10:49.112316 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108937    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:10:49.112785 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108940    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:10:49.112785 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108943    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:10:49.112785 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108945    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:10:49.112785 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108948    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:10:49.112785 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108950    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:10:49.112785 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108953    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:10:49.112785 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108956    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:10:49.112785 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108959    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:10:49.112785 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108962    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:10:49.112785 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108970    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:10:49.112785 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108973    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:10:49.112785 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108975    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:10:49.112785 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108977    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:10:49.112785 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108980    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:10:49.112785 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108982    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:10:49.112785 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108984    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:10:49.112785 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108987    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:10:49.112785 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108989    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:10:49.112785 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108992    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:10:49.112785 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108994    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:10:49.113257 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.108997    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:10:49.113257 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109000    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:10:49.113257 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109003    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:10:49.113257 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109005    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:10:49.113257 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109008    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:10:49.113257 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109010    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:10:49.113257 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109014    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:10:49.113257 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109017    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:10:49.113257 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109020    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:10:49.113257 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109022    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:10:49.113257 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109025    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:10:49.113257 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109027    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:10:49.113257 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109030    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:10:49.113257 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109032    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:10:49.113257 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109035    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:10:49.113257 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109037    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:10:49.113257 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109040    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:10:49.113257 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109042    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:10:49.113257 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109045    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:10:49.113686 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109048    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:10:49.113686 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109050    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:10:49.113686 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109053    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:10:49.113686 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109055    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:10:49.113686 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109058    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:10:49.113686 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109061    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:10:49.113686 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109065    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:10:49.113686 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109068    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:10:49.113686 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109071    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:10:49.113686 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109074    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:10:49.113686 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109076    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:10:49.113686 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109079    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:10:49.113686 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109082    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:10:49.113686 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109084    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:10:49.113686 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109088    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:10:49.113686 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109090    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:10:49.113686 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109092    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:10:49.113686 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109095    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:10:49.113686 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109098    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:10:49.114142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109101    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:10:49.114142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109104    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:10:49.114142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109106    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:10:49.114142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109109    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:10:49.114142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109111    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:10:49.114142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109114    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:10:49.114142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109116    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:10:49.114142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109119    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:10:49.114142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109122    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:10:49.114142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109125    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:10:49.114142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109127    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:10:49.114142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109130    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:10:49.114142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109133    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:10:49.114142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109136    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:10:49.114142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109139    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:10:49.114142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109142    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:10:49.114142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109144    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:10:49.114142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109146    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:10:49.114142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.109149    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:10:49.114142 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110081    2581 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110095    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110102    2581 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110107    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110111    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110115    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110120    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110128    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110132    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110136    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110139    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110142    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110145    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110149    2581 flags.go:64] FLAG: --cgroup-root=""
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110152    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110155    2581 flags.go:64] FLAG: --client-ca-file=""
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110158    2581 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110161    2581 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110166    2581 flags.go:64] FLAG: --cluster-domain=""
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110169    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110172    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110175    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110178    2581 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110182    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 21:10:49.114601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110185    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110188    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110191    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110194    2581 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110197    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110200    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110203    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110206    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110210    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110213    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110216    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110219    2581 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110222    2581 flags.go:64] FLAG: --enable-server="true"
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110224    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110229    2581 flags.go:64] FLAG: --event-burst="100"
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110232    2581 flags.go:64] FLAG: --event-qps="50"
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110235    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110239    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110242    2581 flags.go:64] FLAG: --eviction-hard=""
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110246    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110249    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110252    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110255    2581 flags.go:64] FLAG: --eviction-soft=""
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110259    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110261    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 21:10:49.115164 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110264    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110267    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110270    2581 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110273    2581 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110276    2581 flags.go:64] FLAG: --feature-gates=""
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110280    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110283    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110286    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110289    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110292    2581 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110295    2581 flags.go:64] FLAG: --help="false"
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110298    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110302    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110305    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110308    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110311    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110315    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110317    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110320    2581 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110323    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110326    2581 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110329    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110332    2581 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110335    2581 flags.go:64] FLAG: --kube-reserved=""
Oct 30 21:10:49.115786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110338    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110341    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110344    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110347    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110349    2581 flags.go:64] FLAG: --lock-file=""
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110352    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110355    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110358    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110364    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110367    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110370    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110372    2581 flags.go:64] FLAG: --logging-format="text"
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110375    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110379    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110382    2581 flags.go:64] FLAG: --manifest-url=""
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110385    2581 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110389    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110392    2581 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110396    2581 flags.go:64] FLAG: --max-pods="110"
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110399    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110402    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110405    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110409    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110412    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110415    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 21:10:49.116395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110417    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110424    2581 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110428    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110431    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110434    2581 flags.go:64] FLAG: --pod-cidr=""
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110436    2581 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110440    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110442    2581 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110445    2581 flags.go:64] FLAG: --port="10250"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110448    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110451    2581 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0b84b8ffac0062eb2"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110454    2581 flags.go:64] FLAG: --qos-reserved=""
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110457    2581 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110460    2581 flags.go:64] FLAG: --register-node="true"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110463    2581 flags.go:64] FLAG: --register-with-taints=""
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110467    2581 flags.go:64] FLAG: --registry-burst="10"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110469    2581 flags.go:64] FLAG: --registry-qps="5"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110472    2581 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110475    2581 flags.go:64] FLAG: --reserved-memory=""
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110479    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110482    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110485    2581 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110488    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110491    2581 flags.go:64] FLAG: --runonce="false"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110494    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110497    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110500    2581 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 21:10:49.117048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110502    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110505    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110509    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110512    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110515    2581 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110523    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110526    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110528    2581 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110531    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110534    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110537    2581 flags.go:64] FLAG: --system-cgroups=""
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110541    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110547    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110550    2581 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110553    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110557    2581 flags.go:64] FLAG: --tls-min-version=""
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110560    2581 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110563    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110566    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110569    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110572    2581 flags.go:64] FLAG: --v="2"
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110576    2581 flags.go:64] FLAG: --version="false"
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110580    2581 flags.go:64] FLAG: --vmodule=""
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110584    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.110587    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 21:10:49.117643 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110715    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:10:49.118220 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110719    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:10:49.118220 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110722    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:10:49.118220 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110724    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:10:49.118220 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110727    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:10:49.118220 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110729    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:10:49.118220 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110732    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:10:49.118220 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110734    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:10:49.118220 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110737    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:10:49.118220 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110739    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:10:49.118220 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110743    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:10:49.118220 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110745    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:10:49.118220 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110749    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:10:49.118220 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110752    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:10:49.118220 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110754    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:10:49.118220 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110757    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:10:49.118220 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110759    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:10:49.118220 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110762    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:10:49.118220 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110766    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:10:49.118220 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110768    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:10:49.118220 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110771    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:10:49.118677 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110773    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:10:49.118677 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110776    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:10:49.118677 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110778    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:10:49.118677 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110781    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:10:49.118677 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110783    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:10:49.118677 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110786    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:10:49.118677 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110789    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:10:49.118677 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110791    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:10:49.118677 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110793    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:10:49.118677 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110796    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:10:49.118677 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110799    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:10:49.118677 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110801    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:10:49.118677 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110804    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:10:49.118677 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110806    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:10:49.118677 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110809    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:10:49.118677 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110811    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:10:49.118677 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110814    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:10:49.118677 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110816    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:10:49.118677 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110819    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:10:49.119207 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110831    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:10:49.119207 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110834    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:10:49.119207 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110838    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:10:49.119207 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110842    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:10:49.119207 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110847    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:10:49.119207 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110851    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:10:49.119207 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110853    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:10:49.119207 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110856    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:10:49.119207 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110858    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:10:49.119207 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110861    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:10:49.119207 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110865    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:10:49.119207 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110867    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:10:49.119207 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110870    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:10:49.119207 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110872    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:10:49.119207 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110875    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:10:49.119207 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110877    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:10:49.119207 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110880    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:10:49.119207 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110882    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:10:49.119207 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110885    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:10:49.119207 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110887    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:10:49.119698 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110890    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:10:49.119698 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110892    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:10:49.119698 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110895    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:10:49.119698 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110897    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:10:49.119698 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110899    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:10:49.119698 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110902    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:10:49.119698 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110904    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:10:49.119698 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110907    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:10:49.119698 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110909    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:10:49.119698 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110912    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:10:49.119698 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110914    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:10:49.119698 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110917    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:10:49.119698 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110919    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:10:49.119698 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110922    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:10:49.119698 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110924    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:10:49.119698 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110927    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:10:49.119698 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110932    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:10:49.119698 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110935    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:10:49.119698 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110939    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:10:49.120147 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110943    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:10:49.120147 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110946    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:10:49.120147 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110948    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:10:49.120147 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110952    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:10:49.120147 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110955    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:10:49.120147 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110957    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:10:49.120147 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110960    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:10:49.120147 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110962    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:10:49.120147 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110965    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:10:49.120147 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110967    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:10:49.120147 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110970    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:10:49.120147 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110972    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:10:49.120147 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110975    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:10:49.120147 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110977    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:10:49.120147 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110980    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:10:49.120147 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110982    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:10:49.120147 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110985    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:10:49.120147 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110987    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:10:49.120147 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110989    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:10:49.120582 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110992    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:10:49.120582 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110994    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:10:49.120582 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.110997    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:10:49.120582 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111000    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:10:49.120582 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111002    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:10:49.120582 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111005    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:10:49.120582 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111007    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:10:49.120582 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111009    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:10:49.120582 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.111035    2581 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:10:49.120582 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111072    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:10:49.120582 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111077    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:10:49.120582 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111087    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:10:49.120582 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111090    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:10:49.120582 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111093    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:10:49.120582 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111096    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:10:49.120582 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111100    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:10:49.121053 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111104    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:10:49.121053 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111109    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:10:49.121053 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111111    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:10:49.121053 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111114    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:10:49.121053 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111116    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:10:49.121053 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111119    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:10:49.121053 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111121    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:10:49.121053 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111124    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:10:49.121053 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111126    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:10:49.121053 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111129    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:10:49.121053 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111131    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:10:49.121053 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111134    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:10:49.121053 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111137    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:10:49.121053 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111139    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:10:49.121053 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111142    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:10:49.121053 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111144    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:10:49.121053 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111147    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:10:49.121053 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111149    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:10:49.121053 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111152    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:10:49.121486 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111154    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:10:49.121486 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111157    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:10:49.121486 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111159    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:10:49.121486 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111162    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:10:49.121486 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111164    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:10:49.121486 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111167    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:10:49.121486 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111170    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:10:49.121486 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111174    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:10:49.121486 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111176    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:10:49.121486 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111180    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:10:49.121486 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111182    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:10:49.121486 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111185    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:10:49.121486 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111187    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:10:49.121486 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111190    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:10:49.121486 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111194    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:10:49.121486 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111196    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:10:49.121486 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111199    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:10:49.121486 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111201    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:10:49.121486 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111204    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:10:49.121486 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111206    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:10:49.121943 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111209    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:10:49.121943 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111212    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:10:49.121943 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111214    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:10:49.121943 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111217    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:10:49.121943 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111219    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:10:49.121943 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111222    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:10:49.121943 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111225    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:10:49.121943 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111228    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:10:49.121943 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111230    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:10:49.121943 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111232    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:10:49.121943 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111235    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:10:49.121943 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111237    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:10:49.121943 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111240    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:10:49.121943 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111243    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:10:49.121943 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111245    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:10:49.121943 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111247    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:10:49.121943 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111250    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:10:49.121943 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111252    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:10:49.121943 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111255    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:10:49.121943 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111259    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:10:49.122393 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111262    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:10:49.122393 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111264    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:10:49.122393 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111267    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:10:49.122393 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111270    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:10:49.122393 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111272    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:10:49.122393 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111275    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:10:49.122393 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111279    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:10:49.122393 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111281    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:10:49.122393 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111284    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:10:49.122393 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111286    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:10:49.122393 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111290    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:10:49.122393 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111293    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:10:49.122393 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111297    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:10:49.122393 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111299    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:10:49.122393 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111302    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:10:49.122393 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111304    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:10:49.122393 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111307    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:10:49.122393 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111309    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:10:49.122393 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111312    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:10:49.122869 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111314    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:10:49.122869 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111317    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:10:49.122869 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111319    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:10:49.122869 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111322    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:10:49.122869 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111324    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:10:49.122869 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111327    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:10:49.122869 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111329    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:10:49.122869 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111332    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:10:49.122869 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111334    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:10:49.122869 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111337    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:10:49.122869 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111339    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:10:49.122869 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111341    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:10:49.122869 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111346    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:10:49.122869 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111348    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:10:49.122869 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111351    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:10:49.122869 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111353    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:10:49.122869 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111356    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:10:49.122869 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111358    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:10:49.122869 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111361    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:10:49.122869 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111364    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:10:49.123321 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.111367    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:10:49.123321 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.119059    2581 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 21:10:49.123321 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.119076    2581 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 21:10:49.123321 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.119091    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 21:10:49.123321 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.119096    2581 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 21:10:49.123321 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119153    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:10:49.123321 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119159    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:10:49.123321 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119162    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:10:49.123321 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119165    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:10:49.123321 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119168    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:10:49.123321 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119171    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:10:49.123321 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119173    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:10:49.123321 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119176    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:10:49.123321 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119178    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:10:49.123321 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119181    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:10:49.123321 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119184    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:10:49.123321 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119186    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:10:49.123321 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119189    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:10:49.123321 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119191    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:10:49.123758 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119194    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:10:49.123758 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119196    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:10:49.123758 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119199    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:10:49.123758 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119202    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:10:49.123758 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119204    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:10:49.123758 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119207    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:10:49.123758 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119209    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:10:49.123758 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119212    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:10:49.123758 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119215    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:10:49.123758 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119218    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:10:49.123758 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119221    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:10:49.123758 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119223    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:10:49.123758 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119226    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:10:49.123758 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119228    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:10:49.123758 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119231    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:10:49.123758 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119240    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:10:49.123758 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119243    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:10:49.123758 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119245    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:10:49.123758 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119248    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:10:49.124205 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119251    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:10:49.124205 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119253    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:10:49.124205 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119255    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:10:49.124205 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119258    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:10:49.124205 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119260    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:10:49.124205 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119263    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:10:49.124205 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119265    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:10:49.124205 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119268    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:10:49.124205 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119270    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:10:49.124205 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119273    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:10:49.124205 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119276    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:10:49.124205 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119278    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:10:49.124205 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119280    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:10:49.124205 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119283    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:10:49.124205 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119286    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:10:49.124205 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119288    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:10:49.124205 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119291    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:10:49.124205 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119293    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:10:49.124205 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119296    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:10:49.124205 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119298    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:10:49.124657 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119300    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:10:49.124657 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119303    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:10:49.124657 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119305    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:10:49.124657 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119308    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:10:49.124657 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119310    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:10:49.124657 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119313    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:10:49.124657 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119315    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:10:49.124657 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119318    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:10:49.124657 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119321    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:10:49.124657 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119329    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:10:49.124657 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119332    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:10:49.124657 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119335    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:10:49.124657 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119337    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:10:49.124657 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119340    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:10:49.124657 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119342    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:10:49.124657 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119345    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:10:49.124657 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119348    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:10:49.124657 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119350    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:10:49.124657 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119352    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:10:49.124657 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119355    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:10:49.125182 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119357    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:10:49.125182 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119361    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:10:49.125182 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119365    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:10:49.125182 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119368    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:10:49.125182 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119371    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:10:49.125182 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119374    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:10:49.125182 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119377    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:10:49.125182 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119379    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:10:49.125182 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119382    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:10:49.125182 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119384    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:10:49.125182 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119387    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:10:49.125182 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119390    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:10:49.125182 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119392    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:10:49.125182 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119395    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:10:49.125182 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119397    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:10:49.125182 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119400    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:10:49.125182 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119402    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:10:49.125182 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119405    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:10:49.125182 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119407    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:10:49.125606 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119410    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:10:49.125606 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119413    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:10:49.125606 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119415    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:10:49.125606 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119424    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:10:49.125606 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119427    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:10:49.125606 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119429    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:10:49.125606 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119431    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:10:49.125606 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119434    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:10:49.125606 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119438    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:10:49.125606 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119441    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:10:49.125606 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119444    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:10:49.125606 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119447    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:10:49.125606 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119450    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:10:49.125606 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119452    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:10:49.125606 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.119479    2581 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:10:49.125606 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119660    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:10:49.126018 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119664    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:10:49.126018 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119667    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:10:49.126018 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119669    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:10:49.126018 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119672    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:10:49.126018 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119675    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:10:49.126018 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119677    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:10:49.126018 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119680    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:10:49.126018 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119682    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:10:49.126018 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119685    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:10:49.126018 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119688    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:10:49.126018 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119690    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:10:49.126018 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119693    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:10:49.126018 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119695    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:10:49.126018 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119698    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:10:49.126018 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119701    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:10:49.126018 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119704    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:10:49.126018 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119708    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:10:49.126018 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119711    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:10:49.126018 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119714    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:10:49.126452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119718    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:10:49.126452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119727    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:10:49.126452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119730    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:10:49.126452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119733    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:10:49.126452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119736    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:10:49.126452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119740    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:10:49.126452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119743    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:10:49.126452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119745    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:10:49.126452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119748    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:10:49.126452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119750    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:10:49.126452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119753    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:10:49.126452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119755    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:10:49.126452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119758    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:10:49.126452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119760    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:10:49.126452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119763    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:10:49.126452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119765    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:10:49.126452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119768    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:10:49.126452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119770    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:10:49.126452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119772    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:10:49.126895 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119775    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:10:49.126895 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119777    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:10:49.126895 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119780    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:10:49.126895 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119783    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:10:49.126895 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119785    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:10:49.126895 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119788    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:10:49.126895 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119790    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:10:49.126895 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119793    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:10:49.126895 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119795    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:10:49.126895 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119798    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:10:49.126895 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119800    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:10:49.126895 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119803    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:10:49.126895 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119805    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:10:49.126895 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119808    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:10:49.126895 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119810    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:10:49.126895 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119818    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:10:49.126895 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119821    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:10:49.126895 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119836    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:10:49.126895 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119839    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:10:49.126895 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119841    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:10:49.127344 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119844    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:10:49.127344 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119846    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:10:49.127344 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119848    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:10:49.127344 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119851    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:10:49.127344 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119853    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:10:49.127344 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119856    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:10:49.127344 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119858    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:10:49.127344 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119861    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:10:49.127344 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119863    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:10:49.127344 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119865    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:10:49.127344 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119868    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:10:49.127344 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119870    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:10:49.127344 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119873    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:10:49.127344 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119875    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:10:49.127344 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119877    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:10:49.127344 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119880    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:10:49.127344 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119882    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:10:49.127344 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119891    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:10:49.127344 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119894    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:10:49.127344 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119896    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:10:49.127792 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119899    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:10:49.127792 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119901    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:10:49.127792 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119904    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:10:49.127792 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119907    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:10:49.127792 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119909    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:10:49.127792 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119911    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:10:49.127792 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119914    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:10:49.127792 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119916    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:10:49.127792 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119924    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:10:49.127792 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119927    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:10:49.127792 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119930    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:10:49.127792 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119932    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:10:49.127792 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119934    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:10:49.127792 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119937    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:10:49.127792 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119939    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:10:49.127792 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119942    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:10:49.127792 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119944    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:10:49.127792 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119947    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:10:49.127792 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119949    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:10:49.128992 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119951    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:10:49.128992 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119954    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:10:49.128992 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119956    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:10:49.128992 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119958    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:10:49.128992 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119961    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:10:49.128992 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119963    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:10:49.128992 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119966    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:10:49.128992 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.119968    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:10:49.128992 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.119992    2581 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:10:49.128992 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120029    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:10:49.128992 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120033    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:10:49.128992 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120036    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:10:49.128992 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120039    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:10:49.128992 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120042    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:10:49.128992 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120045    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:10:49.128992 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120048    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120051    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120053    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120056    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120058    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120061    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120063    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120072    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120074    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120077    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120079    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120082    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120084    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120087    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120089    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120091    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120094    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120096    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120098    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120101    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120103    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:10:49.129352 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120106    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:10:49.129819 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120108    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:10:49.129819 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120111    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:10:49.129819 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120113    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:10:49.129819 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120116    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:10:49.129819 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120118    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:10:49.129819 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120121    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:10:49.129819 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120123    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:10:49.129819 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120126    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:10:49.129819 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120128    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:10:49.129819 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120130    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:10:49.129819 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120133    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:10:49.129819 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120135    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:10:49.129819 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120137    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:10:49.129819 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120140    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:10:49.129819 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120142    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:10:49.129819 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120145    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:10:49.129819 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120147    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:10:49.129819 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120149    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:10:49.129819 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120159    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:10:49.130249 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120162    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:10:49.130249 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120164    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:10:49.130249 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120167    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:10:49.130249 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120169    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:10:49.130249 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120171    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:10:49.130249 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120174    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:10:49.130249 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120176    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:10:49.130249 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120179    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:10:49.130249 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120181    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:10:49.130249 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120184    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:10:49.130249 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120186    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:10:49.130249 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120189    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:10:49.130249 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120191    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:10:49.130249 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120193    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:10:49.130249 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120196    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:10:49.130249 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120198    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:10:49.130249 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120201    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:10:49.130249 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120203    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:10:49.130249 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120206    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:10:49.130761 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120208    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:10:49.130761 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120210    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:10:49.130761 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120213    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:10:49.130761 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120215    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:10:49.130761 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120217    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:10:49.130761 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120220    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:10:49.130761 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120222    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:10:49.130761 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120225    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:10:49.130761 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120227    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:10:49.130761 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120229    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:10:49.130761 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120232    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:10:49.130761 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120234    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:10:49.130761 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120237    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:10:49.130761 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120248    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:10:49.130761 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120251    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:10:49.130761 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120253    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:10:49.130761 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120256    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:10:49.130761 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120258    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:10:49.130761 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120261    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:10:49.131452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120263    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:10:49.131452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120266    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:10:49.131452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120268    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:10:49.131452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120271    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:10:49.131452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120274    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:10:49.131452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120276    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:10:49.131452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120279    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:10:49.131452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120281    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:10:49.131452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120284    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:10:49.131452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120288    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:10:49.131452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120291    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:10:49.131452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120293    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:10:49.131452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120297    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:10:49.131452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120301    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:10:49.131452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120304    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:10:49.131452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120308    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:10:49.131452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120311    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:10:49.131452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120315    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:10:49.131452 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120317    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:10:49.132142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120321    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:10:49.132142 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:49.120325    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:10:49.132142 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.120380    2581 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 21:10:49.132142 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.122624    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 21:10:49.132142 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.123536    2581 server.go:1014] "Starting client certificate rotation"
Oct 30 21:10:49.132142 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.123638    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:10:49.132142 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.124450    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:10:49.132142 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.125793    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:10:49.133222 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.133204    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:10:49.145862 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.145846    2581 log.go:25] "Validated CRI v1 runtime API"
Oct 30 21:10:49.149631 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.149619    2581 log.go:25] "Validated CRI v1 image API"
Oct 30 21:10:49.150496 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.150474    2581 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 21:10:49.153081 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.153056    2581 fs.go:135] Filesystem UUIDs: map[5914debf-bde7-476b-884f-00143a519a29:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e686108b-5ee5-4752-8e70-59e53ba44c18:/dev/nvme0n1p3]
Oct 30 21:10:49.153129 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.153081    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 21:10:49.158284 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.158185    2581 manager.go:217] Machine: {Timestamp:2026-10-30 21:10:49.156883813 +0000 UTC m=+0.325852487 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3204743 MemoryCapacity:33164328960 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25f323b414f8eaa886af0e2c5fa445 SystemUUID:ec25f323-b414-f8ea-a886-af0e2c5fa445 BootID:28efbb58-9158-4657-a7d7-7dde52667f67 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582164480 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:41:10:d8:d2:81 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:41:10:d8:d2:81 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:83:a5:3d:91:95 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164328960 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 21:10:49.158284 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.158283    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 21:10:49.158396 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.158385    2581 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 21:10:49.161601 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.161575    2581 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 21:10:49.161722 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.161604    2581 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-237.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 21:10:49.162395 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.162386    2581 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 21:10:49.162424 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.162398    2581 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 21:10:49.162424 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.162411    2581 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:10:49.162424 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.162420    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:10:49.163620 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.163609    2581 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 21:10:49.167956 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.167944    2581 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 21:10:49.168074 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.168066    2581 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 21:10:49.168850 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.168838    2581 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 21:10:49.168889 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.168854    2581 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 21:10:49.168889 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.168864    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 21:10:49.168889 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.168873    2581 kubelet.go:405] "Adding apiserver pod source"
Oct 30 21:10:49.168889 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.168880    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 21:10:49.169265 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.169250    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:10:49.171594 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.171577    2581 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 21:10:49.178061 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.178047    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:10:49.179267 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.179255    2581 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 21:10:49.179311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.179284    2581 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 21:10:49.179435 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.179426    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 21:10:49.179463 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.179440    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 21:10:49.179463 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.179446    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 21:10:49.179463 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.179452    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 21:10:49.179463 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.179458    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 21:10:49.179463 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.179464    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 21:10:49.180071 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.180063    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 21:10:49.180105 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.180071    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 21:10:49.180105 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.180078    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 21:10:49.180105 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.180084    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 21:10:49.180105 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.180092    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 21:10:49.180105 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.180102    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 21:10:49.180950 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.180941    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 21:10:49.180950 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.180950    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 21:10:49.184636 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.184625    2581 server.go:1263] "Started kubelet"
Oct 30 21:10:49.184763 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.184727    2581 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 21:10:49.184867 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.184790    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 21:10:49.184867 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.184862    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 21:10:49.186115 ip-10-0-142-237 systemd[1]: Started Kubernetes Kubelet.
Oct 30 21:10:49.187736 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.186233    2581 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 21:10:49.192635 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.192612    2581 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 21:10:49.193338 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:49.193311    2581 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 21:10:49.196839 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.196811    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 21:10:49.198003 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.197989    2581 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 21:10:49.198113 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:49.198091    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-237.us-west-1.compute.internal\" not found"
Oct 30 21:10:49.198792 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.198774    2581 factory.go:55] Registering systemd factory
Oct 30 21:10:49.198883 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.198790    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 21:10:49.198883 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.198795    2581 factory.go:223] Registration of the systemd container factory successfully
Oct 30 21:10:49.198999 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.198978    2581 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 21:10:49.198999 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.199000    2581 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 21:10:49.199141 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.199002    2581 factory.go:153] Registering CRI-O factory
Oct 30 21:10:49.199141 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.199013    2581 factory.go:223] Registration of the crio container factory successfully
Oct 30 21:10:49.199141 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.199075    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 21:10:49.199141 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.199084    2581 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 21:10:49.199141 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.199093    2581 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 21:10:49.199141 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.199094    2581 factory.go:103] Registering Raw factory
Oct 30 21:10:49.199141 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.199108    2581 manager.go:1199] Started watching for new ooms in manager
Oct 30 21:10:49.200064 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.200046    2581 manager.go:319] Starting recovery of all containers
Oct 30 21:10:49.210135 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.210121    2581 manager.go:324] Recovery completed
Oct 30 21:10:49.214115 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.214103    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:10:49.217554 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.217518    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:10:49.217614 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.217559    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:10:49.217614 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.217575    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:10:49.218091 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.218076    2581 cpu_manager.go:226] "Starting" policy="none"
Oct 30 21:10:49.218091 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.218089    2581 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 21:10:49.218229 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.218090    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:10:49.218229 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.218111    2581 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 21:10:49.218845 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.218818    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:10:49.218909 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.218860    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:10:49.218909 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.218876    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:10:49.220256 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.220241    2581 policy_none.go:50] "Start"
Oct 30 21:10:49.220326 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.220258    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 21:10:49.220326 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.220275    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 21:10:49.222201 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.222189    2581 policy_none.go:44] "Start"
Oct 30 21:10:49.255393 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.255362    2581 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 21:10:49.257761 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.257747    2581 manager.go:341] "Starting Device Plugin manager"
Oct 30 21:10:49.258434 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:49.258416    2581 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 21:10:49.258434 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.258435    2581 server.go:87] "Starting device plugin registration server"
Oct 30 21:10:49.258699 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.258688    2581 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 21:10:49.258733 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.258701    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 21:10:49.258837 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.258811    2581 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 21:10:49.258927 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.258904    2581 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 21:10:49.258927 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.258913    2581 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 21:10:49.259400 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:49.259380    2581 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 21:10:49.259464 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:49.259435    2581 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-237.us-west-1.compute.internal\" not found"
Oct 30 21:10:49.323807 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.323777    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 21:10:49.325724 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.324864    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 21:10:49.325724 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.325286    2581 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 21:10:49.325724 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.325323    2581 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 21:10:49.325724 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:49.325363    2581 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 21:10:49.327175 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.326869    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-237.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 21:10:49.327175 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:49.326881    2581 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-237.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 21:10:49.327842 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:49.326869    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-237.us-west-1.compute.internal.18e36aee7ebbfc4e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-237.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-237.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 21:10:49.184599118 +0000 UTC m=+0.353567792,LastTimestamp:2026-10-30 21:10:49.184599118 +0000 UTC m=+0.353567792,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-237.us-west-1.compute.internal,}"
Oct 30 21:10:49.358851 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.358781    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:10:49.359555 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.359533    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:10:49.359621 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.359564    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:10:49.359621 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.359575    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:10:49.359621 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.359601    2581 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.378977 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:49.378954    2581 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 30 21:10:49.378977 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:49.378966    2581 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-237.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 30 21:10:49.379096 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:49.378985    2581 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 30 21:10:49.379152 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:49.379088    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-237.us-west-1.compute.internal.18e36aee80b2afb3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-237.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-237.us-west-1.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-237.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 21:10:49.217544115 +0000 UTC m=+0.386512790,LastTimestamp:2026-10-30 21:10:49.217544115 +0000 UTC m=+0.386512790,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-237.us-west-1.compute.internal,}"
Oct 30 21:10:49.426428 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.426398    2581 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"]
Oct 30 21:10:49.426503 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.426453    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:10:49.427223 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.427201    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:10:49.427311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.427229    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:10:49.427311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.427243    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:10:49.429355 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.429343    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:10:49.429516 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.429499    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.429580 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.429536    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:10:49.430144 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.430128    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:10:49.430230 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.430162    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:10:49.430230 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.430169    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:10:49.430230 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.430178    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:10:49.430230 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.430190    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:10:49.430230 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.430202    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:10:49.432166 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.432154    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.432210 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.432178    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:10:49.433051 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.433036    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:10:49.433112 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.433068    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:10:49.433112 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.433082    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:10:49.453301 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.453277    2581 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 21:10:49.453389 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.453340    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qjgqr"
Oct 30 21:10:49.458205 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:49.458188    2581 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-237.us-west-1.compute.internal\" not found" node="ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.464740 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:49.464723    2581 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-237.us-west-1.compute.internal\" not found" node="ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.480694 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:49.480674    2581 reflector.go:204] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass"
Oct 30 21:10:49.480694 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:49.480645    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-237.us-west-1.compute.internal.18e36aee80b3085f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-237.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-237.us-west-1.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-237.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 21:10:49.217566815 +0000 UTC m=+0.386535494,LastTimestamp:2026-10-30 21:10:49.217566815 +0000 UTC m=+0.386535494,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-237.us-west-1.compute.internal,}"
Oct 30 21:10:49.501370 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.501350    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f52de7228915512f349d24482d38315b-config\") pod \"kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal\" (UID: \"f52de7228915512f349d24482d38315b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.501431 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.501373    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bad8c0bc4ce6ec32ae0c638173a27350-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal\" (UID: \"bad8c0bc4ce6ec32ae0c638173a27350\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.501431 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.501394    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bad8c0bc4ce6ec32ae0c638173a27350-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal\" (UID: \"bad8c0bc4ce6ec32ae0c638173a27350\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.535691 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:49.535672    2581 kubelet_node_status.go:115] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-237.us-west-1.compute.internal\" not found" node="ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.602435 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.602416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f52de7228915512f349d24482d38315b-config\") pod \"kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal\" (UID: \"f52de7228915512f349d24482d38315b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.602515 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.602440    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bad8c0bc4ce6ec32ae0c638173a27350-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal\" (UID: \"bad8c0bc4ce6ec32ae0c638173a27350\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.602554 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.602512    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f52de7228915512f349d24482d38315b-config\") pod \"kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal\" (UID: \"f52de7228915512f349d24482d38315b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.602554 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.602517    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bad8c0bc4ce6ec32ae0c638173a27350-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal\" (UID: \"bad8c0bc4ce6ec32ae0c638173a27350\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.602554 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.602490    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bad8c0bc4ce6ec32ae0c638173a27350-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal\" (UID: \"bad8c0bc4ce6ec32ae0c638173a27350\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.602554 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.602540    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bad8c0bc4ce6ec32ae0c638173a27350-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal\" (UID: \"bad8c0bc4ce6ec32ae0c638173a27350\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.629092 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:49.629055    2581 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-237.us-west-1.compute.internal\" not found" node="ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.736727 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.736707    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:10:49.737485 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.737471    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:10:49.737569 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.737499    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:10:49.737569 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.737512    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:10:49.737569 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.737551    2581 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.761910 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.761893    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.768232 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.768216    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.792463 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:49.792446    2581 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:49.792533 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:49.792464    2581 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-237.us-west-1.compute.internal\": node \"ip-10-0-142-237.us-west-1.compute.internal\" not found"
Oct 30 21:10:49.908075 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:49.908024    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-237.us-west-1.compute.internal\" not found"
Oct 30 21:10:50.008357 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:50.008323    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-237.us-west-1.compute.internal\" not found"
Oct 30 21:10:50.109173 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:50.109139    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-237.us-west-1.compute.internal\" not found"
Oct 30 21:10:50.124296 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:50.124278    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 21:10:50.124478 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:50.124410    2581 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a37cf823f4ff54d85b23692eedd79e51-8af2da30c05d0787.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-142-237.us-west-1.compute.internal.18e36aee80b2afb3\": read tcp 10.0.142.237:35526->3.139.119.67:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-142-237.us-west-1.compute.internal.18e36aee80b2afb3  default   5018 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-237.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-237.us-west-1.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-237.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 21:10:49 +0000 UTC,LastTimestamp:2026-10-30 21:10:49.427215864 +0000 UTC m=+0.596184538,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-237.us-west-1.compute.internal,}"
Oct 30 21:10:50.210181 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:50.210117    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-237.us-west-1.compute.internal\" not found"
Oct 30 21:10:51.831560 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:51.831382    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-237.us-west-1.compute.internal\" not found"
Oct 30 21:10:51.932447 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:51.932414    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-237.us-west-1.compute.internal\" not found"
Oct 30 21:10:51.938588 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:51.938572    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:10:51.939411 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:51.939392    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:10:51.939501 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:51.939424    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:10:51.939501 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:51.939433    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:10:51.978843 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:51.978794    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 21:05:50 +0000 UTC" deadline="2028-06-05 20:31:28.88210596 +0000 UTC"
Oct 30 21:10:51.978843 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:51.978842    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14015h20m36.90326753s"
Oct 30 21:10:52.033524 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:52.033484    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-237.us-west-1.compute.internal\" not found"
Oct 30 21:10:52.121960 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.121932    2581 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:10:52.134150 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:52.134130    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-237.us-west-1.compute.internal\" not found"
Oct 30 21:10:52.234449 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:52.234423    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-237.us-west-1.compute.internal\" not found"
Oct 30 21:10:52.334965 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:52.334900    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-237.us-west-1.compute.internal\" not found"
Oct 30 21:10:52.366227 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:52.366186    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbad8c0bc4ce6ec32ae0c638173a27350.slice/crio-813c6690ba4f95b19636bc400c7adfa0cc1ec08139b4baf443b90b5530e52310 WatchSource:0}: Error finding container 813c6690ba4f95b19636bc400c7adfa0cc1ec08139b4baf443b90b5530e52310: Status 404 returned error can't find the container with id 813c6690ba4f95b19636bc400c7adfa0cc1ec08139b4baf443b90b5530e52310
Oct 30 21:10:52.366478 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:52.366439    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52de7228915512f349d24482d38315b.slice/crio-ad9cdf4d7bf1cd250086bc58198518185e96ad68875e6bfd405291bb078f7127 WatchSource:0}: Error finding container ad9cdf4d7bf1cd250086bc58198518185e96ad68875e6bfd405291bb078f7127: Status 404 returned error can't find the container with id ad9cdf4d7bf1cd250086bc58198518185e96ad68875e6bfd405291bb078f7127
Oct 30 21:10:52.374030 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.374006    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:10:52.435694 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:52.435673    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-237.us-west-1.compute.internal\" not found"
Oct 30 21:10:52.436510 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.436497    2581 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:10:52.455805 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.455788    2581 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:10:52.519632 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.519616    2581 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:52.566994 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.566978    2581 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:10:52.577900 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.577886    2581 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:10:52.578857 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.578845    2581 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:10:52.636348 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.636303    2581 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:10:52.690398 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.690381    2581 apiserver.go:52] "Watching apiserver"
Oct 30 21:10:52.718545 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.718527    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 21:10:52.792123 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.792103    2581 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 21:10:52.792414 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.792397    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-58btz","openshift-multus/multus-cx7lm","openshift-network-diagnostics/network-check-target-m4t5j","kube-system/konnectivity-agent-ttsq4","openshift-ovn-kubernetes/ovnkube-node-8vk2q","openshift-cluster-node-tuning-operator/tuned-tnk8v","openshift-dns/node-resolver-lzdr5","openshift-image-registry/node-ca-5548s","openshift-multus/network-metrics-daemon-58v4c","openshift-network-operator/iptables-alerter-wlqbw","kube-system/global-pull-secret-syncer-6gs88","kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"]
Oct 30 21:10:52.796009 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.795993    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lzdr5"
Oct 30 21:10:52.798153 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.798132    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.800529 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.800515    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:10:52.800619 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:52.800577    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4t5j" podUID="32468c74-2a0c-4a3b-a073-98961fc3ffd6"
Oct 30 21:10:52.803897 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.803882    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ttsq4"
Oct 30 21:10:52.806235 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.806217    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.808526 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.808512    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.810855 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.810841    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:10:52.810925 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:52.810889    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58v4c" podUID="46c8ff3a-870d-4939-94f3-8c73beab6ecb"
Oct 30 21:10:52.813289 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.813274    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.815693 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.815679    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.818123 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.818108    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wlqbw"
Oct 30 21:10:52.820525 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.820507    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:10:52.820598 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:52.820556    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gs88" podUID="de7df116-a968-473a-85b7-cd508eb8edc5"
Oct 30 21:10:52.823001 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.822981    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5548s"
Oct 30 21:10:52.833417 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.833400    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.833505 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.833423    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkx85\" (UniqueName: \"kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85\") pod \"network-check-target-m4t5j\" (UID: \"32468c74-2a0c-4a3b-a073-98961fc3ffd6\") " pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:10:52.833505 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.833439    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-modprobe-d\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.833505 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.833454    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-sysctl-d\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.833505 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.833483    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-sysctl-conf\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.833505 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.833496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-run-openvswitch\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.833682 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.833514    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9095843d-0f41-4363-9bd3-d7516c532136-tuning-conf-dir\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.833682 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.833586    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-socket-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.833682 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.833609    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-tmp\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.833682 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.833644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc5ds\" (UniqueName: \"kubernetes.io/projected/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-kube-api-access-wc5ds\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.833815 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.833678    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-slash\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.833815 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.833711    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/886735ce-b78e-4b99-898d-35d295a1b059-ovnkube-config\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.833815 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.833754    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/886735ce-b78e-4b99-898d-35d295a1b059-ovnkube-script-lib\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.833815 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.833776    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9095843d-0f41-4363-9bd3-d7516c532136-cni-binary-copy\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.833975 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.833838    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-kubernetes\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.833975 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.833897    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-var-lib-cni-multus\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.834038 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.833993    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pps44\" (UniqueName: \"kubernetes.io/projected/d67402d3-89aa-453d-991b-56606214dfa4-kube-api-access-pps44\") pod \"iptables-alerter-wlqbw\" (UID: \"d67402d3-89aa-453d-991b-56606214dfa4\") " pod="openshift-network-operator/iptables-alerter-wlqbw"
Oct 30 21:10:52.834038 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834012    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/886735ce-b78e-4b99-898d-35d295a1b059-ovn-node-metrics-cert\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.834117 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834038    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9095843d-0f41-4363-9bd3-d7516c532136-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.834117 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834052    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-run\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.834117 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834065    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25hjt\" (UniqueName: \"kubernetes.io/projected/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-kube-api-access-25hjt\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.834117 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834098    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9095843d-0f41-4363-9bd3-d7516c532136-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.834282 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834135    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-systemd\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.834282 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834149    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-system-cni-dir\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.834282 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834167    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0f88e16-68d7-49b8-b50a-29786cf11a17-hosts-file\") pod \"node-resolver-lzdr5\" (UID: \"b0f88e16-68d7-49b8-b50a-29786cf11a17\") " pod="openshift-dns/node-resolver-lzdr5"
Oct 30 21:10:52.834282 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834191    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-cni-bin\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.834282 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834215    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:10:52.834282 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834246    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-lib-modules\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.834282 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834279    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-etc-kubernetes\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.834578 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834329    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-kubelet\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.834578 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834371    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-run-systemd\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.834578 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834402    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.834578 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834440    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9095843d-0f41-4363-9bd3-d7516c532136-system-cni-dir\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.834578 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834509    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-sysconfig\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.834578 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-run-ovn\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.834578 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834572    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-device-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.834816 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834611    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs\") pod \"network-metrics-daemon-58v4c\" (UID: \"46c8ff3a-870d-4939-94f3-8c73beab6ecb\") " pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:10:52.834816 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834649    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4jsr\" (UniqueName: \"kubernetes.io/projected/46c8ff3a-870d-4939-94f3-8c73beab6ecb-kube-api-access-n4jsr\") pod \"network-metrics-daemon-58v4c\" (UID: \"46c8ff3a-870d-4939-94f3-8c73beab6ecb\") " pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:10:52.834816 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834690    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-conf-dir\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.834816 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834718    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkt57\" (UniqueName: \"kubernetes.io/projected/b0f88e16-68d7-49b8-b50a-29786cf11a17-kube-api-access-jkt57\") pod \"node-resolver-lzdr5\" (UID: \"b0f88e16-68d7-49b8-b50a-29786cf11a17\") " pod="openshift-dns/node-resolver-lzdr5"
Oct 30 21:10:52.834816 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834745    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-systemd-units\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.834816 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834771    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-registration-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.834816 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834795    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d67402d3-89aa-453d-991b-56606214dfa4-host-slash\") pod \"iptables-alerter-wlqbw\" (UID: \"d67402d3-89aa-453d-991b-56606214dfa4\") " pod="openshift-network-operator/iptables-alerter-wlqbw"
Oct 30 21:10:52.835141 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.834946    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-run-netns\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.835192 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.835162    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-node-log\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.835192 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.835185    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-sys-fs\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.835286 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.835204    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-run-netns\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.835286 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.835221    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-var-lib-openvswitch\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.835286 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.835259    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95b8w\" (UniqueName: \"kubernetes.io/projected/9095843d-0f41-4363-9bd3-d7516c532136-kube-api-access-95b8w\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.835286 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.835281    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/de7df116-a968-473a-85b7-cd508eb8edc5-kubelet-config\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:10:52.835492 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.835475    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-etc-selinux\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.836223 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.835511    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sc76\" (UniqueName: \"kubernetes.io/projected/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-kube-api-access-9sc76\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.836314 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836297    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6626e30d-3f05-406c-8ea5-5329ea58dd07-agent-certs\") pod \"konnectivity-agent-ttsq4\" (UID: \"6626e30d-3f05-406c-8ea5-5329ea58dd07\") " pod="kube-system/konnectivity-agent-ttsq4"
Oct 30 21:10:52.836363 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836335    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-host\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.836407 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836366    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-run-k8s-cni-cncf-io\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.836407 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-etc-openvswitch\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.836521 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836451    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74jsm\" (UniqueName: \"kubernetes.io/projected/886735ce-b78e-4b99-898d-35d295a1b059-kube-api-access-74jsm\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.836521 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836495    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-sys\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.836611 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836521    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-var-lib-kubelet\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.836611 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836544    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-cnibin\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.836611 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836570    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0f88e16-68d7-49b8-b50a-29786cf11a17-tmp-dir\") pod \"node-resolver-lzdr5\" (UID: \"b0f88e16-68d7-49b8-b50a-29786cf11a17\") " pod="openshift-dns/node-resolver-lzdr5"
Oct 30 21:10:52.836611 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836598    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6626e30d-3f05-406c-8ea5-5329ea58dd07-konnectivity-ca\") pod \"konnectivity-agent-ttsq4\" (UID: \"6626e30d-3f05-406c-8ea5-5329ea58dd07\") " pod="kube-system/konnectivity-agent-ttsq4"
Oct 30 21:10:52.836795 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836626    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-socket-dir-parent\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.836795 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-run-multus-certs\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.836795 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836723    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d67402d3-89aa-453d-991b-56606214dfa4-iptables-alerter-script\") pod \"iptables-alerter-wlqbw\" (UID: \"d67402d3-89aa-453d-991b-56606214dfa4\") " pod="openshift-network-operator/iptables-alerter-wlqbw"
Oct 30 21:10:52.836795 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836751    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-log-socket\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.836795 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836774    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-cni-netd\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.837020 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-cni-dir\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.837020 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836831    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-var-lib-cni-bin\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.837020 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836860    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-run-ovn-kubernetes\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.837020 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836887    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-tuned\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.837020 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836908    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-hostroot\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.837020 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836935    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-daemon-config\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.837020 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836963    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9095843d-0f41-4363-9bd3-d7516c532136-cnibin\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.837020 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.836989    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-cni-binary-copy\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.837020 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.837015    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-var-lib-kubelet\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.837453 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.837038    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/886735ce-b78e-4b99-898d-35d295a1b059-env-overrides\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.837453 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.837073    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/de7df116-a968-473a-85b7-cd508eb8edc5-dbus\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:10:52.847817 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.847787    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 21:10:52.847817 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.847791    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 21:10:52.847971 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.847901    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-swkpp\""
Oct 30 21:10:52.849308 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.849282    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 21:10:52.849409 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.849390    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-87wxx\""
Oct 30 21:10:52.849409 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.849398    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 21:10:52.849546 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.849414    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 21:10:52.851310 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.851278    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal" event={"ID":"bad8c0bc4ce6ec32ae0c638173a27350","Type":"ContainerStarted","Data":"813c6690ba4f95b19636bc400c7adfa0cc1ec08139b4baf443b90b5530e52310"}
Oct 30 21:10:52.852334 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.852317    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal" event={"ID":"f52de7228915512f349d24482d38315b","Type":"ContainerStarted","Data":"ad9cdf4d7bf1cd250086bc58198518185e96ad68875e6bfd405291bb078f7127"}
Oct 30 21:10:52.855060 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.855046    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 21:10:52.855331 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.855319    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-x9kft\""
Oct 30 21:10:52.855391 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.855382    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 21:10:52.857731 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.857715    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 21:10:52.857816 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.857797    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t4qh6\""
Oct 30 21:10:52.857875 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.857809    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 21:10:52.857875 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.857824    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 21:10:52.858169 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.858155    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 21:10:52.858169 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.858160    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 21:10:52.858238 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.858223    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 21:10:52.859691 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.859679    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 21:10:52.859842 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.859828    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:10:52.859897 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.859847    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xkwpv\""
Oct 30 21:10:52.864245 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.864229    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 21:10:52.864598 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.864578    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 21:10:52.864731 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.864710    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 21:10:52.864790 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.864743    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wtj2v\""
Oct 30 21:10:52.864790 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.864778    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 21:10:52.892963 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.892925    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cb6bb\""
Oct 30 21:10:52.893172 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.893160    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-rvh9q\""
Oct 30 21:10:52.893224 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.893209    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zwgx7\""
Oct 30 21:10:52.893495 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.893480    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 21:10:52.893567 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.893539    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 21:10:52.896849 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.896836    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 21:10:52.896915 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.896884    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 21:10:52.896954 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.896912    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 21:10:52.897099 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.897086    2581 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 21:10:52.897146 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.897123    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vw8k9"
Oct 30 21:10:52.897205 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.897189    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 21:10:52.897275 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.897259    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 21:10:52.897339 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.897311    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:10:52.920311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.920289    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 21:10:52.938136 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938119    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-etc-selinux\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.938182 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938139    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sc76\" (UniqueName: \"kubernetes.io/projected/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-kube-api-access-9sc76\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.938182 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6626e30d-3f05-406c-8ea5-5329ea58dd07-agent-certs\") pod \"konnectivity-agent-ttsq4\" (UID: \"6626e30d-3f05-406c-8ea5-5329ea58dd07\") " pod="kube-system/konnectivity-agent-ttsq4"
Oct 30 21:10:52.938182 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938170    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-host\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.938272 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938184    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-run-k8s-cni-cncf-io\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.938272 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938217    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-host\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.938272 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938239    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-run-k8s-cni-cncf-io\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.938272 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938266    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-etc-selinux\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.938435 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938417    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-etc-openvswitch\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.938478 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938452    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74jsm\" (UniqueName: \"kubernetes.io/projected/886735ce-b78e-4b99-898d-35d295a1b059-kube-api-access-74jsm\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.938534 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938485    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-etc-openvswitch\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.938534 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938492    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-sys\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.938534 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938511    2581 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 21:10:52.938680 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938536    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-sys\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.938680 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938604    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-var-lib-kubelet\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.938680 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938622    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-cnibin\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.938680 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938661    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-cnibin\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.938680 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938661    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-var-lib-kubelet\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.938890 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938674    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0f88e16-68d7-49b8-b50a-29786cf11a17-tmp-dir\") pod \"node-resolver-lzdr5\" (UID: \"b0f88e16-68d7-49b8-b50a-29786cf11a17\") " pod="openshift-dns/node-resolver-lzdr5"
Oct 30 21:10:52.938890 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6626e30d-3f05-406c-8ea5-5329ea58dd07-konnectivity-ca\") pod \"konnectivity-agent-ttsq4\" (UID: \"6626e30d-3f05-406c-8ea5-5329ea58dd07\") " pod="kube-system/konnectivity-agent-ttsq4"
Oct 30 21:10:52.938890 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938755    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-socket-dir-parent\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.938890 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938778    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-run-multus-certs\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.938890 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d67402d3-89aa-453d-991b-56606214dfa4-iptables-alerter-script\") pod \"iptables-alerter-wlqbw\" (UID: \"d67402d3-89aa-453d-991b-56606214dfa4\") " pod="openshift-network-operator/iptables-alerter-wlqbw"
Oct 30 21:10:52.938890 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-log-socket\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.938890 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938839    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-cni-netd\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.938890 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938844    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-run-multus-certs\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.938890 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938859    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-cni-dir\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.938890 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938884    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-var-lib-cni-bin\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.938890 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938891    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-cni-netd\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.939311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938883    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0f88e16-68d7-49b8-b50a-29786cf11a17-tmp-dir\") pod \"node-resolver-lzdr5\" (UID: \"b0f88e16-68d7-49b8-b50a-29786cf11a17\") " pod="openshift-dns/node-resolver-lzdr5"
Oct 30 21:10:52.939311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938897    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-log-socket\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.939311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938948    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-var-lib-cni-bin\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.939311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938948    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-socket-dir-parent\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.939311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-run-ovn-kubernetes\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.939311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938984    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-tuned\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.939311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.938997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-hostroot\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.939311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939005    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-cni-dir\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.939311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-daemon-config\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.939311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939021    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-run-ovn-kubernetes\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.939311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939043    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9095843d-0f41-4363-9bd3-d7516c532136-cnibin\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.939311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939058    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9095843d-0f41-4363-9bd3-d7516c532136-cnibin\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.939311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939073    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-cni-binary-copy\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.939311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939094    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-var-lib-kubelet\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.939311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939105    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-hostroot\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.939311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939114    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/886735ce-b78e-4b99-898d-35d295a1b059-env-overrides\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.939311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/de7df116-a968-473a-85b7-cd508eb8edc5-dbus\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:10:52.939311 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939196    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.940151 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939211    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-var-lib-kubelet\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.940151 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939221    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkx85\" (UniqueName: \"kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85\") pod \"network-check-target-m4t5j\" (UID: \"32468c74-2a0c-4a3b-a073-98961fc3ffd6\") " pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:10:52.940151 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-modprobe-d\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.940151 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939267    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-sysctl-d\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.940151 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939303    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-sysctl-conf\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.940151 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-run-openvswitch\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.940151 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939356    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9095843d-0f41-4363-9bd3-d7516c532136-tuning-conf-dir\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.940151 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939414    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-sysctl-d\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.940151 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939246    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/de7df116-a968-473a-85b7-cd508eb8edc5-dbus\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:10:52.940151 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939437    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-socket-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.940151 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939481    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-run-openvswitch\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.940151 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939493    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-tmp\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.940151 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939512    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-modprobe-d\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.940151 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939532    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc5ds\" (UniqueName: \"kubernetes.io/projected/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-kube-api-access-wc5ds\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.940151 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939556    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-slash\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.940151 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/886735ce-b78e-4b99-898d-35d295a1b059-ovnkube-config\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.940151 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939329    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.940922 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939603    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/886735ce-b78e-4b99-898d-35d295a1b059-ovnkube-script-lib\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.940922 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9095843d-0f41-4363-9bd3-d7516c532136-cni-binary-copy\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.940922 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939660    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9095843d-0f41-4363-9bd3-d7516c532136-tuning-conf-dir\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.940922 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939749    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-kubernetes\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.940922 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939778    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-var-lib-cni-multus\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.940922 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939784    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6626e30d-3f05-406c-8ea5-5329ea58dd07-konnectivity-ca\") pod \"konnectivity-agent-ttsq4\" (UID: \"6626e30d-3f05-406c-8ea5-5329ea58dd07\") " pod="kube-system/konnectivity-agent-ttsq4"
Oct 30 21:10:52.940922 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939802    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pps44\" (UniqueName: \"kubernetes.io/projected/d67402d3-89aa-453d-991b-56606214dfa4-kube-api-access-pps44\") pod \"iptables-alerter-wlqbw\" (UID: \"d67402d3-89aa-453d-991b-56606214dfa4\") " pod="openshift-network-operator/iptables-alerter-wlqbw"
Oct 30 21:10:52.940922 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939580    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-sysctl-conf\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.940922 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939832    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/886735ce-b78e-4b99-898d-35d295a1b059-ovn-node-metrics-cert\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.940922 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939879    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9095843d-0f41-4363-9bd3-d7516c532136-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.940922 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939906    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-run\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.940922 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939905    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-socket-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.940922 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939937    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/886735ce-b78e-4b99-898d-35d295a1b059-env-overrides\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.940922 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939949    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25hjt\" (UniqueName: \"kubernetes.io/projected/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-kube-api-access-25hjt\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.940922 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.939974    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9095843d-0f41-4363-9bd3-d7516c532136-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.940922 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.940126    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-daemon-config\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.940922 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.940113    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d67402d3-89aa-453d-991b-56606214dfa4-iptables-alerter-script\") pod \"iptables-alerter-wlqbw\" (UID: \"d67402d3-89aa-453d-991b-56606214dfa4\") " pod="openshift-network-operator/iptables-alerter-wlqbw"
Oct 30 21:10:52.941763 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.940218    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-var-lib-cni-multus\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.941763 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.940405    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-run\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.941763 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.940438    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-kubernetes\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.941763 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.940664    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-cni-binary-copy\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.941763 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.940839    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9095843d-0f41-4363-9bd3-d7516c532136-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.941763 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.940855    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-slash\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.941763 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.940899    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-systemd\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.941763 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941053    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-systemd\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.941763 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941083    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9095843d-0f41-4363-9bd3-d7516c532136-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.941763 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941086    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-system-cni-dir\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.941763 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941145    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-system-cni-dir\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.941763 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941144    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0f88e16-68d7-49b8-b50a-29786cf11a17-hosts-file\") pod \"node-resolver-lzdr5\" (UID: \"b0f88e16-68d7-49b8-b50a-29786cf11a17\") " pod="openshift-dns/node-resolver-lzdr5"
Oct 30 21:10:52.941763 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941297    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-cni-bin\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.941763 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941330    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:10:52.941763 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941366    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-cni-bin\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.941763 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941396    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-lib-modules\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.941763 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941428    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-etc-kubernetes\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.941763 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941447    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-kubelet\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.942558 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941484    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/886735ce-b78e-4b99-898d-35d295a1b059-ovnkube-config\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.942558 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941486    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-run-systemd\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.942558 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941523    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0f88e16-68d7-49b8-b50a-29786cf11a17-hosts-file\") pod \"node-resolver-lzdr5\" (UID: \"b0f88e16-68d7-49b8-b50a-29786cf11a17\") " pod="openshift-dns/node-resolver-lzdr5"
Oct 30 21:10:52.942558 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941544    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.942558 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9095843d-0f41-4363-9bd3-d7516c532136-system-cni-dir\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.942558 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-sysconfig\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.942558 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:52.941625    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:10:52.942558 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941627    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-run-ovn\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.942558 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:52.941697    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret podName:de7df116-a968-473a-85b7-cd508eb8edc5 nodeName:}" failed. No retries permitted until 2026-10-30 21:10:53.441666181 +0000 UTC m=+3.090001226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret") pod "global-pull-secret-syncer-6gs88" (UID: "de7df116-a968-473a-85b7-cd508eb8edc5") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:10:52.942558 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941698    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-run-ovn\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.942558 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941732    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-run-systemd\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.942558 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941754    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-etc-kubernetes\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.942558 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941779    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-kubelet\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.942558 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941799    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-lib-modules\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.942558 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941732    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.942558 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941828    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-device-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.942558 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941822    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-sysconfig\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.943125 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941857    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs\") pod \"network-metrics-daemon-58v4c\" (UID: \"46c8ff3a-870d-4939-94f3-8c73beab6ecb\") " pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:10:52.943125 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941884    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4jsr\" (UniqueName: \"kubernetes.io/projected/46c8ff3a-870d-4939-94f3-8c73beab6ecb-kube-api-access-n4jsr\") pod \"network-metrics-daemon-58v4c\" (UID: \"46c8ff3a-870d-4939-94f3-8c73beab6ecb\") " pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:10:52.943125 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941908    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-conf-dir\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.943125 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941940    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkt57\" (UniqueName: \"kubernetes.io/projected/b0f88e16-68d7-49b8-b50a-29786cf11a17-kube-api-access-jkt57\") pod \"node-resolver-lzdr5\" (UID: \"b0f88e16-68d7-49b8-b50a-29786cf11a17\") " pod="openshift-dns/node-resolver-lzdr5"
Oct 30 21:10:52.943125 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941953    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9095843d-0f41-4363-9bd3-d7516c532136-cni-binary-copy\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.943125 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.941986    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-systemd-units\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.943125 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942001    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9095843d-0f41-4363-9bd3-d7516c532136-system-cni-dir\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.943125 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942014    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-conf-dir\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.943125 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:52.942029    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:10:52.943125 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:52.942181    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs podName:46c8ff3a-870d-4939-94f3-8c73beab6ecb nodeName:}" failed. No retries permitted until 2026-10-30 21:10:53.442164667 +0000 UTC m=+3.090499709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs") pod "network-metrics-daemon-58v4c" (UID: "46c8ff3a-870d-4939-94f3-8c73beab6ecb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:10:52.943125 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942062    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/886735ce-b78e-4b99-898d-35d295a1b059-ovnkube-script-lib\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.943125 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942088    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-systemd-units\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.943125 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lkhv\" (UniqueName: \"kubernetes.io/projected/47c8f18e-4ca1-413e-b665-d4b4a51dcab4-kube-api-access-5lkhv\") pod \"node-ca-5548s\" (UID: \"47c8f18e-4ca1-413e-b665-d4b4a51dcab4\") " pod="openshift-image-registry/node-ca-5548s"
Oct 30 21:10:52.943125 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942236    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-registration-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.943125 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d67402d3-89aa-453d-991b-56606214dfa4-host-slash\") pod \"iptables-alerter-wlqbw\" (UID: \"d67402d3-89aa-453d-991b-56606214dfa4\") " pod="openshift-network-operator/iptables-alerter-wlqbw"
Oct 30 21:10:52.943125 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942067    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-device-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.943125 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942283    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-run-netns\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.943618 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942308    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-node-log\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.943618 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942327    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d67402d3-89aa-453d-991b-56606214dfa4-host-slash\") pod \"iptables-alerter-wlqbw\" (UID: \"d67402d3-89aa-453d-991b-56606214dfa4\") " pod="openshift-network-operator/iptables-alerter-wlqbw"
Oct 30 21:10:52.943618 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942334    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-registration-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.943618 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942364    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-sys-fs\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.943618 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-sys-fs\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:52.943618 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942375    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-run-netns\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.943618 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942398    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-node-log\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.943618 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942405    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-run-netns\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.943618 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942431    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-var-lib-openvswitch\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.943618 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95b8w\" (UniqueName: \"kubernetes.io/projected/9095843d-0f41-4363-9bd3-d7516c532136-kube-api-access-95b8w\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:52.943618 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942491    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-run-netns\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:52.943618 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942493    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-var-lib-openvswitch\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.943618 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942503    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/de7df116-a968-473a-85b7-cd508eb8edc5-kubelet-config\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:10:52.943618 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47c8f18e-4ca1-413e-b665-d4b4a51dcab4-host\") pod \"node-ca-5548s\" (UID: \"47c8f18e-4ca1-413e-b665-d4b4a51dcab4\") " pod="openshift-image-registry/node-ca-5548s"
Oct 30 21:10:52.943618 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942682    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/de7df116-a968-473a-85b7-cd508eb8edc5-kubelet-config\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:10:52.943618 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942705    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47c8f18e-4ca1-413e-b665-d4b4a51dcab4-serviceca\") pod \"node-ca-5548s\" (UID: \"47c8f18e-4ca1-413e-b665-d4b4a51dcab4\") " pod="openshift-image-registry/node-ca-5548s"
Oct 30 21:10:52.943618 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942820    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-tmp\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.944075 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.942857    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/886735ce-b78e-4b99-898d-35d295a1b059-ovn-node-metrics-cert\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:52.944075 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.943062    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6626e30d-3f05-406c-8ea5-5329ea58dd07-agent-certs\") pod \"konnectivity-agent-ttsq4\" (UID: \"6626e30d-3f05-406c-8ea5-5329ea58dd07\") " pod="kube-system/konnectivity-agent-ttsq4"
Oct 30 21:10:52.944268 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.944249    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-tuned\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.996677 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:52.996649    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:10:52.996677 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:52.996667    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:10:52.996677 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:52.996675    2581 projected.go:196] Error preparing data for projected volume kube-api-access-mkx85 for pod openshift-network-diagnostics/network-check-target-m4t5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:10:52.996883 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:52.996722    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85 podName:32468c74-2a0c-4a3b-a073-98961fc3ffd6 nodeName:}" failed. No retries permitted until 2026-10-30 21:10:53.49671208 +0000 UTC m=+3.145047141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mkx85" (UniqueName: "kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85") pod "network-check-target-m4t5j" (UID: "32468c74-2a0c-4a3b-a073-98961fc3ffd6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:10:52.999392 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.999221    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4jsr\" (UniqueName: \"kubernetes.io/projected/46c8ff3a-870d-4939-94f3-8c73beab6ecb-kube-api-access-n4jsr\") pod \"network-metrics-daemon-58v4c\" (UID: \"46c8ff3a-870d-4939-94f3-8c73beab6ecb\") " pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:10:52.999392 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.999345    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc5ds\" (UniqueName: \"kubernetes.io/projected/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-kube-api-access-wc5ds\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:52.999573 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.999553    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pps44\" (UniqueName: \"kubernetes.io/projected/d67402d3-89aa-453d-991b-56606214dfa4-kube-api-access-pps44\") pod \"iptables-alerter-wlqbw\" (UID: \"d67402d3-89aa-453d-991b-56606214dfa4\") " pod="openshift-network-operator/iptables-alerter-wlqbw"
Oct 30 21:10:52.999640 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.999624    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkt57\" (UniqueName: \"kubernetes.io/projected/b0f88e16-68d7-49b8-b50a-29786cf11a17-kube-api-access-jkt57\") pod \"node-resolver-lzdr5\" (UID: \"b0f88e16-68d7-49b8-b50a-29786cf11a17\") " pod="openshift-dns/node-resolver-lzdr5"
Oct 30 21:10:52.999979 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:52.999963    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sc76\" (UniqueName: \"kubernetes.io/projected/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-kube-api-access-9sc76\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:53.000023 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.000000    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74jsm\" (UniqueName: \"kubernetes.io/projected/886735ce-b78e-4b99-898d-35d295a1b059-kube-api-access-74jsm\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:53.000076 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.000061    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25hjt\" (UniqueName: \"kubernetes.io/projected/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-kube-api-access-25hjt\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:53.000309 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.000294    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95b8w\" (UniqueName: \"kubernetes.io/projected/9095843d-0f41-4363-9bd3-d7516c532136-kube-api-access-95b8w\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:53.043093 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.043072    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lkhv\" (UniqueName: \"kubernetes.io/projected/47c8f18e-4ca1-413e-b665-d4b4a51dcab4-kube-api-access-5lkhv\") pod \"node-ca-5548s\" (UID: \"47c8f18e-4ca1-413e-b665-d4b4a51dcab4\") " pod="openshift-image-registry/node-ca-5548s"
Oct 30 21:10:53.043180 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.043105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47c8f18e-4ca1-413e-b665-d4b4a51dcab4-host\") pod \"node-ca-5548s\" (UID: \"47c8f18e-4ca1-413e-b665-d4b4a51dcab4\") " pod="openshift-image-registry/node-ca-5548s"
Oct 30 21:10:53.043180 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.043142    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47c8f18e-4ca1-413e-b665-d4b4a51dcab4-serviceca\") pod \"node-ca-5548s\" (UID: \"47c8f18e-4ca1-413e-b665-d4b4a51dcab4\") " pod="openshift-image-registry/node-ca-5548s"
Oct 30 21:10:53.043272 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.043174    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47c8f18e-4ca1-413e-b665-d4b4a51dcab4-host\") pod \"node-ca-5548s\" (UID: \"47c8f18e-4ca1-413e-b665-d4b4a51dcab4\") " pod="openshift-image-registry/node-ca-5548s"
Oct 30 21:10:53.044156 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.044141    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47c8f18e-4ca1-413e-b665-d4b4a51dcab4-serviceca\") pod \"node-ca-5548s\" (UID: \"47c8f18e-4ca1-413e-b665-d4b4a51dcab4\") " pod="openshift-image-registry/node-ca-5548s"
Oct 30 21:10:53.101881 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.101861    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lkhv\" (UniqueName: \"kubernetes.io/projected/47c8f18e-4ca1-413e-b665-d4b4a51dcab4-kube-api-access-5lkhv\") pod \"node-ca-5548s\" (UID: \"47c8f18e-4ca1-413e-b665-d4b4a51dcab4\") " pod="openshift-image-registry/node-ca-5548s"
Oct 30 21:10:53.107805 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.107790    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lzdr5"
Oct 30 21:10:53.116536 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.116514    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:10:53.116768 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:53.116750    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0f88e16_68d7_49b8_b50a_29786cf11a17.slice/crio-be77c0837462e287f57629efb8f5eeb87248c21a3314b443364d0b88f78436d9 WatchSource:0}: Error finding container be77c0837462e287f57629efb8f5eeb87248c21a3314b443364d0b88f78436d9: Status 404 returned error can't find the container with id be77c0837462e287f57629efb8f5eeb87248c21a3314b443364d0b88f78436d9
Oct 30 21:10:53.120145 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.120121    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ttsq4"
Oct 30 21:10:53.124632 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:53.124614    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6c8d5f3_1059_4847_ad18_af3750c7c7e8.slice/crio-30816de148a53d3654acad16df62ba7a410e916e8c30526de5fe5e0348f55302 WatchSource:0}: Error finding container 30816de148a53d3654acad16df62ba7a410e916e8c30526de5fe5e0348f55302: Status 404 returned error can't find the container with id 30816de148a53d3654acad16df62ba7a410e916e8c30526de5fe5e0348f55302
Oct 30 21:10:53.128844 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:53.128827    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6626e30d_3f05_406c_8ea5_5329ea58dd07.slice/crio-9f5c138e0c1d7514d203a5bea8f272e9375f1a560bf5e9cc7adf77f5e1813437 WatchSource:0}: Error finding container 9f5c138e0c1d7514d203a5bea8f272e9375f1a560bf5e9cc7adf77f5e1813437: Status 404 returned error can't find the container with id 9f5c138e0c1d7514d203a5bea8f272e9375f1a560bf5e9cc7adf77f5e1813437
Oct 30 21:10:53.134996 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.134978    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:10:53.143119 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:53.143076    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d1ae5a7_dbca_4614_bd43_3ed9e0558360.slice/crio-ee11d7ac907b2786ca9a95ba06c67ab65c34b50fbe1e09c34e665bf0071a66ee WatchSource:0}: Error finding container ee11d7ac907b2786ca9a95ba06c67ab65c34b50fbe1e09c34e665bf0071a66ee: Status 404 returned error can't find the container with id ee11d7ac907b2786ca9a95ba06c67ab65c34b50fbe1e09c34e665bf0071a66ee
Oct 30 21:10:53.148130 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.148114    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cx7lm"
Oct 30 21:10:53.150273 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.150258    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:10:53.154808 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.154792    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wlqbw"
Oct 30 21:10:53.155881 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.155867    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5548s"
Oct 30 21:10:53.156601 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:53.156560    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0426d3d3_3a43_4023_9b2f_2dbcb52e0dcf.slice/crio-f45e917f6fa87b655405487f479cf3a5007a2acac742f72a2df6abac3b8890cd WatchSource:0}: Error finding container f45e917f6fa87b655405487f479cf3a5007a2acac742f72a2df6abac3b8890cd: Status 404 returned error can't find the container with id f45e917f6fa87b655405487f479cf3a5007a2acac742f72a2df6abac3b8890cd
Oct 30 21:10:53.158682 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:53.158665    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod886735ce_b78e_4b99_898d_35d295a1b059.slice/crio-ad7bc466ca5f0a7737d7b01aaa2de119bb2319b8ebaec429632228e57b395281 WatchSource:0}: Error finding container ad7bc466ca5f0a7737d7b01aaa2de119bb2319b8ebaec429632228e57b395281: Status 404 returned error can't find the container with id ad7bc466ca5f0a7737d7b01aaa2de119bb2319b8ebaec429632228e57b395281
Oct 30 21:10:53.162916 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.162901    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:10:53.164628 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:53.164612    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67402d3_89aa_453d_991b_56606214dfa4.slice/crio-63613ac19e2dc81451369e07858ab1af26cb8523a4a488e625e967c293753adf WatchSource:0}: Error finding container 63613ac19e2dc81451369e07858ab1af26cb8523a4a488e625e967c293753adf: Status 404 returned error can't find the container with id 63613ac19e2dc81451369e07858ab1af26cb8523a4a488e625e967c293753adf
Oct 30 21:10:53.166579 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:53.166529    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47c8f18e_4ca1_413e_b665_d4b4a51dcab4.slice/crio-1fe5a71f85fc8db891d79c8bc8bb5e141a36109f9098cf07d312ace4f1914ae1 WatchSource:0}: Error finding container 1fe5a71f85fc8db891d79c8bc8bb5e141a36109f9098cf07d312ace4f1914ae1: Status 404 returned error can't find the container with id 1fe5a71f85fc8db891d79c8bc8bb5e141a36109f9098cf07d312ace4f1914ae1
Oct 30 21:10:53.173218 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:10:53.173188    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9095843d_0f41_4363_9bd3_d7516c532136.slice/crio-4fbf222cc1cd35e2e1f4abd0d6ef7e59a9b24249a49d6940e24de9fa05197160 WatchSource:0}: Error finding container 4fbf222cc1cd35e2e1f4abd0d6ef7e59a9b24249a49d6940e24de9fa05197160: Status 404 returned error can't find the container with id 4fbf222cc1cd35e2e1f4abd0d6ef7e59a9b24249a49d6940e24de9fa05197160
Oct 30 21:10:53.445790 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.445706    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:10:53.445790 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.445759    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs\") pod \"network-metrics-daemon-58v4c\" (UID: \"46c8ff3a-870d-4939-94f3-8c73beab6ecb\") " pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:10:53.445986 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:53.445887    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:10:53.445986 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:53.445948    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs podName:46c8ff3a-870d-4939-94f3-8c73beab6ecb nodeName:}" failed. No retries permitted until 2026-10-30 21:10:54.445929351 +0000 UTC m=+4.094264392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs") pod "network-metrics-daemon-58v4c" (UID: "46c8ff3a-870d-4939-94f3-8c73beab6ecb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:10:53.446053 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:53.446009    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:10:53.446053 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:53.446038    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret podName:de7df116-a968-473a-85b7-cd508eb8edc5 nodeName:}" failed. No retries permitted until 2026-10-30 21:10:54.446028839 +0000 UTC m=+4.094363881 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret") pod "global-pull-secret-syncer-6gs88" (UID: "de7df116-a968-473a-85b7-cd508eb8edc5") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:10:53.546865 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.546818    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkx85\" (UniqueName: \"kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85\") pod \"network-check-target-m4t5j\" (UID: \"32468c74-2a0c-4a3b-a073-98961fc3ffd6\") " pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:10:53.547044 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:53.546975    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:10:53.547044 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:53.546993    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:10:53.547044 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:53.547002    2581 projected.go:196] Error preparing data for projected volume kube-api-access-mkx85 for pod openshift-network-diagnostics/network-check-target-m4t5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:10:53.547169 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:53.547048    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85 podName:32468c74-2a0c-4a3b-a073-98961fc3ffd6 nodeName:}" failed. No retries permitted until 2026-10-30 21:10:54.547030108 +0000 UTC m=+4.195365150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mkx85" (UniqueName: "kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85") pod "network-check-target-m4t5j" (UID: "32468c74-2a0c-4a3b-a073-98961fc3ffd6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:10:53.846396 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.846326    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:10:53.846942 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:53.846475    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4t5j" podUID="32468c74-2a0c-4a3b-a073-98961fc3ffd6"
Oct 30 21:10:53.855030 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.855003    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5" event={"ID":"f6c8d5f3-1059-4847-ad18-af3750c7c7e8","Type":"ContainerStarted","Data":"30816de148a53d3654acad16df62ba7a410e916e8c30526de5fe5e0348f55302"}
Oct 30 21:10:53.856265 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.856239    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lzdr5" event={"ID":"b0f88e16-68d7-49b8-b50a-29786cf11a17","Type":"ContainerStarted","Data":"be77c0837462e287f57629efb8f5eeb87248c21a3314b443364d0b88f78436d9"}
Oct 30 21:10:53.857654 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.857614    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58btz" event={"ID":"9095843d-0f41-4363-9bd3-d7516c532136","Type":"ContainerStarted","Data":"4fbf222cc1cd35e2e1f4abd0d6ef7e59a9b24249a49d6940e24de9fa05197160"}
Oct 30 21:10:53.858705 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.858688    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5548s" event={"ID":"47c8f18e-4ca1-413e-b665-d4b4a51dcab4","Type":"ContainerStarted","Data":"1fe5a71f85fc8db891d79c8bc8bb5e141a36109f9098cf07d312ace4f1914ae1"}
Oct 30 21:10:53.859899 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.859880    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q" event={"ID":"886735ce-b78e-4b99-898d-35d295a1b059","Type":"ContainerStarted","Data":"ad7bc466ca5f0a7737d7b01aaa2de119bb2319b8ebaec429632228e57b395281"}
Oct 30 21:10:53.861230 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.861206    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ttsq4" event={"ID":"6626e30d-3f05-406c-8ea5-5329ea58dd07","Type":"ContainerStarted","Data":"9f5c138e0c1d7514d203a5bea8f272e9375f1a560bf5e9cc7adf77f5e1813437"}
Oct 30 21:10:53.862425 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.862379    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wlqbw" event={"ID":"d67402d3-89aa-453d-991b-56606214dfa4","Type":"ContainerStarted","Data":"63613ac19e2dc81451369e07858ab1af26cb8523a4a488e625e967c293753adf"}
Oct 30 21:10:53.863474 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.863443    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cx7lm" event={"ID":"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf","Type":"ContainerStarted","Data":"f45e917f6fa87b655405487f479cf3a5007a2acac742f72a2df6abac3b8890cd"}
Oct 30 21:10:53.865068 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.865045    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tnk8v" event={"ID":"1d1ae5a7-dbca-4614-bd43-3ed9e0558360","Type":"ContainerStarted","Data":"ee11d7ac907b2786ca9a95ba06c67ab65c34b50fbe1e09c34e665bf0071a66ee"}
Oct 30 21:10:53.899801 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.899748    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:05:52 +0000 UTC" deadline="2028-03-30 05:28:43.968936363 +0000 UTC"
Oct 30 21:10:53.899902 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:53.899812    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12392h17m50.069132921s"
Oct 30 21:10:54.456057 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:54.455157    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:10:54.456057 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:54.455220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs\") pod \"network-metrics-daemon-58v4c\" (UID: \"46c8ff3a-870d-4939-94f3-8c73beab6ecb\") " pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:10:54.456057 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:54.455389    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:10:54.456057 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:54.455451    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs podName:46c8ff3a-870d-4939-94f3-8c73beab6ecb nodeName:}" failed. No retries permitted until 2026-10-30 21:10:56.45543306 +0000 UTC m=+6.103768103 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs") pod "network-metrics-daemon-58v4c" (UID: "46c8ff3a-870d-4939-94f3-8c73beab6ecb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:10:54.456057 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:54.455530    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:10:54.456057 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:54.455562    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret podName:de7df116-a968-473a-85b7-cd508eb8edc5 nodeName:}" failed. No retries permitted until 2026-10-30 21:10:56.455551697 +0000 UTC m=+6.103886726 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret") pod "global-pull-secret-syncer-6gs88" (UID: "de7df116-a968-473a-85b7-cd508eb8edc5") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:10:54.558520 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:54.556132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkx85\" (UniqueName: \"kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85\") pod \"network-check-target-m4t5j\" (UID: \"32468c74-2a0c-4a3b-a073-98961fc3ffd6\") " pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:10:54.558762 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:54.558739    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:10:54.558841 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:54.558768    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:10:54.558841 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:54.558791    2581 projected.go:196] Error preparing data for projected volume kube-api-access-mkx85 for pod openshift-network-diagnostics/network-check-target-m4t5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:10:54.559052 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:54.558870    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85 podName:32468c74-2a0c-4a3b-a073-98961fc3ffd6 nodeName:}" failed. No retries permitted until 2026-10-30 21:10:56.558843455 +0000 UTC m=+6.207178489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mkx85" (UniqueName: "kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85") pod "network-check-target-m4t5j" (UID: "32468c74-2a0c-4a3b-a073-98961fc3ffd6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:10:54.851883 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:54.848675    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:10:54.851883 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:54.848789    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gs88" podUID="de7df116-a968-473a-85b7-cd508eb8edc5"
Oct 30 21:10:54.851883 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:54.848872    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:10:54.851883 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:54.848955    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58v4c" podUID="46c8ff3a-870d-4939-94f3-8c73beab6ecb"
Oct 30 21:10:54.900534 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:54.900449    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:05:52 +0000 UTC" deadline="2028-06-03 05:27:29.051735948 +0000 UTC"
Oct 30 21:10:54.900534 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:54.900532    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13952h16m34.151208015s"
Oct 30 21:10:55.847517 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:55.847098    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:10:55.847517 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:55.847512    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4t5j" podUID="32468c74-2a0c-4a3b-a073-98961fc3ffd6"
Oct 30 21:10:55.891242 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:55.891154    2581 generic.go:356] "Generic (PLEG): container finished" podID="bad8c0bc4ce6ec32ae0c638173a27350" containerID="ed704fc6f5192224465bcc9fb13e10085a4917efa184135ce7e692b67af20fc2" exitCode=0
Oct 30 21:10:55.891772 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:55.891255    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal" event={"ID":"bad8c0bc4ce6ec32ae0c638173a27350","Type":"ContainerDied","Data":"ed704fc6f5192224465bcc9fb13e10085a4917efa184135ce7e692b67af20fc2"}
Oct 30 21:10:55.898657 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:55.898628    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal" event={"ID":"f52de7228915512f349d24482d38315b","Type":"ContainerStarted","Data":"ab822b46944724815609b760bdd872982d5948384a3cdfa84aa5524bce974501"}
Oct 30 21:10:56.117099 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:56.117051    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal" podStartSLOduration=4.117036844 podStartE2EDuration="4.117036844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:10:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:10:56.1167072 +0000 UTC m=+5.765042249" watchObservedRunningTime="2026-10-30 21:10:56.117036844 +0000 UTC m=+5.765371894"
Oct 30 21:10:56.474329 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:56.474292    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:10:56.474992 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:56.474349    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs\") pod \"network-metrics-daemon-58v4c\" (UID: \"46c8ff3a-870d-4939-94f3-8c73beab6ecb\") " pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:10:56.474992 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:56.474551    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:10:56.474992 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:56.474615    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs podName:46c8ff3a-870d-4939-94f3-8c73beab6ecb nodeName:}" failed. No retries permitted until 2026-10-30 21:11:00.47459756 +0000 UTC m=+10.122932602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs") pod "network-metrics-daemon-58v4c" (UID: "46c8ff3a-870d-4939-94f3-8c73beab6ecb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:10:56.474992 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:56.474702    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:10:56.474992 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:56.474735    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret podName:de7df116-a968-473a-85b7-cd508eb8edc5 nodeName:}" failed. No retries permitted until 2026-10-30 21:11:00.474724356 +0000 UTC m=+10.123059398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret") pod "global-pull-secret-syncer-6gs88" (UID: "de7df116-a968-473a-85b7-cd508eb8edc5") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:10:56.575440 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:56.575402    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkx85\" (UniqueName: \"kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85\") pod \"network-check-target-m4t5j\" (UID: \"32468c74-2a0c-4a3b-a073-98961fc3ffd6\") " pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:10:56.575697 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:56.575599    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:10:56.575697 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:56.575623    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:10:56.575697 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:56.575636    2581 projected.go:196] Error preparing data for projected volume kube-api-access-mkx85 for pod openshift-network-diagnostics/network-check-target-m4t5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:10:56.575697 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:56.575695    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85 podName:32468c74-2a0c-4a3b-a073-98961fc3ffd6 nodeName:}" failed. No retries permitted until 2026-10-30 21:11:00.57567809 +0000 UTC m=+10.224013122 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mkx85" (UniqueName: "kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85") pod "network-check-target-m4t5j" (UID: "32468c74-2a0c-4a3b-a073-98961fc3ffd6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:10:56.848327 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:56.848259    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:10:56.848494 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:56.848398    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gs88" podUID="de7df116-a968-473a-85b7-cd508eb8edc5"
Oct 30 21:10:56.848494 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:56.848453    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:10:56.848648 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:56.848553    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58v4c" podUID="46c8ff3a-870d-4939-94f3-8c73beab6ecb"
Oct 30 21:10:56.907620 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:56.907585    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal" event={"ID":"bad8c0bc4ce6ec32ae0c638173a27350","Type":"ContainerStarted","Data":"8cb2b3960abd134672edb22f089d347eb627f6e3fcfe5ff86b3165ef7aa79af2"}
Oct 30 21:10:56.910556 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:56.910529    2581 generic.go:356] "Generic (PLEG): container finished" podID="9095843d-0f41-4363-9bd3-d7516c532136" containerID="ccbe3bb8f36e954d980d89c202f4619b141486ea23897cd449bcd96dfa4da44e" exitCode=0
Oct 30 21:10:56.911479 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:56.911436    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58btz" event={"ID":"9095843d-0f41-4363-9bd3-d7516c532136","Type":"ContainerDied","Data":"ccbe3bb8f36e954d980d89c202f4619b141486ea23897cd449bcd96dfa4da44e"}
Oct 30 21:10:57.020778 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:57.020722    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal" podStartSLOduration=5.02070316 podStartE2EDuration="5.02070316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:10:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:10:57.020442345 +0000 UTC m=+6.668777393" watchObservedRunningTime="2026-10-30 21:10:57.02070316 +0000 UTC m=+6.669038208"
Oct 30 21:10:57.847165 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:57.847130    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:10:57.847331 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:57.847284    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4t5j" podUID="32468c74-2a0c-4a3b-a073-98961fc3ffd6"
Oct 30 21:10:57.918383 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:57.918345    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ttsq4" event={"ID":"6626e30d-3f05-406c-8ea5-5329ea58dd07","Type":"ContainerStarted","Data":"60f477eb046c154f9e7a4aabaa59effdec6c345087698001007374b177d3658d"}
Oct 30 21:10:58.849627 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:58.849590    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:10:58.849627 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:58.849606    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:10:58.849811 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:58.849738    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58v4c" podUID="46c8ff3a-870d-4939-94f3-8c73beab6ecb"
Oct 30 21:10:58.849861 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:58.849834    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gs88" podUID="de7df116-a968-473a-85b7-cd508eb8edc5"
Oct 30 21:10:58.932606 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:58.932570    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5548s" event={"ID":"47c8f18e-4ca1-413e-b665-d4b4a51dcab4","Type":"ContainerStarted","Data":"0475598c70dfd8e9e0f95553190160317b4cc9ab17338294afd5067d792343ed"}
Oct 30 21:10:59.045612 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:59.044745    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ttsq4" podStartSLOduration=3.823994156 podStartE2EDuration="8.044727225s" totalImagesPullingTime="4.220733069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:10:58.034309066 +0000 UTC m=+7.682644115" watchObservedRunningTime="2026-10-30 21:10:59.044727225 +0000 UTC m=+8.693062275"
Oct 30 21:10:59.462610 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:59.462428    2581 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ttsq4"
Oct 30 21:10:59.462939 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:59.462914    2581 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ttsq4"
Oct 30 21:10:59.577213 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:59.577145    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5548s" podStartSLOduration=3.43873752 podStartE2EDuration="8.57708841s" totalImagesPullingTime="5.13835089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:10:59.045638647 +0000 UTC m=+8.693973698" watchObservedRunningTime="2026-10-30 21:10:59.57708841 +0000 UTC m=+9.225423461"
Oct 30 21:10:59.846200 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:59.846116    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:10:59.846353 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:10:59.846242    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4t5j" podUID="32468c74-2a0c-4a3b-a073-98961fc3ffd6"
Oct 30 21:10:59.936556 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:10:59.936516    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5" event={"ID":"f6c8d5f3-1059-4847-ad18-af3750c7c7e8","Type":"ContainerStarted","Data":"dc8172387091507f54618668da0aaa9d48f216ad874ddfb2f2af51bd43d2a1fc"}
Oct 30 21:11:00.508750 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:00.508449    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:00.508750 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:00.508527    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs\") pod \"network-metrics-daemon-58v4c\" (UID: \"46c8ff3a-870d-4939-94f3-8c73beab6ecb\") " pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:00.508750 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:00.508656    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:11:00.508750 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:00.508719    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs podName:46c8ff3a-870d-4939-94f3-8c73beab6ecb nodeName:}" failed. No retries permitted until 2026-10-30 21:11:08.50870061 +0000 UTC m=+18.157035650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs") pod "network-metrics-daemon-58v4c" (UID: "46c8ff3a-870d-4939-94f3-8c73beab6ecb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:11:00.508750 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:00.508657    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:11:00.509138 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:00.508783    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret podName:de7df116-a968-473a-85b7-cd508eb8edc5 nodeName:}" failed. No retries permitted until 2026-10-30 21:11:08.508770451 +0000 UTC m=+18.157105495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret") pod "global-pull-secret-syncer-6gs88" (UID: "de7df116-a968-473a-85b7-cd508eb8edc5") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:11:00.609351 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:00.609311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkx85\" (UniqueName: \"kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85\") pod \"network-check-target-m4t5j\" (UID: \"32468c74-2a0c-4a3b-a073-98961fc3ffd6\") " pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:00.609523 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:00.609489    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:11:00.609523 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:00.609508    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:11:00.609523 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:00.609521    2581 projected.go:196] Error preparing data for projected volume kube-api-access-mkx85 for pod openshift-network-diagnostics/network-check-target-m4t5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:11:00.609689 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:00.609589    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85 podName:32468c74-2a0c-4a3b-a073-98961fc3ffd6 nodeName:}" failed. No retries permitted until 2026-10-30 21:11:08.60956041 +0000 UTC m=+18.257895451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mkx85" (UniqueName: "kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85") pod "network-check-target-m4t5j" (UID: "32468c74-2a0c-4a3b-a073-98961fc3ffd6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:11:00.862213 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:00.861601    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:00.862213 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:00.861793    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58v4c" podUID="46c8ff3a-870d-4939-94f3-8c73beab6ecb"
Oct 30 21:11:00.864748 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:00.864559    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:00.864748 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:00.864707    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gs88" podUID="de7df116-a968-473a-85b7-cd508eb8edc5"
Oct 30 21:11:00.938855 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:00.938826    2581 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:11:01.069416 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:01.069292    2581 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 21:11:01.789717 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:01.789609    2581 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T21:11:01.069307632Z","UUID":"620cbb15-c328-4cc5-941c-a2b5e2986d33","Handler":null,"Name":"","Endpoint":""}
Oct 30 21:11:01.792052 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:01.792029    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 21:11:01.792178 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:01.792060    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 21:11:01.847227 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:01.847068    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:01.847227 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:01.847188    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4t5j" podUID="32468c74-2a0c-4a3b-a073-98961fc3ffd6"
Oct 30 21:11:01.943484 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:01.943431    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cx7lm" event={"ID":"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf","Type":"ContainerStarted","Data":"cbec2d89f8c49a4d8904d39bf12b3c3c2f4a9ef7da6614381a404ab4805dd047"}
Oct 30 21:11:01.946844 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:01.946758    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5" event={"ID":"f6c8d5f3-1059-4847-ad18-af3750c7c7e8","Type":"ContainerStarted","Data":"517d831763bb6ec2f97688329862babc156e76a36f295d1e2a1840bd03e44d27"}
Oct 30 21:11:01.948866 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:01.948846    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lzdr5" event={"ID":"b0f88e16-68d7-49b8-b50a-29786cf11a17","Type":"ContainerStarted","Data":"e204499b3d59c294c05a48c771b2f1af1ab64c1ebc4bef321f8f80a7fdd89e14"}
Oct 30 21:11:01.951238 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:01.951215    2581 generic.go:356] "Generic (PLEG): container finished" podID="9095843d-0f41-4363-9bd3-d7516c532136" containerID="224451de2094648c564cbe6c55a885aaec9fe5d5eab3c9d0cdad731809fb97c4" exitCode=0
Oct 30 21:11:01.951343 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:01.951255    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58btz" event={"ID":"9095843d-0f41-4363-9bd3-d7516c532136","Type":"ContainerDied","Data":"224451de2094648c564cbe6c55a885aaec9fe5d5eab3c9d0cdad731809fb97c4"}
Oct 30 21:11:02.062957 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:02.062856    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-cx7lm" podStartSLOduration=2.932312665 podStartE2EDuration="11.062831406s" totalImagesPullingTime="8.130518741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:11:02.062586963 +0000 UTC m=+11.710922016" watchObservedRunningTime="2026-10-30 21:11:02.062831406 +0000 UTC m=+11.711166457"
Oct 30 21:11:02.291348 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:02.291298    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-lzdr5" podStartSLOduration=2.989213588 podStartE2EDuration="11.291280189s" totalImagesPullingTime="8.302066601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:11:02.291087719 +0000 UTC m=+11.939422766" watchObservedRunningTime="2026-10-30 21:11:02.291280189 +0000 UTC m=+11.939615242"
Oct 30 21:11:02.847428 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:02.847220    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:02.847428 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:02.847258    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:02.847428 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:02.847345    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58v4c" podUID="46c8ff3a-870d-4939-94f3-8c73beab6ecb"
Oct 30 21:11:02.847428 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:02.847405    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gs88" podUID="de7df116-a968-473a-85b7-cd508eb8edc5"
Oct 30 21:11:02.955843 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:02.955805    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wlqbw" event={"ID":"d67402d3-89aa-453d-991b-56606214dfa4","Type":"ContainerStarted","Data":"405e05c072f4e52146704ecc1622806458f0d35f81782bddd0091ebb2e7dabbe"}
Oct 30 21:11:02.959620 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:02.959594    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5" event={"ID":"f6c8d5f3-1059-4847-ad18-af3750c7c7e8","Type":"ContainerStarted","Data":"86c287b3b0199c945317b6dc64a53c4c4705e8648be80f63e05a5cdae20d6dfd"}
Oct 30 21:11:03.071843 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:03.071009    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wlqbw" podStartSLOduration=4.159266482 podStartE2EDuration="12.070991773s" totalImagesPullingTime="7.911725291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:11:03.070421969 +0000 UTC m=+12.718757020" watchObservedRunningTime="2026-10-30 21:11:03.070991773 +0000 UTC m=+12.719326823"
Oct 30 21:11:03.187775 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:03.187731    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5" podStartSLOduration=3.306667416 podStartE2EDuration="12.187716335s" totalImagesPullingTime="8.881048919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:10:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:11:03.187425216 +0000 UTC m=+12.835760268" watchObservedRunningTime="2026-10-30 21:11:03.187716335 +0000 UTC m=+12.836051386"
Oct 30 21:11:03.846447 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:03.846414    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:03.846639 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:03.846537    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4t5j" podUID="32468c74-2a0c-4a3b-a073-98961fc3ffd6"
Oct 30 21:11:03.962950 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:03.962918    2581 generic.go:356] "Generic (PLEG): container finished" podID="9095843d-0f41-4363-9bd3-d7516c532136" containerID="7b68f754274e4c2f753984f7a82af1edf876a949d952cdfed0fb9ab08c6891c2" exitCode=0
Oct 30 21:11:03.963335 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:03.962959    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58btz" event={"ID":"9095843d-0f41-4363-9bd3-d7516c532136","Type":"ContainerDied","Data":"7b68f754274e4c2f753984f7a82af1edf876a949d952cdfed0fb9ab08c6891c2"}
Oct 30 21:11:03.964824 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:03.964738    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tnk8v" event={"ID":"1d1ae5a7-dbca-4614-bd43-3ed9e0558360","Type":"ContainerStarted","Data":"638f9a58488f7e9866c0b663de1b459c02f510b78959e246f899ca76ea758791"}
Oct 30 21:11:04.199074 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:04.198958    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tnk8v" podStartSLOduration=3.088711086 podStartE2EDuration="13.198944253s" totalImagesPullingTime="10.110233167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:11:04.1986729 +0000 UTC m=+13.847007951" watchObservedRunningTime="2026-10-30 21:11:04.198944253 +0000 UTC m=+13.847279302"
Oct 30 21:11:04.846989 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:04.846957    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:04.847472 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:04.847426    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58v4c" podUID="46c8ff3a-870d-4939-94f3-8c73beab6ecb"
Oct 30 21:11:04.847588 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:04.847536    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:04.847657 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:04.847639    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gs88" podUID="de7df116-a968-473a-85b7-cd508eb8edc5"
Oct 30 21:11:05.847268 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:05.847076    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:05.847268 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:05.847231    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4t5j" podUID="32468c74-2a0c-4a3b-a073-98961fc3ffd6"
Oct 30 21:11:05.971929 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:05.971899    2581 generic.go:356] "Generic (PLEG): container finished" podID="9095843d-0f41-4363-9bd3-d7516c532136" containerID="9660eb1ef337716bde8ca9e6bcc55c36a9c92d441fbc2b313e20254ff7d27b37" exitCode=0
Oct 30 21:11:05.972105 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:05.971943    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58btz" event={"ID":"9095843d-0f41-4363-9bd3-d7516c532136","Type":"ContainerDied","Data":"9660eb1ef337716bde8ca9e6bcc55c36a9c92d441fbc2b313e20254ff7d27b37"}
Oct 30 21:11:06.846240 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:06.846204    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:06.846240 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:06.846223    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:06.846502 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:06.846324    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58v4c" podUID="46c8ff3a-870d-4939-94f3-8c73beab6ecb"
Oct 30 21:11:06.846502 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:06.846455    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gs88" podUID="de7df116-a968-473a-85b7-cd508eb8edc5"
Oct 30 21:11:07.846541 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:07.846182    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:07.846945 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:07.846655    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4t5j" podUID="32468c74-2a0c-4a3b-a073-98961fc3ffd6"
Oct 30 21:11:07.979446 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:07.979375    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:11:07.979793 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:07.979772    2581 generic.go:356] "Generic (PLEG): container finished" podID="886735ce-b78e-4b99-898d-35d295a1b059" containerID="ac4944d2452f676a3ac844b35def1139164075bc952a292f68c3012e21147cff" exitCode=1
Oct 30 21:11:07.979866 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:07.979828    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q" event={"ID":"886735ce-b78e-4b99-898d-35d295a1b059","Type":"ContainerStarted","Data":"1ea2e0276a4319ec5b9b1b7c58e3962301abcb371ad3bf853556610fecf54833"}
Oct 30 21:11:07.979905 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:07.979886    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q" event={"ID":"886735ce-b78e-4b99-898d-35d295a1b059","Type":"ContainerStarted","Data":"1c02c7117a6cb03399138c51e8a5e5165a2664262b4690e06191c5dd4fa48456"}
Oct 30 21:11:07.979943 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:07.979925    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q" event={"ID":"886735ce-b78e-4b99-898d-35d295a1b059","Type":"ContainerStarted","Data":"a669f056d4870b13aabd05d61c57ed3a7ddf0d0ee6eca5e2b158f75bd826990b"}
Oct 30 21:11:07.979977 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:07.979954    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q" event={"ID":"886735ce-b78e-4b99-898d-35d295a1b059","Type":"ContainerStarted","Data":"fed7820fe9dcf59cb478bcfb4da0f5633f963cb7c0651f9543dc939e0634e98b"}
Oct 30 21:11:07.980019 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:07.979995    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q" event={"ID":"886735ce-b78e-4b99-898d-35d295a1b059","Type":"ContainerDied","Data":"ac4944d2452f676a3ac844b35def1139164075bc952a292f68c3012e21147cff"}
Oct 30 21:11:07.980048 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:07.980028    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q" event={"ID":"886735ce-b78e-4b99-898d-35d295a1b059","Type":"ContainerStarted","Data":"0f70387c96e4f0840b20c0dd334249972cea1515ce3cde825f0033d069e7381b"}
Oct 30 21:11:08.568162 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:08.568132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:08.568380 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:08.568168    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs\") pod \"network-metrics-daemon-58v4c\" (UID: \"46c8ff3a-870d-4939-94f3-8c73beab6ecb\") " pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:08.568380 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:08.568264    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:11:08.568380 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:08.568276    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:11:08.568380 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:08.568312    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs podName:46c8ff3a-870d-4939-94f3-8c73beab6ecb nodeName:}" failed. No retries permitted until 2026-10-30 21:11:24.56829782 +0000 UTC m=+34.216632860 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs") pod "network-metrics-daemon-58v4c" (UID: "46c8ff3a-870d-4939-94f3-8c73beab6ecb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:11:08.568380 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:08.568335    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret podName:de7df116-a968-473a-85b7-cd508eb8edc5 nodeName:}" failed. No retries permitted until 2026-10-30 21:11:24.568317724 +0000 UTC m=+34.216652768 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret") pod "global-pull-secret-syncer-6gs88" (UID: "de7df116-a968-473a-85b7-cd508eb8edc5") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:11:08.668697 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:08.668669    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkx85\" (UniqueName: \"kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85\") pod \"network-check-target-m4t5j\" (UID: \"32468c74-2a0c-4a3b-a073-98961fc3ffd6\") " pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:08.668831 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:08.668816    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:11:08.668887 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:08.668835    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:11:08.668887 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:08.668844    2581 projected.go:196] Error preparing data for projected volume kube-api-access-mkx85 for pod openshift-network-diagnostics/network-check-target-m4t5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:11:08.668887 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:08.668882    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85 podName:32468c74-2a0c-4a3b-a073-98961fc3ffd6 nodeName:}" failed. No retries permitted until 2026-10-30 21:11:24.668870958 +0000 UTC m=+34.317205987 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mkx85" (UniqueName: "kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85") pod "network-check-target-m4t5j" (UID: "32468c74-2a0c-4a3b-a073-98961fc3ffd6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:11:08.849580 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:08.849509    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:08.849580 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:08.849543    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:08.850001 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:08.849642    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58v4c" podUID="46c8ff3a-870d-4939-94f3-8c73beab6ecb"
Oct 30 21:11:08.850001 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:08.849757    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gs88" podUID="de7df116-a968-473a-85b7-cd508eb8edc5"
Oct 30 21:11:08.984214 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:08.984187    2581 generic.go:356] "Generic (PLEG): container finished" podID="9095843d-0f41-4363-9bd3-d7516c532136" containerID="8f1710d6f8bf7cc5d9825d7e0ad33009d06af79cfd9d5ce46ee58ea943ef178b" exitCode=0
Oct 30 21:11:08.984320 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:08.984224    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58btz" event={"ID":"9095843d-0f41-4363-9bd3-d7516c532136","Type":"ContainerDied","Data":"8f1710d6f8bf7cc5d9825d7e0ad33009d06af79cfd9d5ce46ee58ea943ef178b"}
Oct 30 21:11:09.846274 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:09.846248    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:09.846384 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:09.846363    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4t5j" podUID="32468c74-2a0c-4a3b-a073-98961fc3ffd6"
Oct 30 21:11:09.988555 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:09.988531    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:11:09.988987 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:09.988882    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q" event={"ID":"886735ce-b78e-4b99-898d-35d295a1b059","Type":"ContainerStarted","Data":"1b2495b476f8149968a7f3c38e0af5da71dbbc7fccb47de1e4a662250de09041"}
Oct 30 21:11:09.991576 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:09.991555    2581 generic.go:356] "Generic (PLEG): container finished" podID="9095843d-0f41-4363-9bd3-d7516c532136" containerID="6513e996e0fb989c365c541c1533ce484b8ebd5ad4b24355afc99e4b6056eafe" exitCode=0
Oct 30 21:11:09.991683 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:09.991585    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58btz" event={"ID":"9095843d-0f41-4363-9bd3-d7516c532136","Type":"ContainerDied","Data":"6513e996e0fb989c365c541c1533ce484b8ebd5ad4b24355afc99e4b6056eafe"}
Oct 30 21:11:10.848830 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:10.848803    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:10.848962 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:10.848911    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58v4c" podUID="46c8ff3a-870d-4939-94f3-8c73beab6ecb"
Oct 30 21:11:10.848997 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:10.848963    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:10.849052 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:10.849036    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gs88" podUID="de7df116-a968-473a-85b7-cd508eb8edc5"
Oct 30 21:11:10.995818 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:10.995791    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-58btz" event={"ID":"9095843d-0f41-4363-9bd3-d7516c532136","Type":"ContainerStarted","Data":"697ea54e542a0855b3751543766a7dbb0f56f16cd454d5015f4092a1711650ef"}
Oct 30 21:11:11.114851 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:11.114766    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-58btz" podStartSLOduration=8.195631917 podStartE2EDuration="20.114753472s" totalImagesPullingTime="11.919121555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:10:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:11:11.113858763 +0000 UTC m=+20.762193834" watchObservedRunningTime="2026-10-30 21:11:11.114753472 +0000 UTC m=+20.763088522"
Oct 30 21:11:11.846271 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:11.846243    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:11.846447 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:11.846334    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4t5j" podUID="32468c74-2a0c-4a3b-a073-98961fc3ffd6"
Oct 30 21:11:12.001401 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:12.001279    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:11:12.001860 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:12.001756    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q" event={"ID":"886735ce-b78e-4b99-898d-35d295a1b059","Type":"ContainerStarted","Data":"d676cf425b27061fe20d40b394f432bf562d190fae4cfe428649018bb988dbb1"}
Oct 30 21:11:12.002280 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:12.002260    2581 scope.go:122] "RemoveContainer" containerID="ac4944d2452f676a3ac844b35def1139164075bc952a292f68c3012e21147cff"
Oct 30 21:11:12.846518 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:12.846484    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:12.846518 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:12.846524    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:12.846774 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:12.846611    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gs88" podUID="de7df116-a968-473a-85b7-cd508eb8edc5"
Oct 30 21:11:12.846774 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:12.846730    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58v4c" podUID="46c8ff3a-870d-4939-94f3-8c73beab6ecb"
Oct 30 21:11:13.007399 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:13.007369    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:11:13.007800 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:13.007714    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q" event={"ID":"886735ce-b78e-4b99-898d-35d295a1b059","Type":"ContainerStarted","Data":"9aa407eec22335ba96b3afffff7cd151cadbaa83b6dd7920810e6f453976c292"}
Oct 30 21:11:13.008062 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:13.008031    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:13.008184 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:13.008101    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:13.008184 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:13.008132    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:13.023159 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:13.023139    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:13.023265 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:13.023230    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:13.258628 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:13.258582    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q" podStartSLOduration=8.221755444 podStartE2EDuration="22.258569314s" totalImagesPullingTime="14.03681387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:11:13.229831563 +0000 UTC m=+22.878166613" watchObservedRunningTime="2026-10-30 21:11:13.258569314 +0000 UTC m=+22.906904363"
Oct 30 21:11:13.846293 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:13.846268    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:13.846444 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:13.846360    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4t5j" podUID="32468c74-2a0c-4a3b-a073-98961fc3ffd6"
Oct 30 21:11:14.522943 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:14.522866    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6gs88"]
Oct 30 21:11:14.523445 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:14.523002    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:14.523445 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:14.523076    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gs88" podUID="de7df116-a968-473a-85b7-cd508eb8edc5"
Oct 30 21:11:14.525580 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:14.525549    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m4t5j"]
Oct 30 21:11:14.525708 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:14.525691    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:14.525807 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:14.525780    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4t5j" podUID="32468c74-2a0c-4a3b-a073-98961fc3ffd6"
Oct 30 21:11:14.571988 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:14.571962    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-58v4c"]
Oct 30 21:11:14.572085 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:14.572056    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:14.572156 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:14.572141    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58v4c" podUID="46c8ff3a-870d-4939-94f3-8c73beab6ecb"
Oct 30 21:11:15.846126 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:15.846098    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:15.846561 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:15.846223    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4t5j" podUID="32468c74-2a0c-4a3b-a073-98961fc3ffd6"
Oct 30 21:11:16.846960 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:16.846891    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:16.847285 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:16.846998    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gs88" podUID="de7df116-a968-473a-85b7-cd508eb8edc5"
Oct 30 21:11:16.847285 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:16.847047    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:16.847285 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:16.847143    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58v4c" podUID="46c8ff3a-870d-4939-94f3-8c73beab6ecb"
Oct 30 21:11:17.350141 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:17.350111    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:17.570133 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:17.570103    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:17.803487 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:17.803445    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:17.843130 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:17.843110    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ttsq4"
Oct 30 21:11:17.843256 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:17.843210    2581 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:11:17.843590 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:17.843576    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ttsq4"
Oct 30 21:11:17.846098 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:17.846081    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:17.846168 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:17.846153    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4t5j" podUID="32468c74-2a0c-4a3b-a073-98961fc3ffd6"
Oct 30 21:11:18.064178 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:18.064121    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:18.846543 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:18.846452    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:18.846685 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:18.846621    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gs88" podUID="de7df116-a968-473a-85b7-cd508eb8edc5"
Oct 30 21:11:18.846685 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:18.846661    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:18.846781 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:18.846734    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58v4c" podUID="46c8ff3a-870d-4939-94f3-8c73beab6ecb"
Oct 30 21:11:18.967707 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:18.967532    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:19.306430 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:19.306406    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:19.846360 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:19.846335    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:19.846519 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:19.846426    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4t5j" podUID="32468c74-2a0c-4a3b-a073-98961fc3ffd6"
Oct 30 21:11:20.148816 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.148752    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeReady"
Oct 30 21:11:20.148920 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.148858    2581 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 21:11:20.265322 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.265295    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cvjpd"]
Oct 30 21:11:20.268449 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.268431    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9nf28"]
Oct 30 21:11:20.268564 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.268548    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cvjpd"
Oct 30 21:11:20.271647 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.271627    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:20.320283 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.320241    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 21:11:20.320283 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.320272    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 21:11:20.320678 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.320322    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-k8b2g\""
Oct 30 21:11:20.330497 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.330471    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cvjpd"]
Oct 30 21:11:20.342718 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.342694    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9nf28"]
Oct 30 21:11:20.363158 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.363134    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7nf7\" (UniqueName: \"kubernetes.io/projected/b0855c11-d0dc-4d51-92a9-3913d9946069-kube-api-access-x7nf7\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:20.363288 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.363163    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxpxg\" (UniqueName: \"kubernetes.io/projected/45d347ba-b99f-402d-92e2-db767c723fab-kube-api-access-dxpxg\") pod \"ingress-canary-cvjpd\" (UID: \"45d347ba-b99f-402d-92e2-db767c723fab\") " pod="openshift-ingress-canary/ingress-canary-cvjpd"
Oct 30 21:11:20.363288 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.363191    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0855c11-d0dc-4d51-92a9-3913d9946069-tmp-dir\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:20.363288 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.363259    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b0855c11-d0dc-4d51-92a9-3913d9946069-config-volume\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:20.363392 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.363373    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45d347ba-b99f-402d-92e2-db767c723fab-cert\") pod \"ingress-canary-cvjpd\" (UID: \"45d347ba-b99f-402d-92e2-db767c723fab\") " pod="openshift-ingress-canary/ingress-canary-cvjpd"
Oct 30 21:11:20.363436 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.363423    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:20.420520 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.420490    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 21:11:20.420656 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.420599    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 21:11:20.420656 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.420621    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 21:11:20.420728 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.420714    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dssbm\""
Oct 30 21:11:20.464285 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.464261    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45d347ba-b99f-402d-92e2-db767c723fab-cert\") pod \"ingress-canary-cvjpd\" (UID: \"45d347ba-b99f-402d-92e2-db767c723fab\") " pod="openshift-ingress-canary/ingress-canary-cvjpd"
Oct 30 21:11:20.464404 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.464303    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:20.464404 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.464329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7nf7\" (UniqueName: \"kubernetes.io/projected/b0855c11-d0dc-4d51-92a9-3913d9946069-kube-api-access-x7nf7\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:20.464516 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:20.464407    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:11:20.464516 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.464441    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxpxg\" (UniqueName: \"kubernetes.io/projected/45d347ba-b99f-402d-92e2-db767c723fab-kube-api-access-dxpxg\") pod \"ingress-canary-cvjpd\" (UID: \"45d347ba-b99f-402d-92e2-db767c723fab\") " pod="openshift-ingress-canary/ingress-canary-cvjpd"
Oct 30 21:11:20.464516 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:20.464451    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls podName:b0855c11-d0dc-4d51-92a9-3913d9946069 nodeName:}" failed. No retries permitted until 2026-10-30 21:11:20.964437845 +0000 UTC m=+30.612772873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls") pod "dns-default-9nf28" (UID: "b0855c11-d0dc-4d51-92a9-3913d9946069") : secret "dns-default-metrics-tls" not found
Oct 30 21:11:20.464647 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.464518    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0855c11-d0dc-4d51-92a9-3913d9946069-tmp-dir\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:20.464647 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.464542    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b0855c11-d0dc-4d51-92a9-3913d9946069-config-volume\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:20.464934 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.464916    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0855c11-d0dc-4d51-92a9-3913d9946069-tmp-dir\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:20.465154 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.465136    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b0855c11-d0dc-4d51-92a9-3913d9946069-config-volume\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:20.468424 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.468391    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45d347ba-b99f-402d-92e2-db767c723fab-cert\") pod \"ingress-canary-cvjpd\" (UID: \"45d347ba-b99f-402d-92e2-db767c723fab\") " pod="openshift-ingress-canary/ingress-canary-cvjpd"
Oct 30 21:11:20.520426 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.520404    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxpxg\" (UniqueName: \"kubernetes.io/projected/45d347ba-b99f-402d-92e2-db767c723fab-kube-api-access-dxpxg\") pod \"ingress-canary-cvjpd\" (UID: \"45d347ba-b99f-402d-92e2-db767c723fab\") " pod="openshift-ingress-canary/ingress-canary-cvjpd"
Oct 30 21:11:20.520527 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.520498    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7nf7\" (UniqueName: \"kubernetes.io/projected/b0855c11-d0dc-4d51-92a9-3913d9946069-kube-api-access-x7nf7\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:20.588404 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.588385    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cvjpd"
Oct 30 21:11:20.717629 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.717562    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:20.847499 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.847471    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:20.847639 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.847598    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:20.899390 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.899364    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 21:11:20.899390 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.899384    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r8s65\""
Oct 30 21:11:20.899555 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.899499    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-tklwz\""
Oct 30 21:11:20.899555 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.899541    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 21:11:20.952121 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.952094    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:20.963333 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.963309    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cvjpd"]
Oct 30 21:11:20.968782 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:20.968732    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:20.968878 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:20.968862    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:11:20.968934 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:20.968922    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls podName:b0855c11-d0dc-4d51-92a9-3913d9946069 nodeName:}" failed. No retries permitted until 2026-10-30 21:11:21.968908268 +0000 UTC m=+31.617243297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls") pod "dns-default-9nf28" (UID: "b0855c11-d0dc-4d51-92a9-3913d9946069") : secret "dns-default-metrics-tls" not found
Oct 30 21:11:20.970418 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:11:20.970396    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d347ba_b99f_402d_92e2_db767c723fab.slice/crio-98687aa443f1ff713e30c86b4f0b4fede556b4bafcaec598b1b8f273742f7851 WatchSource:0}: Error finding container 98687aa443f1ff713e30c86b4f0b4fede556b4bafcaec598b1b8f273742f7851: Status 404 returned error can't find the container with id 98687aa443f1ff713e30c86b4f0b4fede556b4bafcaec598b1b8f273742f7851
Oct 30 21:11:21.025082 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:21.025054    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cvjpd" event={"ID":"45d347ba-b99f-402d-92e2-db767c723fab","Type":"ContainerStarted","Data":"98687aa443f1ff713e30c86b4f0b4fede556b4bafcaec598b1b8f273742f7851"}
Oct 30 21:11:21.846705 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:21.846674    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:21.898295 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:21.898248    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 21:11:21.898430 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:21.898371    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 21:11:21.947628 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:21.947599    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-z8gbk\""
Oct 30 21:11:21.974997 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:21.974963    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:21.975103 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:21.975084    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:11:21.975158 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:21.975146    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls podName:b0855c11-d0dc-4d51-92a9-3913d9946069 nodeName:}" failed. No retries permitted until 2026-10-30 21:11:23.975128496 +0000 UTC m=+33.623463541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls") pod "dns-default-9nf28" (UID: "b0855c11-d0dc-4d51-92a9-3913d9946069") : secret "dns-default-metrics-tls" not found
Oct 30 21:11:22.439014 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.438977    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p9vq8"]
Oct 30 21:11:22.442593 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.442568    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:22.501684 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.501655    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p9vq8"]
Oct 30 21:11:22.567270 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.567239    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 21:11:22.567501 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.567476    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-c2dlm\""
Oct 30 21:11:22.567584 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.567482    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 21:11:22.567584 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.567519    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 21:11:22.567584 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.567491    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 21:11:22.579610 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.579583    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6de535fe-3a22-40e2-9a24-86fcc6292b0f-crio-socket\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:22.579723 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.579622    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:22.579723 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.579653    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:22.579838 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.579739    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6de535fe-3a22-40e2-9a24-86fcc6292b0f-data-volume\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:22.579888 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.579872    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng8xl\" (UniqueName: \"kubernetes.io/projected/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-api-access-ng8xl\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:22.589622 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.589595    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:22.680967 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.680935    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng8xl\" (UniqueName: \"kubernetes.io/projected/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-api-access-ng8xl\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:22.681141 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.681029    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6de535fe-3a22-40e2-9a24-86fcc6292b0f-crio-socket\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:22.681141 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.681062    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:22.681141 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.681095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:22.681141 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.681122    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6de535fe-3a22-40e2-9a24-86fcc6292b0f-data-volume\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:22.681520 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.681176    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6de535fe-3a22-40e2-9a24-86fcc6292b0f-crio-socket\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:22.681520 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:22.681223    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:11:22.681520 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:22.681263    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:11:22.681520 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:22.681290    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls podName:6de535fe-3a22-40e2-9a24-86fcc6292b0f nodeName:}" failed. No retries permitted until 2026-10-30 21:11:23.181269528 +0000 UTC m=+32.829604571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p9vq8" (UID: "6de535fe-3a22-40e2-9a24-86fcc6292b0f") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:11:22.681520 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:22.681311    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-rbac-proxy-cm podName:6de535fe-3a22-40e2-9a24-86fcc6292b0f nodeName:}" failed. No retries permitted until 2026-10-30 21:11:23.181299808 +0000 UTC m=+32.829634848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p9vq8" (UID: "6de535fe-3a22-40e2-9a24-86fcc6292b0f") : configmap "kube-rbac-proxy" not found
Oct 30 21:11:22.681520 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.681434    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6de535fe-3a22-40e2-9a24-86fcc6292b0f-data-volume\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:22.692151 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.692093    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-8nc9h-csrmt"]
Oct 30 21:11:22.695648 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.695629    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:22.742704 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.742677    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng8xl\" (UniqueName: \"kubernetes.io/projected/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-api-access-ng8xl\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:22.747200 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.747175    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 21:11:22.747498 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.747478    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9zfm5\""
Oct 30 21:11:22.781397 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.781371    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3d6657-b9dd-4d70-889a-e480fa537ed9-trusted-ca-bundle\") pod \"periodic-gathering-8nc9h-csrmt\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") " pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:22.781538 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.781394    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:22.781538 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.781508    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3f3d6657-b9dd-4d70-889a-e480fa537ed9-archives-path\") pod \"periodic-gathering-8nc9h-csrmt\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") " pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:22.781538 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.781534    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3d6657-b9dd-4d70-889a-e480fa537ed9-service-ca-bundle\") pod \"periodic-gathering-8nc9h-csrmt\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") " pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:22.781695 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.781599    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8tpp\" (UniqueName: \"kubernetes.io/projected/3f3d6657-b9dd-4d70-889a-e480fa537ed9-kube-api-access-j8tpp\") pod \"periodic-gathering-8nc9h-csrmt\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") " pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:22.799880 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.799849    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-8nc9h-csrmt"]
Oct 30 21:11:22.801293 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.801275    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 21:11:22.882305 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.882273    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8tpp\" (UniqueName: \"kubernetes.io/projected/3f3d6657-b9dd-4d70-889a-e480fa537ed9-kube-api-access-j8tpp\") pod \"periodic-gathering-8nc9h-csrmt\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") " pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:22.882774 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.882325    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3d6657-b9dd-4d70-889a-e480fa537ed9-trusted-ca-bundle\") pod \"periodic-gathering-8nc9h-csrmt\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") " pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:22.882774 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.882707    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3f3d6657-b9dd-4d70-889a-e480fa537ed9-archives-path\") pod \"periodic-gathering-8nc9h-csrmt\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") " pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:22.882774 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.882754    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3d6657-b9dd-4d70-889a-e480fa537ed9-service-ca-bundle\") pod \"periodic-gathering-8nc9h-csrmt\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") " pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:22.884637 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.884604    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3d6657-b9dd-4d70-889a-e480fa537ed9-service-ca-bundle\") pod \"periodic-gathering-8nc9h-csrmt\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") " pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:22.884765 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.884722    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3f3d6657-b9dd-4d70-889a-e480fa537ed9-archives-path\") pod \"periodic-gathering-8nc9h-csrmt\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") " pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:22.884927 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.884891    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3d6657-b9dd-4d70-889a-e480fa537ed9-trusted-ca-bundle\") pod \"periodic-gathering-8nc9h-csrmt\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") " pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:22.929638 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.929610    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-kv82x"]
Oct 30 21:11:22.934047 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.934023    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-kv82x"
Oct 30 21:11:22.947865 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.947818    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8tpp\" (UniqueName: \"kubernetes.io/projected/3f3d6657-b9dd-4d70-889a-e480fa537ed9-kube-api-access-j8tpp\") pod \"periodic-gathering-8nc9h-csrmt\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") " pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:22.972661 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.972633    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:22.986724 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.986700    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 21:11:22.986985 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.986964    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 21:11:22.988210 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.988194    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-mfb44\""
Oct 30 21:11:22.991025 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:22.991002    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-kv82x"]
Oct 30 21:11:23.008265 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.008234    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:23.083976 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.083948    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-669nt\" (UniqueName: \"kubernetes.io/projected/ca23ae9d-6ade-4f64-ba4c-a77e7ad9f639-kube-api-access-669nt\") pod \"migrator-66df5d496b-kv82x\" (UID: \"ca23ae9d-6ade-4f64-ba4c-a77e7ad9f639\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-kv82x"
Oct 30 21:11:23.164727 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.164693    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:23.184734 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.184701    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:23.184879 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.184745    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:23.184879 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.184812    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-669nt\" (UniqueName: \"kubernetes.io/projected/ca23ae9d-6ade-4f64-ba4c-a77e7ad9f639-kube-api-access-669nt\") pod \"migrator-66df5d496b-kv82x\" (UID: \"ca23ae9d-6ade-4f64-ba4c-a77e7ad9f639\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-kv82x"
Oct 30 21:11:23.184879 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:23.184846    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:11:23.185006 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:23.184872    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:11:23.185006 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:23.184923    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls podName:6de535fe-3a22-40e2-9a24-86fcc6292b0f nodeName:}" failed. No retries permitted until 2026-10-30 21:11:24.184905741 +0000 UTC m=+33.833240792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p9vq8" (UID: "6de535fe-3a22-40e2-9a24-86fcc6292b0f") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:11:23.185006 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:23.184945    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-rbac-proxy-cm podName:6de535fe-3a22-40e2-9a24-86fcc6292b0f nodeName:}" failed. No retries permitted until 2026-10-30 21:11:24.184934715 +0000 UTC m=+33.833269744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p9vq8" (UID: "6de535fe-3a22-40e2-9a24-86fcc6292b0f") : configmap "kube-rbac-proxy" not found
Oct 30 21:11:23.245058 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.244982    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-669nt\" (UniqueName: \"kubernetes.io/projected/ca23ae9d-6ade-4f64-ba4c-a77e7ad9f639-kube-api-access-669nt\") pod \"migrator-66df5d496b-kv82x\" (UID: \"ca23ae9d-6ade-4f64-ba4c-a77e7ad9f639\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-kv82x"
Oct 30 21:11:23.247005 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.246807    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-kv82x"
Oct 30 21:11:23.357825 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.357795    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:23.389117 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.389090    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-8nc9h-csrmt"]
Oct 30 21:11:23.392677 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:11:23.392653    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3d6657_b9dd_4d70_889a_e480fa537ed9.slice/crio-7103501cdaf6df86cd317e1d49d96a4b2defa5b8bd036c548c754a3c43f7de98 WatchSource:0}: Error finding container 7103501cdaf6df86cd317e1d49d96a4b2defa5b8bd036c548c754a3c43f7de98: Status 404 returned error can't find the container with id 7103501cdaf6df86cd317e1d49d96a4b2defa5b8bd036c548c754a3c43f7de98
Oct 30 21:11:23.618901 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.618789    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-kv82x"]
Oct 30 21:11:23.635926 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:11:23.635900    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca23ae9d_6ade_4f64_ba4c_a77e7ad9f639.slice/crio-727c7f03904328d8f776bda34045b36787e93cb7d28fe4e0748b643d4c61b99d WatchSource:0}: Error finding container 727c7f03904328d8f776bda34045b36787e93cb7d28fe4e0748b643d4c61b99d: Status 404 returned error can't find the container with id 727c7f03904328d8f776bda34045b36787e93cb7d28fe4e0748b643d4c61b99d
Oct 30 21:11:23.779928 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.779898    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-64r42"]
Oct 30 21:11:23.783061 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.783043    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-64r42"
Oct 30 21:11:23.836251 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.836223    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Oct 30 21:11:23.836424 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.836407    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Oct 30 21:11:23.836517 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.836407    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Oct 30 21:11:23.836517 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.836504    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qmnsm\""
Oct 30 21:11:23.836517 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.836451    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Oct 30 21:11:23.843239 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.843215    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-64r42"]
Oct 30 21:11:23.890585 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.890530    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b22257b3-075e-4545-abac-4d37820d073e-signing-cabundle\") pod \"service-ca-5fffc97bdf-64r42\" (UID: \"b22257b3-075e-4545-abac-4d37820d073e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-64r42"
Oct 30 21:11:23.890900 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.890587    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b22257b3-075e-4545-abac-4d37820d073e-signing-key\") pod \"service-ca-5fffc97bdf-64r42\" (UID: \"b22257b3-075e-4545-abac-4d37820d073e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-64r42"
Oct 30 21:11:23.890900 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.890710    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h4ts\" (UniqueName: \"kubernetes.io/projected/b22257b3-075e-4545-abac-4d37820d073e-kube-api-access-8h4ts\") pod \"service-ca-5fffc97bdf-64r42\" (UID: \"b22257b3-075e-4545-abac-4d37820d073e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-64r42"
Oct 30 21:11:23.991336 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.991311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b22257b3-075e-4545-abac-4d37820d073e-signing-cabundle\") pod \"service-ca-5fffc97bdf-64r42\" (UID: \"b22257b3-075e-4545-abac-4d37820d073e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-64r42"
Oct 30 21:11:23.991434 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.991366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:23.991434 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.991395    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b22257b3-075e-4545-abac-4d37820d073e-signing-key\") pod \"service-ca-5fffc97bdf-64r42\" (UID: \"b22257b3-075e-4545-abac-4d37820d073e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-64r42"
Oct 30 21:11:23.991560 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.991442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h4ts\" (UniqueName: \"kubernetes.io/projected/b22257b3-075e-4545-abac-4d37820d073e-kube-api-access-8h4ts\") pod \"service-ca-5fffc97bdf-64r42\" (UID: \"b22257b3-075e-4545-abac-4d37820d073e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-64r42"
Oct 30 21:11:23.991560 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:23.991536    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:11:23.991652 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:23.991601    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls podName:b0855c11-d0dc-4d51-92a9-3913d9946069 nodeName:}" failed. No retries permitted until 2026-10-30 21:11:27.991586682 +0000 UTC m=+37.639921725 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls") pod "dns-default-9nf28" (UID: "b0855c11-d0dc-4d51-92a9-3913d9946069") : secret "dns-default-metrics-tls" not found
Oct 30 21:11:23.992046 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.992029    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b22257b3-075e-4545-abac-4d37820d073e-signing-cabundle\") pod \"service-ca-5fffc97bdf-64r42\" (UID: \"b22257b3-075e-4545-abac-4d37820d073e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-64r42"
Oct 30 21:11:23.994039 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:23.993803    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b22257b3-075e-4545-abac-4d37820d073e-signing-key\") pod \"service-ca-5fffc97bdf-64r42\" (UID: \"b22257b3-075e-4545-abac-4d37820d073e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-64r42"
Oct 30 21:11:24.033235 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:24.033200    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-kv82x" event={"ID":"ca23ae9d-6ade-4f64-ba4c-a77e7ad9f639","Type":"ContainerStarted","Data":"727c7f03904328d8f776bda34045b36787e93cb7d28fe4e0748b643d4c61b99d"}
Oct 30 21:11:24.034494 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:24.034473    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cvjpd" event={"ID":"45d347ba-b99f-402d-92e2-db767c723fab","Type":"ContainerStarted","Data":"17909482b4f977f463727a66571c96dfa794846ca573ebec2f15de09b38b4307"}
Oct 30 21:11:24.035514 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:24.035495    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-8nc9h-csrmt" event={"ID":"3f3d6657-b9dd-4d70-889a-e480fa537ed9","Type":"ContainerStarted","Data":"7103501cdaf6df86cd317e1d49d96a4b2defa5b8bd036c548c754a3c43f7de98"}
Oct 30 21:11:24.052734 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:24.052711    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h4ts\" (UniqueName: \"kubernetes.io/projected/b22257b3-075e-4545-abac-4d37820d073e-kube-api-access-8h4ts\") pod \"service-ca-5fffc97bdf-64r42\" (UID: \"b22257b3-075e-4545-abac-4d37820d073e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-64r42"
Oct 30 21:11:24.064287 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:24.064267    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:24.093086 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:24.093064    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-64r42"
Oct 30 21:11:24.158201 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:24.158156    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cvjpd" podStartSLOduration=1.481318524 podStartE2EDuration="4.158141749s" totalImagesPullingTime="2.676823225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:11:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:11:24.157928724 +0000 UTC m=+33.806263787" watchObservedRunningTime="2026-10-30 21:11:24.158141749 +0000 UTC m=+33.806476795"
Oct 30 21:11:24.192655 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:24.192631    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:24.192776 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:24.192671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:24.192776 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:24.192751    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:11:24.192873 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:24.192814    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-rbac-proxy-cm podName:6de535fe-3a22-40e2-9a24-86fcc6292b0f nodeName:}" failed. No retries permitted until 2026-10-30 21:11:26.192795879 +0000 UTC m=+35.841130921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p9vq8" (UID: "6de535fe-3a22-40e2-9a24-86fcc6292b0f") : configmap "kube-rbac-proxy" not found
Oct 30 21:11:24.192929 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:24.192881    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:11:24.192966 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:24.192930    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls podName:6de535fe-3a22-40e2-9a24-86fcc6292b0f nodeName:}" failed. No retries permitted until 2026-10-30 21:11:26.192918038 +0000 UTC m=+35.841253083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p9vq8" (UID: "6de535fe-3a22-40e2-9a24-86fcc6292b0f") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:11:24.473807 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:24.473759    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-64r42"]
Oct 30 21:11:24.477323 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:11:24.477299    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb22257b3_075e_4545_abac_4d37820d073e.slice/crio-1021434f3359e89cd5975676cca7aeb6b2b577d56e443822a2955cd26745ca9d WatchSource:0}: Error finding container 1021434f3359e89cd5975676cca7aeb6b2b577d56e443822a2955cd26745ca9d: Status 404 returned error can't find the container with id 1021434f3359e89cd5975676cca7aeb6b2b577d56e443822a2955cd26745ca9d
Oct 30 21:11:24.554150 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:24.554116    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:24.595256 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:24.595228    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:24.595374 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:24.595278    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs\") pod \"network-metrics-daemon-58v4c\" (UID: \"46c8ff3a-870d-4939-94f3-8c73beab6ecb\") " pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:24.595472 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:24.595438    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 21:11:24.595571 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:24.595512    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs podName:46c8ff3a-870d-4939-94f3-8c73beab6ecb nodeName:}" failed. No retries permitted until 2026-10-30 21:11:56.595494475 +0000 UTC m=+66.243829516 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs") pod "network-metrics-daemon-58v4c" (UID: "46c8ff3a-870d-4939-94f3-8c73beab6ecb") : secret "metrics-daemon-secret" not found
Oct 30 21:11:24.597821 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:24.597804    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:24.695786 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:24.695761    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkx85\" (UniqueName: \"kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85\") pod \"network-check-target-m4t5j\" (UID: \"32468c74-2a0c-4a3b-a073-98961fc3ffd6\") " pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:24.698629 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:24.698606    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkx85\" (UniqueName: \"kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85\") pod \"network-check-target-m4t5j\" (UID: \"32468c74-2a0c-4a3b-a073-98961fc3ffd6\") " pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:24.760822 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:24.760546    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:24.858759 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:24.858736    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:25.041795 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:25.041689    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-64r42" event={"ID":"b22257b3-075e-4545-abac-4d37820d073e","Type":"ContainerStarted","Data":"1021434f3359e89cd5975676cca7aeb6b2b577d56e443822a2955cd26745ca9d"}
Oct 30 21:11:25.152876 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:25.152836    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6gs88"]
Oct 30 21:11:25.159365 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:11:25.159123    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde7df116_a968_473a_85b7_cd508eb8edc5.slice/crio-817af4fbe3a45d5618690e11abe622318b68cfcd04110847a5450a969d40f402 WatchSource:0}: Error finding container 817af4fbe3a45d5618690e11abe622318b68cfcd04110847a5450a969d40f402: Status 404 returned error can't find the container with id 817af4fbe3a45d5618690e11abe622318b68cfcd04110847a5450a969d40f402
Oct 30 21:11:25.269404 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:25.269374    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m4t5j"]
Oct 30 21:11:25.274373 ip-10-0-142-237 kubenswrapper[2581]: W1030 21:11:25.274340    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32468c74_2a0c_4a3b_a073_98961fc3ffd6.slice/crio-20e119dcb3f1feb5b6224fb958bde387c2c7d70f8178077605e62a420a51d425 WatchSource:0}: Error finding container 20e119dcb3f1feb5b6224fb958bde387c2c7d70f8178077605e62a420a51d425: Status 404 returned error can't find the container with id 20e119dcb3f1feb5b6224fb958bde387c2c7d70f8178077605e62a420a51d425
Oct 30 21:11:26.046202 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:26.046166    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m4t5j" event={"ID":"32468c74-2a0c-4a3b-a073-98961fc3ffd6","Type":"ContainerStarted","Data":"20e119dcb3f1feb5b6224fb958bde387c2c7d70f8178077605e62a420a51d425"}
Oct 30 21:11:26.047701 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:26.047643    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-kv82x" event={"ID":"ca23ae9d-6ade-4f64-ba4c-a77e7ad9f639","Type":"ContainerStarted","Data":"4a0b45282825b67ef37c75947ee1c267a57901408573682e66a6be992ecb1b94"}
Oct 30 21:11:26.048796 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:26.048773    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6gs88" event={"ID":"de7df116-a968-473a-85b7-cd508eb8edc5","Type":"ContainerStarted","Data":"817af4fbe3a45d5618690e11abe622318b68cfcd04110847a5450a969d40f402"}
Oct 30 21:11:26.161949 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:26.161849    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-kv82x" podStartSLOduration=1.896536153 podStartE2EDuration="4.161830435s" totalImagesPullingTime="2.265294282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:11:26.161088695 +0000 UTC m=+35.809423746" watchObservedRunningTime="2026-10-30 21:11:26.161830435 +0000 UTC m=+35.810165486"
Oct 30 21:11:26.208352 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:26.208324    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:26.208490 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:26.208367    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:26.208490 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:26.208482    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:11:26.208607 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:26.208539    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-rbac-proxy-cm podName:6de535fe-3a22-40e2-9a24-86fcc6292b0f nodeName:}" failed. No retries permitted until 2026-10-30 21:11:30.208521283 +0000 UTC m=+39.856856327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p9vq8" (UID: "6de535fe-3a22-40e2-9a24-86fcc6292b0f") : configmap "kube-rbac-proxy" not found
Oct 30 21:11:26.208889 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:26.208863    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:11:26.208986 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:26.208926    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls podName:6de535fe-3a22-40e2-9a24-86fcc6292b0f nodeName:}" failed. No retries permitted until 2026-10-30 21:11:30.208910033 +0000 UTC m=+39.857245067 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p9vq8" (UID: "6de535fe-3a22-40e2-9a24-86fcc6292b0f") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:11:26.880061 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:26.879878    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:27.055648 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:27.055511    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-8nc9h-csrmt" event={"ID":"3f3d6657-b9dd-4d70-889a-e480fa537ed9","Type":"ContainerStarted","Data":"de03671cd054f2216748b3465f68ae9707ef9a521a58c99fc0e55bd62d948320"}
Oct 30 21:11:27.119033 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:27.118905    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:27.170471 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:27.169874    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-8nc9h-csrmt" podStartSLOduration=2.377323649 podStartE2EDuration="5.169857019s" totalImagesPullingTime="2.79253337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:11:27.168791861 +0000 UTC m=+36.817126911" watchObservedRunningTime="2026-10-30 21:11:27.169857019 +0000 UTC m=+36.818192069"
Oct 30 21:11:28.024154 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:28.024125    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:28.024321 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:28.024253    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:11:28.024321 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:28.024307    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls podName:b0855c11-d0dc-4d51-92a9-3913d9946069 nodeName:}" failed. No retries permitted until 2026-10-30 21:11:36.024294372 +0000 UTC m=+45.672629400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls") pod "dns-default-9nf28" (UID: "b0855c11-d0dc-4d51-92a9-3913d9946069") : secret "dns-default-metrics-tls" not found
Oct 30 21:11:28.059141 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:28.059107    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-64r42" event={"ID":"b22257b3-075e-4545-abac-4d37820d073e","Type":"ContainerStarted","Data":"e65caa94f17e348d340ffdf715c52baee6102f22004d980092320769d2b61110"}
Oct 30 21:11:28.179834 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:28.179755    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-64r42" podStartSLOduration=1.81159659 podStartE2EDuration="5.179737187s" totalImagesPullingTime="3.368140597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:11:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:11:28.178343508 +0000 UTC m=+37.826678558" watchObservedRunningTime="2026-10-30 21:11:28.179737187 +0000 UTC m=+37.828072237"
Oct 30 21:11:29.796212 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:29.796133    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lzdr5_b0f88e16-68d7-49b8-b50a-29786cf11a17/dns-node-resolver/0.log"
Oct 30 21:11:30.066829 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:30.066751    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m4t5j" event={"ID":"32468c74-2a0c-4a3b-a073-98961fc3ffd6","Type":"ContainerStarted","Data":"8d2b40b3e456d457c82d1a74d634f4747c04a026e198293cd5da4f35fad7cbd2"}
Oct 30 21:11:30.066974 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:30.066888    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:30.180632 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:30.180579    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m4t5j" podStartSLOduration=34.997672602 podStartE2EDuration="39.180564129s" totalImagesPullingTime="4.182891527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:11:30.180050861 +0000 UTC m=+39.828385913" watchObservedRunningTime="2026-10-30 21:11:30.180564129 +0000 UTC m=+39.828899178"
Oct 30 21:11:30.243524 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:30.243493    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:30.243524 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:30.243530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:30.243706 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:30.243640    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:11:30.243743 ip-10-0-142-237 kubenswrapper[2581]: E1030 21:11:30.243707    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls podName:6de535fe-3a22-40e2-9a24-86fcc6292b0f nodeName:}" failed. No retries permitted until 2026-10-30 21:11:38.243689462 +0000 UTC m=+47.892024494 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p9vq8" (UID: "6de535fe-3a22-40e2-9a24-86fcc6292b0f") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:11:30.243974 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:30.243958    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:30.596432 ip-10-0-142-237 kubenswrapper[2581]: I1030 21:11:30.596410    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5548s_47c8f18e-4ca1-413e-b665-d4b4a51dcab4/node-ca/0.log"
Oct 30 21:11:31.003758 ip-10-0-142-237 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 21:11:31.014815 ip-10-0-142-237 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 21:11:31.015037 ip-10-0-142-237 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 21:11:31.015094 ip-10-0-142-237 systemd[1]: kubelet.service: Consumed 2.324s CPU time.
Oct 30 21:11:31.027029 ip-10-0-142-237 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 21:11:31.115717 ip-10-0-142-237 kubenswrapper[4522]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:11:31.115717 ip-10-0-142-237 kubenswrapper[4522]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 21:11:31.115717 ip-10-0-142-237 kubenswrapper[4522]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:11:31.115717 ip-10-0-142-237 kubenswrapper[4522]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:11:31.117639 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117566    4522 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:11:31.117639 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117639    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:11:31.117639 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117643    4522 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:11:31.117737 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117646    4522 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:11:31.117737 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117648    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:11:31.117737 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117651    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:11:31.117737 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117654    4522 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:11:31.117737 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117656    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:11:31.117737 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117659    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:11:31.117737 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117662    4522 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:11:31.117737 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117664    4522 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:11:31.117737 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117667    4522 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:11:31.117737 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117670    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:11:31.117737 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117672    4522 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:11:31.117737 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117675    4522 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:11:31.117737 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117678    4522 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:11:31.117737 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117680    4522 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:11:31.117737 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117683    4522 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:11:31.117737 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117686    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:11:31.117737 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117688    4522 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:11:31.117737 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117691    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:11:31.117737 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117693    4522 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:11:31.118184 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117696    4522 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:11:31.118184 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117699    4522 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:11:31.118184 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117701    4522 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:11:31.118184 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117706    4522 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:11:31.118184 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117710    4522 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:11:31.118184 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117713    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:11:31.118184 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117716    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:11:31.118184 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117719    4522 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:11:31.118184 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117721    4522 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:11:31.118184 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117724    4522 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:11:31.118184 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117726    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:11:31.118184 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117729    4522 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:11:31.118184 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117731    4522 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:11:31.118184 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117734    4522 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:11:31.118184 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117736    4522 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:11:31.118184 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117739    4522 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:11:31.118184 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117742    4522 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:11:31.118184 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117745    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:11:31.118184 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117747    4522 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:11:31.118654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117750    4522 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:11:31.118654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117752    4522 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:11:31.118654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117755    4522 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:11:31.118654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117758    4522 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:11:31.118654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117761    4522 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:11:31.118654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117763    4522 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:11:31.118654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117766    4522 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:11:31.118654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117770    4522 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:11:31.118654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117772    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:11:31.118654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117775    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:11:31.118654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117778    4522 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:11:31.118654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117780    4522 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:11:31.118654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117783    4522 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:11:31.118654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117785    4522 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:11:31.118654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117788    4522 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:11:31.118654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117791    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:11:31.118654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117793    4522 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:11:31.118654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117796    4522 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:11:31.118654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117798    4522 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:11:31.118654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117801    4522 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:11:31.119145 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117804    4522 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:11:31.119145 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117806    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:11:31.119145 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117809    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:11:31.119145 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117812    4522 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:11:31.119145 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117816    4522 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:11:31.119145 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117818    4522 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:11:31.119145 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117821    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:11:31.119145 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117823    4522 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:11:31.119145 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117826    4522 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:11:31.119145 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117828    4522 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:11:31.119145 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117831    4522 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:11:31.119145 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117834    4522 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:11:31.119145 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117836    4522 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:11:31.119145 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117838    4522 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:11:31.119145 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117841    4522 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:11:31.119145 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117843    4522 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:11:31.119145 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117846    4522 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:11:31.119145 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117849    4522 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:11:31.119145 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117852    4522 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:11:31.119145 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117855    4522 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:11:31.119625 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117857    4522 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:11:31.119625 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117860    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:11:31.119625 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117862    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:11:31.119625 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117865    4522 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:11:31.119625 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117867    4522 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:11:31.119625 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117870    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:11:31.119625 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117873    4522 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:11:31.119625 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117876    4522 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:11:31.119625 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117880    4522 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:11:31.119625 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117883    4522 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:11:31.119625 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117886    4522 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:11:31.119625 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117889    4522 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:11:31.119625 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117891    4522 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:11:31.119625 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117894    4522 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:11:31.119625 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117897    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:11:31.119625 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117900    4522 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:11:31.119625 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117903    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:11:31.119625 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117905    4522 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:11:31.119625 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117908    4522 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:11:31.120066 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117911    4522 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:11:31.120066 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117914    4522 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:11:31.120066 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117916    4522 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:11:31.120066 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117919    4522 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:11:31.120066 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117922    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:11:31.120066 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.117926    4522 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:11:31.120066 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118664    4522 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:11:31.120066 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118670    4522 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:11:31.120066 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118673    4522 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:11:31.120066 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118676    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:11:31.120066 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118679    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:11:31.120066 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118682    4522 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:11:31.120066 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118685    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:11:31.120066 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118687    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:11:31.120066 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118690    4522 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:11:31.120066 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118694    4522 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:11:31.120066 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118696    4522 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:11:31.120066 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118699    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:11:31.120066 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118701    4522 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:11:31.120521 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118704    4522 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:11:31.120521 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118707    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:11:31.120521 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118709    4522 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:11:31.120521 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118712    4522 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:11:31.120521 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118715    4522 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:11:31.120521 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118717    4522 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:11:31.120521 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118719    4522 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:11:31.120521 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118722    4522 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:11:31.120521 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118725    4522 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:11:31.120521 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118727    4522 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:11:31.120521 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118730    4522 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:11:31.120521 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118732    4522 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:11:31.120521 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118735    4522 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:11:31.120521 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118738    4522 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:11:31.120521 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118741    4522 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:11:31.120521 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118743    4522 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:11:31.120521 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118747    4522 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:11:31.120521 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118749    4522 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:11:31.120521 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118752    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:11:31.120521 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118755    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:11:31.121027 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118758    4522 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:11:31.121027 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118760    4522 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:11:31.121027 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118764    4522 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:11:31.121027 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118768    4522 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:11:31.121027 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118777    4522 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:11:31.121027 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118781    4522 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:11:31.121027 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118784    4522 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:11:31.121027 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118787    4522 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:11:31.121027 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118790    4522 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:11:31.121027 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118792    4522 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:11:31.121027 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118795    4522 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:11:31.121027 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118797    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:11:31.121027 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118800    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:11:31.121027 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118803    4522 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:11:31.121027 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118806    4522 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:11:31.121027 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118808    4522 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:11:31.121027 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118811    4522 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:11:31.121027 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118814    4522 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:11:31.121027 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118816    4522 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:11:31.121511 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118819    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:11:31.121511 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118821    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:11:31.121511 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118824    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:11:31.121511 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118826    4522 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:11:31.121511 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118829    4522 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:11:31.121511 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118831    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:11:31.121511 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118834    4522 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:11:31.121511 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118836    4522 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:11:31.121511 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118839    4522 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:11:31.121511 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118841    4522 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:11:31.121511 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118844    4522 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:11:31.121511 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118846    4522 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:11:31.121511 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118849    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:11:31.121511 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118851    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:11:31.121511 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118854    4522 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:11:31.121511 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118856    4522 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:11:31.121511 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118859    4522 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:11:31.121511 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118861    4522 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:11:31.121511 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118864    4522 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:11:31.121957 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118868    4522 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:11:31.121957 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118874    4522 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:11:31.121957 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118876    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:11:31.121957 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118879    4522 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:11:31.121957 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118883    4522 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:11:31.121957 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118886    4522 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:11:31.121957 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118888    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:11:31.121957 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118891    4522 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:11:31.121957 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118893    4522 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:11:31.121957 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118896    4522 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:11:31.121957 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118899    4522 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:11:31.121957 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118901    4522 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:11:31.121957 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118904    4522 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:11:31.121957 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118906    4522 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:11:31.121957 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118909    4522 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:11:31.121957 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118911    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:11:31.121957 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118914    4522 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:11:31.121957 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118916    4522 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:11:31.121957 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118919    4522 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:11:31.121957 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118922    4522 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:11:31.122423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118924    4522 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:11:31.122423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118927    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:11:31.122423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118929    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:11:31.122423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118932    4522 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:11:31.122423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118934    4522 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:11:31.122423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118937    4522 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:11:31.122423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118939    4522 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:11:31.122423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118942    4522 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:11:31.122423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118944    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:11:31.122423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118950    4522 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:11:31.122423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118953    4522 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:11:31.122423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118955    4522 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:11:31.122423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118958    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:11:31.122423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118962    4522 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:11:31.122423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.118965    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:11:31.122423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119442    4522 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:11:31.122423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119448    4522 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:11:31.122423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119451    4522 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:11:31.122423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119454    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:11:31.122423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119471    4522 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:11:31.122910 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119473    4522 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:11:31.122910 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119476    4522 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:11:31.122910 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119479    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:11:31.122910 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119482    4522 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:11:31.122910 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119485    4522 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:11:31.122910 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119487    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:11:31.122910 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119490    4522 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:11:31.122910 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119492    4522 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:11:31.122910 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119495    4522 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:11:31.122910 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119497    4522 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:11:31.122910 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119500    4522 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:11:31.122910 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119502    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:11:31.122910 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119505    4522 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:11:31.122910 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119508    4522 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:11:31.122910 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119510    4522 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:11:31.122910 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119513    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:11:31.122910 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119515    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:11:31.122910 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119518    4522 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:11:31.122910 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119520    4522 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:11:31.123353 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119523    4522 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:11:31.123353 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119525    4522 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:11:31.123353 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119527    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:11:31.123353 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119530    4522 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:11:31.123353 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119533    4522 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:11:31.123353 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119535    4522 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:11:31.123353 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119541    4522 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:11:31.123353 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119543    4522 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:11:31.123353 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119546    4522 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:11:31.123353 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119549    4522 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:11:31.123353 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119552    4522 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:11:31.123353 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119554    4522 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:11:31.123353 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119557    4522 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:11:31.123353 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119559    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:11:31.123353 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119562    4522 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:11:31.123353 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119565    4522 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:11:31.123353 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119567    4522 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:11:31.123353 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119570    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:11:31.123353 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119572    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:11:31.123353 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119575    4522 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:11:31.123839 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119578    4522 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:11:31.123839 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119580    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:11:31.123839 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119582    4522 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:11:31.123839 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119585    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:11:31.123839 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119587    4522 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:11:31.123839 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119590    4522 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:11:31.123839 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119593    4522 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:11:31.123839 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119596    4522 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:11:31.123839 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119598    4522 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:11:31.123839 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119601    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:11:31.123839 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119603    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:11:31.123839 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119606    4522 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:11:31.123839 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119608    4522 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:11:31.123839 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119611    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:11:31.123839 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119613    4522 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:11:31.123839 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119616    4522 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:11:31.123839 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119619    4522 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:11:31.123839 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119621    4522 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:11:31.123839 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119625    4522 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:11:31.123839 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119628    4522 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:11:31.124300 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119631    4522 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:11:31.124300 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119634    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:11:31.124300 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119636    4522 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:11:31.124300 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119639    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:11:31.124300 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119641    4522 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:11:31.124300 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119644    4522 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:11:31.124300 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119646    4522 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:11:31.124300 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119649    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:11:31.124300 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119651    4522 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:11:31.124300 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119654    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:11:31.124300 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119656    4522 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:11:31.124300 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119658    4522 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:11:31.124300 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119661    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:11:31.124300 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119663    4522 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:11:31.124300 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119667    4522 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:11:31.124300 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119670    4522 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:11:31.124300 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119674    4522 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:11:31.124300 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119676    4522 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:11:31.124300 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119679    4522 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:11:31.124867 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119682    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:11:31.124867 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119684    4522 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:11:31.124867 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119687    4522 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:11:31.124867 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119689    4522 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:11:31.124867 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119692    4522 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:11:31.124867 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119694    4522 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:11:31.124867 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119697    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:11:31.124867 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119699    4522 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:11:31.124867 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119702    4522 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:11:31.124867 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119704    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:11:31.124867 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119707    4522 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:11:31.124867 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119711    4522 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:11:31.124867 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119713    4522 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:11:31.124867 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119717    4522 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:11:31.124867 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119720    4522 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:11:31.124867 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119722    4522 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:11:31.124867 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119728    4522 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:11:31.124867 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119731    4522 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:11:31.124867 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119734    4522 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119737    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119740    4522 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119743    4522 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.119745    4522 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119834    4522 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119847    4522 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119853    4522 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119857    4522 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119861    4522 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119865    4522 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119869    4522 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119877    4522 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119881    4522 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119884    4522 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119887    4522 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119890    4522 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119893    4522 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119896    4522 flags.go:64] FLAG: --cgroup-root=""
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119899    4522 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119902    4522 flags.go:64] FLAG: --client-ca-file=""
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119905    4522 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119909    4522 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 21:11:31.125323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119913    4522 flags.go:64] FLAG: --cluster-domain=""
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119916    4522 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119921    4522 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119924    4522 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119927    4522 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119932    4522 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119935    4522 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119938    4522 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119942    4522 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119945    4522 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119948    4522 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119951    4522 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119954    4522 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119957    4522 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119961    4522 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119965    4522 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119968    4522 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119971    4522 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119974    4522 flags.go:64] FLAG: --enable-server="true"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119977    4522 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119982    4522 flags.go:64] FLAG: --event-burst="100"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119985    4522 flags.go:64] FLAG: --event-qps="50"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119988    4522 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119991    4522 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 21:11:31.125908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119994    4522 flags.go:64] FLAG: --eviction-hard=""
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.119998    4522 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120001    4522 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120004    4522 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120007    4522 flags.go:64] FLAG: --eviction-soft=""
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120010    4522 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120014    4522 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120017    4522 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120019    4522 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120022    4522 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120026    4522 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120029    4522 flags.go:64] FLAG: --feature-gates=""
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120033    4522 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120036    4522 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120040    4522 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120043    4522 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120046    4522 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120049    4522 flags.go:64] FLAG: --help="false"
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120052    4522 flags.go:64] FLAG: --hostname-override="ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120055    4522 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120058    4522 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120061    4522 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120065    4522 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 21:11:31.126671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120070    4522 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120074    4522 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120077    4522 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120080    4522 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120083    4522 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120086    4522 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120089    4522 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120092    4522 flags.go:64] FLAG: --kube-reserved=""
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120095    4522 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120098    4522 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120101    4522 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120104    4522 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120106    4522 flags.go:64] FLAG: --lock-file=""
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120109    4522 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120112    4522 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120115    4522 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120121    4522 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120124    4522 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120126    4522 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120130    4522 flags.go:64] FLAG: --logging-format="text"
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120133    4522 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120136    4522 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120139    4522 flags.go:64] FLAG: --manifest-url=""
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120142    4522 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120147    4522 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 21:11:31.127551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120150    4522 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120153    4522 flags.go:64] FLAG: --max-pods="110"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120156    4522 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120159    4522 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120162    4522 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120165    4522 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120168    4522 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120172    4522 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120175    4522 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120182    4522 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120186    4522 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120189    4522 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120191    4522 flags.go:64] FLAG: --pod-cidr=""
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120195    4522 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120197    4522 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120201    4522 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120204    4522 flags.go:64] FLAG: --port="10250"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120207    4522 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120210    4522 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0b84b8ffac0062eb2"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120213    4522 flags.go:64] FLAG: --qos-reserved=""
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120216    4522 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120219    4522 flags.go:64] FLAG: --register-node="true"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120222    4522 flags.go:64] FLAG: --register-with-taints=""
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120225    4522 flags.go:64] FLAG: --registry-burst="10"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120228    4522 flags.go:64] FLAG: --registry-qps="5"
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120231    4522 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 21:11:31.128172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120234    4522 flags.go:64] FLAG: --reserved-memory=""
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120237    4522 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120240    4522 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120243    4522 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120246    4522 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120249    4522 flags.go:64] FLAG: --runonce="false"
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120257    4522 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120260    4522 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120263    4522 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120266    4522 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120269    4522 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120272    4522 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120275    4522 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120280    4522 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120283    4522 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120286    4522 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120289    4522 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120291    4522 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120294    4522 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120297    4522 flags.go:64] FLAG: --system-cgroups=""
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120300    4522 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120305    4522 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120308    4522 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120311    4522 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120315    4522 flags.go:64] FLAG: --tls-min-version=""
Oct 30 21:11:31.128855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120318    4522 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120321    4522 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120324    4522 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120327    4522 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120330    4522 flags.go:64] FLAG: --v="2"
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120334    4522 flags.go:64] FLAG: --version="false"
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120338    4522 flags.go:64] FLAG: --vmodule=""
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120342    4522 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120345    4522 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120503    4522 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120507    4522 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120510    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120513    4522 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120516    4522 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120519    4522 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120522    4522 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120525    4522 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120528    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120531    4522 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120533    4522 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120538    4522 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120540    4522 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:11:31.129483 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120543    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:11:31.130148 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120546    4522 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:11:31.130148 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120549    4522 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:11:31.130148 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120551    4522 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:11:31.130148 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120554    4522 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:11:31.130148 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120557    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:11:31.130148 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120559    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:11:31.130148 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120562    4522 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:11:31.130148 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120564    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:11:31.130148 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120567    4522 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:11:31.130148 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120569    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:11:31.130148 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120572    4522 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:11:31.130148 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120575    4522 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:11:31.130148 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120577    4522 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:11:31.130148 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120580    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:11:31.130148 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120582    4522 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:11:31.130148 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120585    4522 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:11:31.130148 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120587    4522 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:11:31.130148 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120589    4522 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:11:31.130148 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120592    4522 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:11:31.130799 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120594    4522 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:11:31.130799 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120597    4522 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:11:31.130799 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120599    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:11:31.130799 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120602    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:11:31.130799 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120604    4522 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:11:31.130799 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120607    4522 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:11:31.130799 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120610    4522 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:11:31.130799 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120612    4522 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:11:31.130799 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120615    4522 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:11:31.130799 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120617    4522 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:11:31.130799 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120621    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:11:31.130799 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120625    4522 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:11:31.130799 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120627    4522 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:11:31.130799 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120630    4522 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:11:31.130799 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120632    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:11:31.130799 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120635    4522 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:11:31.130799 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120637    4522 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:11:31.130799 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120640    4522 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:11:31.130799 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120643    4522 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:11:31.131357 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120645    4522 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:11:31.131357 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120648    4522 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:11:31.131357 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120650    4522 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:11:31.131357 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120653    4522 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:11:31.131357 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120655    4522 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:11:31.131357 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120658    4522 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:11:31.131357 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120660    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:11:31.131357 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120663    4522 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:11:31.131357 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120666    4522 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:11:31.131357 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120668    4522 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:11:31.131357 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120670    4522 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:11:31.131357 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120673    4522 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:11:31.131357 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120675    4522 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:11:31.131357 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120678    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:11:31.131357 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120681    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:11:31.131357 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120683    4522 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:11:31.131357 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120686    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:11:31.131357 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120688    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:11:31.131357 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120691    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:11:31.131357 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120694    4522 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:11:31.131958 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120696    4522 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:11:31.131958 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120699    4522 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:11:31.131958 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120701    4522 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:11:31.131958 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120705    4522 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:11:31.131958 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120710    4522 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:11:31.131958 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120713    4522 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:11:31.131958 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120716    4522 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:11:31.131958 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120718    4522 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:11:31.131958 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120721    4522 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:11:31.131958 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120725    4522 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:11:31.131958 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120728    4522 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:11:31.131958 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120732    4522 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:11:31.131958 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120734    4522 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:11:31.131958 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120737    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:11:31.131958 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120739    4522 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:11:31.131958 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120742    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:11:31.131958 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120746    4522 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:11:31.131958 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120749    4522 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:11:31.131958 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120752    4522 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:11:31.132523 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120755    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:11:31.132523 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120758    4522 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:11:31.132523 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120760    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:11:31.132523 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120763    4522 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:11:31.132523 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120765    4522 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:11:31.132523 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120768    4522 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:11:31.132523 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120770    4522 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:11:31.132523 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120773    4522 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:11:31.132523 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120775    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:11:31.132523 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120778    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:11:31.132523 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120781    4522 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:11:31.132523 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120783    4522 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:11:31.132523 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120786    4522 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:11:31.132523 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120789    4522 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:11:31.132523 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120791    4522 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:11:31.132523 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.120816    4522 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:11:31.132985 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120851    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:11:31.132985 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120855    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:11:31.132985 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120860    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:11:31.132985 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120862    4522 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:11:31.132985 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120865    4522 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:11:31.132985 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120868    4522 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:11:31.132985 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120870    4522 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:11:31.132985 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120873    4522 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:11:31.132985 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120876    4522 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:11:31.132985 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120878    4522 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:11:31.132985 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120881    4522 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:11:31.132985 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120883    4522 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:11:31.132985 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120886    4522 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:11:31.132985 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120890    4522 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:11:31.132985 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120893    4522 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:11:31.132985 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120897    4522 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:11:31.132985 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120900    4522 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:11:31.132985 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120902    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:11:31.132985 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120905    4522 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:11:31.133555 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120908    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:11:31.133555 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120911    4522 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:11:31.133555 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120915    4522 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:11:31.133555 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120918    4522 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:11:31.133555 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120921    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:11:31.133555 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120924    4522 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:11:31.133555 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120927    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:11:31.133555 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120930    4522 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:11:31.133555 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120932    4522 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:11:31.133555 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120935    4522 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:11:31.133555 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120937    4522 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:11:31.133555 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120940    4522 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:11:31.133555 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120943    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:11:31.133555 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120947    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:11:31.133555 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120950    4522 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:11:31.133555 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120955    4522 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:11:31.133555 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120957    4522 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:11:31.133555 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120960    4522 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:11:31.133555 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120963    4522 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:11:31.133996 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120965    4522 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:11:31.133996 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120968    4522 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:11:31.133996 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120970    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:11:31.133996 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120973    4522 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:11:31.133996 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120975    4522 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:11:31.133996 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120978    4522 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:11:31.133996 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120980    4522 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:11:31.133996 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120983    4522 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:11:31.133996 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120986    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:11:31.133996 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120988    4522 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:11:31.133996 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120991    4522 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:11:31.133996 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120993    4522 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:11:31.133996 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120995    4522 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:11:31.133996 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.120998    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:11:31.133996 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121001    4522 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:11:31.133996 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121004    4522 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:11:31.133996 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121006    4522 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:11:31.133996 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121009    4522 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:11:31.133996 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121011    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:11:31.133996 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121014    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:11:31.134482 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121017    4522 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:11:31.134482 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121019    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:11:31.134482 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121022    4522 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:11:31.134482 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121024    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:11:31.134482 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121027    4522 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:11:31.134482 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121030    4522 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:11:31.134482 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121034    4522 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:11:31.134482 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121036    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:11:31.134482 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121040    4522 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:11:31.134482 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121043    4522 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:11:31.134482 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121045    4522 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:11:31.134482 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121048    4522 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:11:31.134482 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121051    4522 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:11:31.134482 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121054    4522 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:11:31.134482 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121056    4522 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:11:31.134482 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121059    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:11:31.134482 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121062    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:11:31.134482 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121064    4522 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:11:31.134482 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121067    4522 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:11:31.134933 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121069    4522 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:11:31.134933 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121071    4522 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:11:31.134933 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121074    4522 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:11:31.134933 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121076    4522 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:11:31.134933 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121079    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:11:31.134933 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121081    4522 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:11:31.134933 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121084    4522 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:11:31.134933 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121086    4522 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:11:31.134933 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121089    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:11:31.134933 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121091    4522 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:11:31.134933 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121094    4522 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:11:31.134933 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121096    4522 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:11:31.134933 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121099    4522 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:11:31.134933 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121101    4522 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:11:31.134933 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121104    4522 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:11:31.134933 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121106    4522 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:11:31.134933 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121109    4522 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:11:31.134933 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121111    4522 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:11:31.134933 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121114    4522 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:11:31.134933 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121117    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:11:31.135609 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121120    4522 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:11:31.135609 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121123    4522 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:11:31.135609 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121126    4522 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:11:31.135609 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121129    4522 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:11:31.135609 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121131    4522 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:11:31.135609 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121133    4522 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:11:31.135609 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121136    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:11:31.135609 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121139    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:11:31.135609 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.121141    4522 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:11:31.135609 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.124522    4522 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 21:11:31.135609 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.124537    4522 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 21:11:31.135609 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.124553    4522 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 21:11:31.135609 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.124558    4522 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 21:11:31.135609 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124609    4522 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:11:31.135609 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124613    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:11:31.135609 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124617    4522 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:11:31.135609 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124620    4522 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:11:31.135609 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124623    4522 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:11:31.135609 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124626    4522 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:11:31.136212 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124628    4522 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:11:31.136212 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124631    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:11:31.136212 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124634    4522 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:11:31.136212 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124636    4522 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:11:31.136212 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124639    4522 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:11:31.136212 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124643    4522 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:11:31.136212 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124647    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:11:31.136212 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124650    4522 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:11:31.136212 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124652    4522 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:11:31.136212 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124655    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:11:31.136212 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124658    4522 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:11:31.136212 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124661    4522 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:11:31.136212 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124663    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:11:31.136212 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124666    4522 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:11:31.136212 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124669    4522 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:11:31.136212 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124672    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:11:31.136212 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124675    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:11:31.136212 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124677    4522 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:11:31.136212 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124680    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:11:31.136823 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124682    4522 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:11:31.136823 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124685    4522 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:11:31.136823 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124688    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:11:31.136823 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124690    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:11:31.136823 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124695    4522 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:11:31.136823 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124697    4522 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:11:31.136823 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124700    4522 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:11:31.136823 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124703    4522 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:11:31.136823 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124706    4522 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:11:31.136823 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124708    4522 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:11:31.136823 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124711    4522 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:11:31.136823 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124714    4522 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:11:31.136823 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124716    4522 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:11:31.136823 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124719    4522 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:11:31.136823 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124721    4522 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:11:31.136823 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124724    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:11:31.136823 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124727    4522 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:11:31.136823 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124729    4522 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:11:31.136823 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124732    4522 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:11:31.136823 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124734    4522 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:11:31.137284 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124737    4522 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:11:31.137284 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124740    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:11:31.137284 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124742    4522 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:11:31.137284 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124745    4522 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:11:31.137284 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124748    4522 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:11:31.137284 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124750    4522 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:11:31.137284 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124753    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:11:31.137284 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124756    4522 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:11:31.137284 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124758    4522 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:11:31.137284 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124761    4522 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:11:31.137284 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124763    4522 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:11:31.137284 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124766    4522 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:11:31.137284 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124769    4522 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:11:31.137284 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124771    4522 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:11:31.137284 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124774    4522 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:11:31.137284 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124777    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:11:31.137284 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124780    4522 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:11:31.137284 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124783    4522 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:11:31.137284 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124785    4522 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:11:31.137743 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124788    4522 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:11:31.137743 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124792    4522 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:11:31.137743 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124796    4522 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:11:31.137743 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124799    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:11:31.137743 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124802    4522 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:11:31.137743 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124805    4522 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:11:31.137743 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124807    4522 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:11:31.137743 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124810    4522 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:11:31.137743 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124812    4522 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:11:31.137743 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124814    4522 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:11:31.137743 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124817    4522 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:11:31.137743 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124820    4522 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:11:31.137743 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124823    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:11:31.137743 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124825    4522 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:11:31.137743 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124828    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:11:31.137743 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124831    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:11:31.137743 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124833    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:11:31.137743 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124836    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:11:31.137743 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124838    4522 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:11:31.138189 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124841    4522 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:11:31.138189 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124844    4522 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:11:31.138189 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124846    4522 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:11:31.138189 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124848    4522 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:11:31.138189 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124851    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:11:31.138189 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124854    4522 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:11:31.138189 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124856    4522 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:11:31.138189 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124859    4522 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:11:31.138189 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124861    4522 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:11:31.138189 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124864    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:11:31.138189 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124866    4522 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:11:31.138189 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124869    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:11:31.138189 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124872    4522 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:11:31.138189 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124875    4522 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:11:31.138189 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124877    4522 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:11:31.138189 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124880    4522 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:11:31.138189 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124883    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:11:31.138189 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124885    4522 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:11:31.138189 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124888    4522 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:11:31.138189 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124890    4522 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:11:31.138689 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124893    4522 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:11:31.138689 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124895    4522 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:11:31.138689 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.124898    4522 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:11:31.138689 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.124924    4522 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:11:31.138689 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125064    4522 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:11:31.138689 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125070    4522 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:11:31.138689 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125073    4522 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:11:31.138689 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125076    4522 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:11:31.138689 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125079    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:11:31.138689 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125082    4522 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:11:31.138689 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125086    4522 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:11:31.138689 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125090    4522 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:11:31.138689 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125092    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:11:31.138689 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125095    4522 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:11:31.138689 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125097    4522 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:11:31.138689 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125100    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:11:31.139057 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125102    4522 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:11:31.139057 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125105    4522 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:11:31.139057 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125108    4522 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:11:31.139057 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125110    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:11:31.139057 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125113    4522 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:11:31.139057 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125115    4522 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:11:31.139057 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125117    4522 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:11:31.139057 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125120    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:11:31.139057 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125122    4522 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:11:31.139057 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125129    4522 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:11:31.139057 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125132    4522 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:11:31.139057 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125134    4522 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:11:31.139057 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125137    4522 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:11:31.139057 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125139    4522 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:11:31.139057 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125142    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:11:31.139057 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125144    4522 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:11:31.139057 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125146    4522 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:11:31.139057 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125149    4522 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:11:31.139057 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125152    4522 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:11:31.139594 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125154    4522 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:11:31.139594 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125157    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:11:31.139594 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125159    4522 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:11:31.139594 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125162    4522 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:11:31.139594 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125164    4522 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:11:31.139594 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125167    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:11:31.139594 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125169    4522 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:11:31.139594 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125172    4522 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:11:31.139594 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125174    4522 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:11:31.139594 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125177    4522 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:11:31.139594 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125179    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:11:31.139594 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125182    4522 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:11:31.139594 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125184    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:11:31.139594 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125187    4522 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:11:31.139594 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125189    4522 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:11:31.139594 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125192    4522 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:11:31.139594 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125201    4522 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:11:31.139594 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125204    4522 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:11:31.139594 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125207    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:11:31.139594 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125209    4522 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:11:31.140096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125212    4522 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:11:31.140096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125215    4522 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:11:31.140096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125217    4522 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:11:31.140096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125220    4522 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:11:31.140096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125223    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:11:31.140096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125226    4522 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:11:31.140096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125228    4522 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:11:31.140096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125231    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:11:31.140096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125233    4522 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:11:31.140096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125236    4522 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:11:31.140096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125238    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:11:31.140096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125241    4522 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:11:31.140096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125243    4522 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:11:31.140096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125246    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:11:31.140096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125248    4522 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:11:31.140096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125251    4522 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:11:31.140096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125253    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:11:31.140096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125256    4522 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:11:31.140096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125258    4522 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:11:31.140096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125261    4522 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:11:31.140572 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125263    4522 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:11:31.140572 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125266    4522 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:11:31.140572 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125268    4522 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:11:31.140572 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125271    4522 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:11:31.140572 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125273    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:11:31.140572 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125276    4522 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:11:31.140572 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125278    4522 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:11:31.140572 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125283    4522 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:11:31.140572 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125285    4522 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:11:31.140572 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125288    4522 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:11:31.140572 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125290    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:11:31.140572 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125293    4522 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:11:31.140572 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125296    4522 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:11:31.140572 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125298    4522 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:11:31.140572 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125300    4522 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:11:31.140572 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125303    4522 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:11:31.140572 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125306    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:11:31.140572 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125308    4522 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:11:31.140572 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125311    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:11:31.140572 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125313    4522 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:11:31.141093 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125316    4522 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:11:31.141093 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125319    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:11:31.141093 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125321    4522 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:11:31.141093 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125324    4522 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:11:31.141093 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125328    4522 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:11:31.141093 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125332    4522 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:11:31.141093 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125335    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:11:31.141093 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125338    4522 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:11:31.141093 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125341    4522 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:11:31.141093 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125344    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:11:31.141093 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125346    4522 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:11:31.141093 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125348    4522 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:11:31.141093 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125351    4522 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:11:31.141093 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125354    4522 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:11:31.141093 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125356    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:11:31.141454 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.125379    4522 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:11:31.141454 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125409    4522 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:11:31.141454 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125413    4522 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:11:31.141454 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125416    4522 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:11:31.141454 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125423    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:11:31.141454 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125426    4522 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:11:31.141454 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125428    4522 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:11:31.141454 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125431    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:11:31.141454 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125434    4522 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:11:31.141454 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125436    4522 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:11:31.141454 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125439    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:11:31.141454 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125441    4522 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:11:31.141454 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125443    4522 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:11:31.141454 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125446    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:11:31.141454 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125448    4522 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:11:31.141454 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125451    4522 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:11:31.141846 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125453    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:11:31.141846 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125469    4522 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:11:31.141846 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125472    4522 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:11:31.141846 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125475    4522 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:11:31.141846 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125477    4522 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:11:31.141846 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125480    4522 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:11:31.141846 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125485    4522 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:11:31.141846 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125488    4522 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:11:31.141846 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125491    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:11:31.141846 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125493    4522 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:11:31.141846 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125496    4522 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:11:31.141846 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125499    4522 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:11:31.141846 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125501    4522 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:11:31.141846 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125504    4522 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:11:31.141846 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125506    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:11:31.141846 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125509    4522 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:11:31.141846 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125511    4522 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:11:31.141846 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125514    4522 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:11:31.141846 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125517    4522 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:11:31.141846 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125519    4522 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:11:31.142620 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125523    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:11:31.142620 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125526    4522 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:11:31.142620 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125528    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:11:31.142620 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125531    4522 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:11:31.142620 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125534    4522 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:11:31.142620 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125536    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:11:31.142620 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125539    4522 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:11:31.142620 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125541    4522 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:11:31.142620 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125546    4522 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:11:31.142620 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125550    4522 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:11:31.142620 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125553    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:11:31.142620 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125557    4522 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:11:31.142620 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125560    4522 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:11:31.142620 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125563    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:11:31.142620 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125565    4522 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:11:31.142620 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125568    4522 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:11:31.142620 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125571    4522 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:11:31.142620 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125573    4522 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:11:31.142620 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125577    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:11:31.143378 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125580    4522 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:11:31.143378 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125583    4522 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:11:31.143378 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125585    4522 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:11:31.143378 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125588    4522 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:11:31.143378 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125590    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:11:31.143378 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125594    4522 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:11:31.143378 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125597    4522 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:11:31.143378 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125600    4522 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:11:31.143378 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125603    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:11:31.143378 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125605    4522 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:11:31.143378 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125608    4522 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:11:31.143378 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125610    4522 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:11:31.143378 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125613    4522 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:11:31.143378 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125617    4522 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:11:31.143378 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125620    4522 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:11:31.143378 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125622    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:11:31.143378 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125625    4522 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:11:31.143378 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125627    4522 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:11:31.143378 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125629    4522 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:11:31.144053 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125632    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:11:31.144053 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125634    4522 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:11:31.144053 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125637    4522 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:11:31.144053 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125639    4522 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:11:31.144053 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125642    4522 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:11:31.144053 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125644    4522 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:11:31.144053 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125647    4522 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:11:31.144053 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125650    4522 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:11:31.144053 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125652    4522 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:11:31.144053 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125654    4522 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:11:31.144053 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125657    4522 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:11:31.144053 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125659    4522 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:11:31.144053 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125663    4522 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:11:31.144053 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125666    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:11:31.144053 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125669    4522 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:11:31.144053 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125671    4522 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:11:31.144053 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125674    4522 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:11:31.144053 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125676    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:11:31.144053 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125679    4522 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:11:31.144053 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125681    4522 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:11:31.144894 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125684    4522 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:11:31.144894 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125686    4522 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:11:31.144894 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125689    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:11:31.144894 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125691    4522 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:11:31.144894 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125694    4522 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:11:31.144894 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125697    4522 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:11:31.144894 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125701    4522 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:11:31.144894 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125703    4522 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:11:31.144894 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125706    4522 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:11:31.144894 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125708    4522 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:11:31.144894 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125711    4522 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:11:31.144894 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125713    4522 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:11:31.144894 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:31.125716    4522 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:11:31.144894 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.125764    4522 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 21:11:31.144894 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.127746    4522 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 21:11:31.144894 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.127795    4522 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 21:11:31.144894 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.127983    4522 server.go:1014] "Starting client certificate rotation"
Oct 30 21:11:31.144894 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.128124    4522 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:11:31.145656 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.128185    4522 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 21:05:50 +0000 UTC" deadline="2028-04-26 11:28:02.752946853 +0000 UTC"
Oct 30 21:11:31.145656 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.128233    4522 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13046h16m31.624717678s"
Oct 30 21:11:31.145656 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.128423    4522 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:11:31.145656 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.129406    4522 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:11:31.145656 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.130544    4522 log.go:25] "Validated CRI v1 runtime API"
Oct 30 21:11:31.145656 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.132095    4522 log.go:25] "Validated CRI v1 image API"
Oct 30 21:11:31.145656 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.132814    4522 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 21:11:31.145656 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.134312    4522 fs.go:135] Filesystem UUIDs: map[5914debf-bde7-476b-884f-00143a519a29:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e686108b-5ee5-4752-8e70-59e53ba44c18:/dev/nvme0n1p3]
Oct 30 21:11:31.145998 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.134333    4522 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1021434f3359e89cd5975676cca7aeb6b2b577d56e443822a2955cd26745ca9d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1021434f3359e89cd5975676cca7aeb6b2b577d56e443822a2955cd26745ca9d/userdata/shm major:0 minor:225 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1fe5a71f85fc8db891d79c8bc8bb5e141a36109f9098cf07d312ace4f1914ae1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1fe5a71f85fc8db891d79c8bc8bb5e141a36109f9098cf07d312ace4f1914ae1/userdata/shm major:0 minor:93 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/20e119dcb3f1feb5b6224fb958bde387c2c7d70f8178077605e62a420a51d425/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/20e119dcb3f1feb5b6224fb958bde387c2c7d70f8178077605e62a420a51d425/userdata/shm major:0 minor:233 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/30816de148a53d3654acad16df62ba7a410e916e8c30526de5fe5e0348f55302/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/30816de148a53d3654acad16df62ba7a410e916e8c30526de5fe5e0348f55302/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4fbf222cc1cd35e2e1f4abd0d6ef7e59a9b24249a49d6940e24de9fa05197160/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4fbf222cc1cd35e2e1f4abd0d6ef7e59a9b24249a49d6940e24de9fa05197160/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/63613ac19e2dc81451369e07858ab1af26cb8523a4a488e625e967c293753adf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/63613ac19e2dc81451369e07858ab1af26cb8523a4a488e625e967c293753adf/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7103501cdaf6df86cd317e1d49d96a4b2defa5b8bd036c548c754a3c43f7de98/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7103501cdaf6df86cd317e1d49d96a4b2defa5b8bd036c548c754a3c43f7de98/userdata/shm major:0 minor:210 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/727c7f03904328d8f776bda34045b36787e93cb7d28fe4e0748b643d4c61b99d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/727c7f03904328d8f776bda34045b36787e93cb7d28fe4e0748b643d4c61b99d/userdata/shm major:0 minor:211 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/813c6690ba4f95b19636bc400c7adfa0cc1ec08139b4baf443b90b5530e52310/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/813c6690ba4f95b19636bc400c7adfa0cc1ec08139b4baf443b90b5530e52310/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/817af4fbe3a45d5618690e11abe622318b68cfcd04110847a5450a969d40f402/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/817af4fbe3a45d5618690e11abe622318b68cfcd04110847a5450a969d40f402/userdata/shm major:0 minor:231 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/98687aa443f1ff713e30c86b4f0b4fede556b4bafcaec598b1b8f273742f7851/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/98687aa443f1ff713e30c86b4f0b4fede556b4bafcaec598b1b8f273742f7851/userdata/shm major:0 minor:202 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9f5c138e0c1d7514d203a5bea8f272e9375f1a560bf5e9cc7adf77f5e1813437/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9f5c138e0c1d7514d203a5bea8f272e9375f1a560bf5e9cc7adf77f5e1813437/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ad7bc466ca5f0a7737d7b01aaa2de119bb2319b8ebaec429632228e57b395281/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ad7bc466ca5f0a7737d7b01aaa2de119bb2319b8ebaec429632228e57b395281/userdata/shm major:0 minor:85 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ad9cdf4d7bf1cd250086bc58198518185e96ad68875e6bfd405291bb078f7127/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ad9cdf4d7bf1cd250086bc58198518185e96ad68875e6bfd405291bb078f7127/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/be77c0837462e287f57629efb8f5eeb87248c21a3314b443364d0b88f78436d9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/be77c0837462e287f57629efb8f5eeb87248c21a3314b443364d0b88f78436d9/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f45e917f6fa87b655405487f479cf3a5007a2acac742f72a2df6abac3b8890cd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f45e917f6fa87b655405487f479cf3a5007a2acac742f72a2df6abac3b8890cd/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf/volumes/kubernetes.io~projected/kube-api-access-25hjt:{mountpoint:/var/lib/kubelet/pods/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf/volumes/kubernetes.io~projected/kube-api-access-25hjt major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1d1ae5a7-dbca-4614-bd43-3ed9e0558360/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/1d1ae5a7-dbca-4614-bd43-3ed9e0558360/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1d1ae5a7-dbca-4614-bd43-3ed9e0558360/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/1d1ae5a7-dbca-4614-bd43-3ed9e0558360/volumes/kubernetes.io~empty-dir/tmp major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1d1ae5a7-dbca-4614-bd43-3ed9e0558360/volumes/kubernetes.io~projected/kube-api-access-wc5ds:{mountpoint:/var/lib/kubelet/pods/1d1ae5a7-dbca-4614-bd43-3ed9e0558360/volumes/kubernetes.io~projected/kube-api-access-wc5ds major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/32468c74-2a0c-4a3b-a073-98961fc3ffd6/volumes/kubernetes.io~projected/kube-api-access-mkx85:{mountpoint:/var/lib/kubelet/pods/32468c74-2a0c-4a3b-a073-98961fc3ffd6/volumes/kubernetes.io~projected/kube-api-access-mkx85 major:0 minor:230 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3f3d6657-b9dd-4d70-889a-e480fa537ed9/volumes/kubernetes.io~projected/kube-api-access-j8tpp:{mountpoint:/var/lib/kubelet/pods/3f3d6657-b9dd-4d70-889a-e480fa537ed9/volumes/kubernetes.io~projected/kube-api-access-j8tpp major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/45d347ba-b99f-402d-92e2-db767c723fab/volumes/kubernetes.io~projected/kube-api-access-dxpxg:{mountpoint:/var/lib/kubelet/pods/45d347ba-b99f-402d-92e2-db767c723fab/volumes/kubernetes.io~projected/kube-api-access-dxpxg major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/45d347ba-b99f-402d-92e2-db767c723fab/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/45d347ba-b99f-402d-92e2-db767c723fab/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/46c8ff3a-870d-4939-94f3-8c73beab6ecb/volumes/kubernetes.io~projected/kube-api-access-n4jsr:{mountpoint:/var/lib/kubelet/pods/46c8ff3a-870d-4939-94f3-8c73beab6ecb/volumes/kubernetes.io~projected/kube-api-access-n4jsr major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/47c8f18e-4ca1-413e-b665-d4b4a51dcab4/volumes/kubernetes.io~projected/kube-api-access-5lkhv:{mountpoint:/var/lib/kubelet/pods/47c8f18e-4ca1-413e-b665-d4b4a51dcab4/volumes/kubernetes.io~projected/kube-api-access-5lkhv major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6626e30d-3f05-406c-8ea5-5329ea58dd07/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/6626e30d-3f05-406c-8ea5-5329ea58dd07/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6de535fe-3a22-40e2-9a24-86fcc6292b0f/volumes/kubernetes.io~projected/kube-api-access-ng8xl:{mountpoint:/var/lib/kubelet/pods/6de535fe-3a22-40e2-9a24-86fcc6292b0f/volumes/kubernetes.io~projected/kube-api-access-ng8xl major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/886735ce-b78e-4b99-898d-35d295a1b059/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/886735ce-b78e-4b99-898d-35d295a1b059/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/886735ce-b78e-4b99-898d-35d295a1b059/volumes/kubernetes.io~projected/kube-api-access-74jsm:{mountpoint:/var/lib/kubelet/pods/886735ce-b78e-4b99-898d-35d295a1b059/volumes/kubernetes.io~projected/kube-api-access-74jsm major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/886735ce-b78e-4b99-898d-35d295a1b059/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/886735ce-b78e-4b99-898d-35d295a1b059/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9095843d-0f41-4363-9bd3-d7516c532136/volumes/kubernetes.io~projected/kube-api-access-95b8w:{mountpoint:/var/lib/kubelet/pods/9095843d-0f41-4363-9bd3-d7516c532136/volumes/kubernetes.io~projected/kube-api-access-95b8w major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b0855c11-d0dc-4d51-92a9-3913d9946069/volumes/kubernetes.io~projected/kube-api-access-x7nf7:{mountpoint:/var/lib/kubelet/pods/b0855c11-d0dc-4d51-92a9-3913d9946069/volumes/kubernetes.io~projected/kube-api-access-x7nf7 major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b0f88e16-68d7-49b8-b50a-29786cf11a17/volumes/kubernetes.io~projected/kube-api-access-jkt57:{mountpoint:/var/lib/kubelet/pods/b0f88e16-68d7-49b8-b50a-29786cf11a17/volumes/kubernetes.io~projected/kube-api-access-jkt57 major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b22257b3-075e-4545-abac-4d37820d073e/volumes/kubernetes.io~projected/kube-api-access-8h4ts:{mountpoint:/var/lib/kubelet/pods/b22257b3-075e-4545-abac-4d37820d073e/volumes/kubernetes.io~projected/kube-api-access-8h4ts major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b22257b3-075e-4545-abac-4d37820d073e/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/b22257b3-075e-4545-abac-4d37820d073e/volumes/kubernetes.io~secret/signing-key major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ca23ae9d-6ade-4f64-ba4c-a77e7ad9f639/volumes/kubernetes.io~projected/kube-api-access-669nt:{mountpoint:/var/lib/kubelet/pods/ca23ae9d-6ade-4f64-ba4c-a77e7ad9f639/volumes/kubernetes.io~projected/kube-api-access-669nt major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d67402d3-89aa-453d-991b-56606214dfa4/volumes/kubernetes.io~projected/kube-api-access-pps44:{mountpoint:/var/lib/kubelet/pods/d67402d3-89aa-453d-991b-56606214dfa4/volumes/kubernetes.io~projected/kube-api-access-pps44 major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/de7df116-a968-473a-85b7-cd508eb8edc5/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/de7df116-a968-473a-85b7-cd508eb8edc5/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:229 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f6c8d5f3-1059-4847-ad18-af3750c7c7e8/volumes/kubernetes.io~projected/kube-api-access-9sc76:{mountpoint:/var/lib/kubelet/pods/f6c8d5f3-1059-4847-ad18-af3750c7c7e8/volumes/kubernetes.io~projected/kube-api-access-9sc76 major:0 minor:63 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/fe13c42f91f15d24d5e6ffe2d4fa8aa6f20b76e9d286055cd67a80b38b4acc1e/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/0f7e03f131a4d3f3b132554f518b4ee6e7004bcc9aa0d68bc7480f8e606c8c05/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/3d558540c79416d56965d01783a1bab6bb9fc0ab6c2c9467243e62cfe0edb111/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/203fcd2892327037d76dc1e48176aef8a1ca6b5640b9d21d349117a452c243b9/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/88e110704aa1dc5704f6f4785d2f739aa2ed325130b4644f44d2ab7474557da6/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/8aa4dc96078cdb79a1f2c77af5bf0913d4d9eb4d3bd945726e82ab1ebb545299/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/a260ab213fa1512328ed6adc1afc96177fe6a80e33e4078c3ea4859fa796f50a/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/05eefffc4fc94208fbdaa36343fbd885e6b1366cf63b742d348ba16f21e5914e/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/e68a45bf547ed205090cf09ff4ade50d437c440fcf7040064e53c92cc02ffef1/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/88a4e6c1210d1775652e6309a8d9775bced39b8d4bd891fa8fad689ec54a875b/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/8bf8ba6b489b9fa1121fffd352a991f0e52f2286b07871fe3fffcd04115f8eb6/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-146:{mountpoint:/var/lib/containers/storage/overlay/45f8fe59f553cc5ee0cdab09c13cb570f9262dc5505861976775194f5c309690/merged major:0 minor:146 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/a6027f3401b4ccc87ba487c87b64d4f43e888f174cd5927eb6dbe389daab72d5/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/83f3de7de0bfb7c965411a92fdc46dbb1d6ca519bbc5af56abba4030bb7de3fc/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/bf1b5d41d8cea3f33ea932143aac37c0b67a40c0a10549f4c7c90abf5bdd4d3e/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/e3a9e3404985260953aefd0a9e8d650634550cbd1efaa580bcb45d3233cf28d2/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/bfb820ea426633d09650a1a946441c3d84e476a2d574b10abb82ba3b02ab75b8/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/a51719f01f62a9766080ce742c0dd88e08e1fddd992ed92ed362d7145eb0066c/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/fb6151cf5f72478a4b4c1a363e0e1833029ccc77871d6dcb6ac6fbbca0e7a402/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/01293d9709218e912dc5c68a1959887742a0aaa13aeff3eb0e76564252dfe14f/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/3cdfd9bc49fc580dc39e8d066e28765f211708d7f2a79056cf3c8f78bf7ba0e9/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-204:{mountpoint:/var/lib/containers/storage/overlay/c2d787edf28da37fd5abc21bd2c84809c91cbd6e517096f2110562f143d115c8/merged major:0 minor:204 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/e1ed90c894d968a67843838105e7a84daec562c66acaead5d9aaac85798f6a80/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/d1eb143a6d552648dfbedc9ba5cda56fdf343bba835533becd11b3274483390b/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/68c3115351d1c9b545d9e193223de21cb07fb318aa0071c931b6ce9fb69f27d8/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-227:{mountpoint:/var/lib/containers/storage/overlay/f068a773d8da765a18b35a41b75bed6fcdcbd13d4437c2a6bda1a0a3a983d8b8/merged major:0 minor:227 fsType:overlay blockSize:0} overlay_0-235:{mountpoint:/var/lib/containers/storage/overlay/b48b0227d7fd195e606c7f33aedd7714aaeee4d64f443c3e3d90c83d63c2aaf6/merged major:0 minor:235 fsType:overlay blockSize:0} overlay_0-237:{mountpoint:/var/lib/containers/storage/overlay/9ba89415adeba817b29e4ff1280a7cd33cf56d4530e1ab2f8f11137689bad140/merged major:0 minor:237 fsType:overlay blockSize:0} overlay_0-239:{mountpoint:/var/lib/containers/storage/overlay/139670bd3dc07a3313236676a978c78e9bac72672b0769cb319a1bb6ee126aab/merged major:0 minor:239 fsType:overlay blockSize:0} overlay_0-241:{mountpoint:/var/lib/containers/storage/overlay/0b093a475d07d4f9189899e9d2d203f65c92bb56c5fe4326096cc13492577f44/merged major:0 minor:241 fsType:overlay blockSize:0} overlay_0-247:{mountpoint:/var/lib/containers/storage/overlay/4dffd937a69cdd6480ede7988e5eefa056a5945fb8c181384feb96229ee08d56/merged major:0 minor:247 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/ba3caf249b8e7a61890ec719e0b0ab7aa825b6e9d591b07d41d706edc698c41b/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-259:{mountpoint:/var/lib/containers/storage/overlay/4ca71088a0ceba355ced1e04f70f70ce2bbdb2c6af435f1bdbc57044003e33e8/merged major:0 minor:259 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/0a1ef93140c5b6a12953f2b42786695d0884c73d083bddac4233ff5d5eab1408/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/e87318d92677b5b2cb4102fb3198e991430d2513960046a280a37dcfda7e51fb/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/57973835691b303eff31ea0117507cb64bcf7e011231d0f5644517fa98c66c12/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/d9d89f483169306f2881abf5153d2975b723aa144b1110b511e245660864c6b7/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/1ceb4ddc32768fc558a8d574bc9c569379b7a690f00482a740b16e478b23e519/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/8fd6f2525039e4eb56f82bbfda92715271eb7452c5f490e996a28bd6be5cac33/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/f26a4568c1a318ced067e4fc2e068a1a9c54ca64c5cd03c2e87ba5d51c6902db/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/b3ac768c4182cc1fb8179ae2d3aa991d196697b724205ee85569284fdd94a382/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/f9587eff4ee4f9dd9a44e363ed2e07208da6124d52772f601784a835f7854b74/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/ea8f3bf5644a331b016e8a212faed6d4beacfad8a572dbdd16cac9eeec9d6f0e/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.140563    4522 manager.go:217] Machine: {Timestamp:2026-10-30 21:11:31.140107164 +0000 UTC m=+0.085052516 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3206670 MemoryCapacity:33164328960 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25f323b414f8eaa886af0e2c5fa445 SystemUUID:ec25f323-b414-f8ea-a886-af0e2c5fa445 BootID:28efbb58-9158-4657-a7d7-7dde52667f67 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ad9cdf4d7bf1cd250086bc58198518185e96ad68875e6bfd405291bb078f7127/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/be77c0837462e287f57629efb8f5eeb87248c21a3314b443364d0b88f78436d9/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1021434f3359e89cd5975676cca7aeb6b2b577d56e443822a2955cd26745ca9d/userdata/shm DeviceMajor:0 DeviceMinor:225 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-239 DeviceMajor:0 DeviceMinor:239 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/886735ce-b78e-4b99-898d-35d295a1b059/volumes/kubernetes.io~projected/kube-api-access-74jsm DeviceMajor:0 DeviceMinor:65 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ad7bc466ca5f0a7737d7b01aaa2de119bb2319b8ebaec429632228e57b395281/userdata/shm DeviceMajor:0 DeviceMinor:85 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/813c6690ba4f95b19636bc400c7adfa0cc1ec08139b4baf443b90b5530e52310/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/886735ce-b78e-4b99-898d-35d295a1b059/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-204 DeviceMajor:0 DeviceMinor:204 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6de535fe-3a22-40e2-9a24-86fcc6292b0f/volumes/kubernetes.io~projected/kube-api-access-ng8xl DeviceMajor:0 DeviceMinor:206 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/727c7f03904328d8f776bda34045b36787e93cb7d28fe4e0748b643d4c61b99d/userdata/shm DeviceMajor:0 DeviceMinor:211 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/817af4fbe3a45d5618690e11abe622318b68cfcd04110847a5450a969d40f402/userdata/shm DeviceMajor:0 DeviceMinor:231 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/1d1ae5a7-dbca-4614-bd43-3ed9e0558360/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:57 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/1d1ae5a7-dbca-4614-bd43-3ed9e0558360/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:58 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1fe5a71f85fc8db891d79c8bc8bb5e141a36109f9098cf07d312ace4f1914ae1/userdata/shm DeviceMajor:0 DeviceMinor:93 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3f3d6657-b9dd-4d70-889a-e480fa537ed9/volumes/kubernetes.io~projected/kube-api-access-j8tpp DeviceMajor:0 DeviceMinor:207 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9095843d-0f41-4363-9bd3-d7516c532136/volumes/kubernetes.io~projected/kube-api-access-95b8w DeviceMajor:0 DeviceMinor:66 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9f5c138e0c1d7514d203a5bea8f272e9375f1a560bf5e9cc7adf77f5e1813437/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f45e917f6fa87b655405487f479cf3a5007a2acac742f72a2df6abac3b8890cd/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-146 DeviceMajor:0 DeviceMinor:146 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-259 DeviceMajor:0 DeviceMinor:259 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d67402d3-89aa-453d-991b-56606214dfa4/volumes/kubernetes.io~projected/kube-api-access-pps44 DeviceMajor:0 DeviceMinor:61 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/45d347ba-b99f-402d-92e2-db767c723fab/volumes/kubernetes.io~projected/kube-api-access-dxpxg DeviceMajor:0 DeviceMinor:197 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-227 DeviceMajor:0 DeviceMinor:227 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6626e30d-3f05-406c-8ea5-5329ea58dd07/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/30816de148a53d3654acad16df62ba7a410e916e8c30526de5fe5e0348f55302/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/98687aa443f1ff713e30c86b4f0b4fede556b4bafcaec598b1b8f273742f7851/userdata/shm DeviceMajor:0 DeviceMinor:202 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4fbf222cc1cd35e2e1f4abd0d6ef7e59a9b24249a49d6940e24de9fa05197160/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b0855c11-d0dc-4d51-92a9-3913d9946069/volumes/kubernetes.io~projected/kube-api-access-x7nf7 DeviceMajor:0 DeviceMinor:201 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-241 DeviceMajor:0 DeviceMinor:241 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1d1ae5a7-dbca-4614-bd43-3ed9e0558360/volumes/kubernetes.io~projected/kube-api-access-wc5ds DeviceMajor:0 DeviceMinor:60 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7103501cdaf6df86cd317e1d49d96a4b2defa5b8bd036c548c754a3c43f7de98/userdata/shm DeviceMajor:0 DeviceMinor:210 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/de7df116-a968-473a-85b7-cd508eb8edc5/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:229 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582164480 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/886735ce-b78e-4b99-898d-35d295a1b059/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:56 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf/volumes/kubernetes.io~projected/kube-api-access-25hjt DeviceMajor:0 DeviceMinor:64 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/45d347ba-b99f-402d-92e2-db767c723fab/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/32468c74-2a0c-4a3b-a073-98961fc3ffd6/volumes/kubernetes.io~projected/kube-api-access-mkx85 DeviceMajor:0 DeviceMinor:230 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/20e119dcb3f1feb5b6224fb958bde387c2c7d70f8178077605e62a420a51d425/userdata/shm DeviceMajor:0 DeviceMinor:233 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-247 DeviceMajor:0 DeviceMinor:247 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-235 DeviceMajor:0 DeviceMinor:235 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b0f88e16-68d7-49b8-b50a-29786cf11a17/volumes/kubernetes.io~projected/kube-api-access-jkt57 DeviceMajor:0 DeviceMinor:62 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/f6c8d5f3-1059-4847-ad18-af3750c7c7e8/volumes/kubernetes.io~projected/kube-api-access-9sc76 DeviceMajor:0 DeviceMinor:63 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b22257b3-075e-4545-abac-4d37820d073e/volumes/kubernetes.io~projected/kube-api-access-8h4ts DeviceMajor:0 DeviceMinor:224 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-237 DeviceMajor:0 DeviceMinor:237 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b22257b3-075e-4545-abac-4d37820d073e/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:219 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/63613ac19e2dc81451369e07858ab1af26cb8523a4a488e625e967c293753adf/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ca23ae9d-6ade-4f64-ba4c-a77e7ad9f639/volumes/kubernetes.io~projected/kube-api-access-669nt DeviceMajor:0 DeviceMinor:208 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/46c8ff3a-870d-4939-94f3-8c73beab6ecb/volumes/kubernetes.io~projected/kube-api-access-n4jsr DeviceMajor:0 DeviceMinor:59 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/47c8f18e-4ca1-413e-b665-d4b4a51dcab4/volumes/kubernetes.io~projected/kube-api-access-5lkhv DeviceMajor:0 DeviceMinor:67 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:1021434f3359e89 MacAddress:4e:34:b3:bd:6a:f1 Speed:10000 Mtu:8901} {Name:20e119dcb3f1feb MacAddress:62:93:9e:94:cd:cc Speed:10000 Mtu:8901} {Name:7103501cdaf6df8 MacAddress:32:90:a3:8e:44:21 Speed:10000 Mtu:8901} {Name:727c7f03904328d MacAddress:e2:12:21:b6:f7:38 Speed:10000 Mtu:8901} {Name:817af4fbe3a45d5 MacAddress:f2:89:9d:43:d8:87 Speed:10000 Mtu:8901} {Name:98687aa443f1ff7 MacAddress:86:91:a8:0b:1a:cf Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:41:10:d8:d2:81 Speed:0 Mtu:9001} {Name:br-int MacAddress:9a:e1:16:c1:08:4e Speed:0 Mtu:8901} {Name:ens5 MacAddress:02:41:10:d8:d2:81 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:16:8e:be:66:7e:a1 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:5e:83:a5:3d:91:95 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164328960 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.140804    4522 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.140843    4522 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.141056    4522 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.141086    4522 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-237.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.141203    4522 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.141211    4522 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.141224    4522 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.141236    4522 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.141308    4522 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.141452    4522 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.141569    4522 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.141602    4522 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.141619    4522 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.141639    4522 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.141651    4522 kubelet.go:405] "Adding apiserver pod source"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.141661    4522 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.143052    4522 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.143068    4522 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.143663    4522 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.145832    4522 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.145842    4522 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.145948    4522 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.146117    4522 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.146143    4522 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.146230    4522 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.146247    4522 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 21:11:31.146240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.146258    4522 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 21:11:31.147398 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.146269    4522 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 21:11:31.147398 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.146276    4522 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 21:11:31.147398 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.146281    4522 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 21:11:31.147398 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.146287    4522 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 21:11:31.147398 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.146293    4522 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 21:11:31.147398 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.146299    4522 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 21:11:31.147398 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.146306    4522 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 21:11:31.147398 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.146326    4522 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 21:11:31.147398 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.146339    4522 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 21:11:31.147398 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.146365    4522 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 21:11:31.147398 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.146374    4522 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 21:11:31.149671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.149657    4522 server.go:1263] "Started kubelet"
Oct 30 21:11:31.149770 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.149726    4522 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 21:11:31.149820 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.149757    4522 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 21:11:31.149863 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.149826    4522 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 21:11:31.150167 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.150107    4522 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 21:11:31.150213 ip-10-0-142-237 systemd[1]: Started Kubernetes Kubelet.
Oct 30 21:11:31.151255 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.151230    4522 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 21:11:31.152435 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.152416    4522 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 21:11:31.154756 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.152442    4522 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 21:11:31.154756 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.152517    4522 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 21:11:31.154756 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.152529    4522 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 21:11:31.154756 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:31.152602    4522 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-237.us-west-1.compute.internal\" not found"
Oct 30 21:11:31.154756 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.152826    4522 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:05:52 +0000 UTC" deadline="2028-07-21 03:19:05.053246636 +0000 UTC"
Oct 30 21:11:31.154756 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.152891    4522 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15102h7m33.900359377s"
Oct 30 21:11:31.154756 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.152921    4522 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 21:11:31.155267 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.155252    4522 factory.go:55] Registering systemd factory
Oct 30 21:11:31.155323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.155272    4522 factory.go:223] Registration of the systemd container factory successfully
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.155683    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0855c11-d0dc-4d51-92a9-3913d9946069" volumeName="kubernetes.io/projected/b0855c11-d0dc-4d51-92a9-3913d9946069-kube-api-access-x7nf7" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.155715    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6626e30d-3f05-406c-8ea5-5329ea58dd07" volumeName="kubernetes.io/configmap/6626e30d-3f05-406c-8ea5-5329ea58dd07-konnectivity-ca" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.155729    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="886735ce-b78e-4b99-898d-35d295a1b059" volumeName="kubernetes.io/secret/886735ce-b78e-4b99-898d-35d295a1b059-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.155750    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b22257b3-075e-4545-abac-4d37820d073e" volumeName="kubernetes.io/configmap/b22257b3-075e-4545-abac-4d37820d073e-signing-cabundle" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.155762    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ca23ae9d-6ade-4f64-ba4c-a77e7ad9f639" volumeName="kubernetes.io/projected/ca23ae9d-6ade-4f64-ba4c-a77e7ad9f639-kube-api-access-669nt" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.155784    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d67402d3-89aa-453d-991b-56606214dfa4" volumeName="kubernetes.io/configmap/d67402d3-89aa-453d-991b-56606214dfa4-iptables-alerter-script" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.155796    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d67402d3-89aa-453d-991b-56606214dfa4" volumeName="kubernetes.io/projected/d67402d3-89aa-453d-991b-56606214dfa4-kube-api-access-pps44" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.155807    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6626e30d-3f05-406c-8ea5-5329ea58dd07" volumeName="kubernetes.io/secret/6626e30d-3f05-406c-8ea5-5329ea58dd07-agent-certs" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.155822    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="886735ce-b78e-4b99-898d-35d295a1b059" volumeName="kubernetes.io/configmap/886735ce-b78e-4b99-898d-35d295a1b059-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.155853    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9095843d-0f41-4363-9bd3-d7516c532136" volumeName="kubernetes.io/configmap/9095843d-0f41-4363-9bd3-d7516c532136-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.155884    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0855c11-d0dc-4d51-92a9-3913d9946069" volumeName="kubernetes.io/empty-dir/b0855c11-d0dc-4d51-92a9-3913d9946069-tmp-dir" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.155903    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b22257b3-075e-4545-abac-4d37820d073e" volumeName="kubernetes.io/projected/b22257b3-075e-4545-abac-4d37820d073e-kube-api-access-8h4ts" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.155915    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6de535fe-3a22-40e2-9a24-86fcc6292b0f" volumeName="kubernetes.io/configmap/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.155934    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9095843d-0f41-4363-9bd3-d7516c532136" volumeName="kubernetes.io/configmap/9095843d-0f41-4363-9bd3-d7516c532136-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.155965    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="32468c74-2a0c-4a3b-a073-98961fc3ffd6" volumeName="kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.155983    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3f3d6657-b9dd-4d70-889a-e480fa537ed9" volumeName="kubernetes.io/configmap/3f3d6657-b9dd-4d70-889a-e480fa537ed9-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.155995    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3f3d6657-b9dd-4d70-889a-e480fa537ed9" volumeName="kubernetes.io/empty-dir/3f3d6657-b9dd-4d70-889a-e480fa537ed9-archives-path" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156227    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="886735ce-b78e-4b99-898d-35d295a1b059" volumeName="kubernetes.io/configmap/886735ce-b78e-4b99-898d-35d295a1b059-env-overrides" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156250    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9095843d-0f41-4363-9bd3-d7516c532136" volumeName="kubernetes.io/configmap/9095843d-0f41-4363-9bd3-d7516c532136-cni-binary-copy" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156264    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f6c8d5f3-1059-4847-ad18-af3750c7c7e8" volumeName="kubernetes.io/projected/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-kube-api-access-9sc76" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156283    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf" volumeName="kubernetes.io/projected/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-kube-api-access-25hjt" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156312    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1d1ae5a7-dbca-4614-bd43-3ed9e0558360" volumeName="kubernetes.io/empty-dir/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-tmp" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156338    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3f3d6657-b9dd-4d70-889a-e480fa537ed9" volumeName="kubernetes.io/configmap/3f3d6657-b9dd-4d70-889a-e480fa537ed9-service-ca-bundle" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156370    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="45d347ba-b99f-402d-92e2-db767c723fab" volumeName="kubernetes.io/secret/45d347ba-b99f-402d-92e2-db767c723fab-cert" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156382    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="46c8ff3a-870d-4939-94f3-8c73beab6ecb" volumeName="kubernetes.io/projected/46c8ff3a-870d-4939-94f3-8c73beab6ecb-kube-api-access-n4jsr" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156423    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="47c8f18e-4ca1-413e-b665-d4b4a51dcab4" volumeName="kubernetes.io/projected/47c8f18e-4ca1-413e-b665-d4b4a51dcab4-kube-api-access-5lkhv" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156436    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="886735ce-b78e-4b99-898d-35d295a1b059" volumeName="kubernetes.io/configmap/886735ce-b78e-4b99-898d-35d295a1b059-ovnkube-config" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156443    4522 factory.go:153] Registering CRI-O factory
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156477    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0855c11-d0dc-4d51-92a9-3913d9946069" volumeName="kubernetes.io/configmap/b0855c11-d0dc-4d51-92a9-3913d9946069-config-volume" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156517    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf" volumeName="kubernetes.io/configmap/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-daemon-config" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156541    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf" volumeName="kubernetes.io/configmap/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-cni-binary-copy" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156580    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3f3d6657-b9dd-4d70-889a-e480fa537ed9" volumeName="kubernetes.io/projected/3f3d6657-b9dd-4d70-889a-e480fa537ed9-kube-api-access-j8tpp" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156606    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0f88e16-68d7-49b8-b50a-29786cf11a17" volumeName="kubernetes.io/projected/b0f88e16-68d7-49b8-b50a-29786cf11a17-kube-api-access-jkt57" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156621    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b22257b3-075e-4545-abac-4d37820d073e" volumeName="kubernetes.io/secret/b22257b3-075e-4545-abac-4d37820d073e-signing-key" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156648    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="de7df116-a968-473a-85b7-cd508eb8edc5" volumeName="kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156660    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1d1ae5a7-dbca-4614-bd43-3ed9e0558360" volumeName="kubernetes.io/projected/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-kube-api-access-wc5ds" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156682    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="47c8f18e-4ca1-413e-b665-d4b4a51dcab4" volumeName="kubernetes.io/configmap/47c8f18e-4ca1-413e-b665-d4b4a51dcab4-serviceca" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156699    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="886735ce-b78e-4b99-898d-35d295a1b059" volumeName="kubernetes.io/projected/886735ce-b78e-4b99-898d-35d295a1b059-kube-api-access-74jsm" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156730    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0f88e16-68d7-49b8-b50a-29786cf11a17" volumeName="kubernetes.io/empty-dir/b0f88e16-68d7-49b8-b50a-29786cf11a17-tmp-dir" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156754    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1d1ae5a7-dbca-4614-bd43-3ed9e0558360" volumeName="kubernetes.io/empty-dir/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-tuned" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156774    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="45d347ba-b99f-402d-92e2-db767c723fab" volumeName="kubernetes.io/projected/45d347ba-b99f-402d-92e2-db767c723fab-kube-api-access-dxpxg" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156785    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6de535fe-3a22-40e2-9a24-86fcc6292b0f" volumeName="kubernetes.io/empty-dir/6de535fe-3a22-40e2-9a24-86fcc6292b0f-data-volume" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156813    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6de535fe-3a22-40e2-9a24-86fcc6292b0f" volumeName="kubernetes.io/projected/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-api-access-ng8xl" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156824    4522 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9095843d-0f41-4363-9bd3-d7516c532136" volumeName="kubernetes.io/projected/9095843d-0f41-4363-9bd3-d7516c532136-kube-api-access-95b8w" seLinuxMountContext=""
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156834    4522 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156841    4522 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 21:11:31.156881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.156479    4522 factory.go:223] Registration of the crio container factory successfully
Oct 30 21:11:31.159447 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.157074    4522 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 21:11:31.159447 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.157099    4522 factory.go:103] Registering Raw factory
Oct 30 21:11:31.159447 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.157118    4522 manager.go:1199] Started watching for new ooms in manager
Oct 30 21:11:31.159447 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.157560    4522 manager.go:319] Starting recovery of all containers
Oct 30 21:11:31.175481 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.175138    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:11:31.175481 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.175451    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:11:31.181826 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.181773    4522 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 21:11:31.184653 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.184628    4522 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 21:11:31.184737 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.184666    4522 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 21:11:31.184737 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.184694    4522 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 21:11:31.184844 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:31.184746    4522 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 21:11:31.194321 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.194300    4522 generic.go:356] "Generic (PLEG): container finished" podID="9095843d-0f41-4363-9bd3-d7516c532136" containerID="6513e996e0fb989c365c541c1533ce484b8ebd5ad4b24355afc99e4b6056eafe" exitCode=0
Oct 30 21:11:31.194321 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.194318    4522 generic.go:356] "Generic (PLEG): container finished" podID="9095843d-0f41-4363-9bd3-d7516c532136" containerID="8f1710d6f8bf7cc5d9825d7e0ad33009d06af79cfd9d5ce46ee58ea943ef178b" exitCode=0
Oct 30 21:11:31.194492 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.194326    4522 generic.go:356] "Generic (PLEG): container finished" podID="9095843d-0f41-4363-9bd3-d7516c532136" containerID="9660eb1ef337716bde8ca9e6bcc55c36a9c92d441fbc2b313e20254ff7d27b37" exitCode=0
Oct 30 21:11:31.194492 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.194333    4522 generic.go:356] "Generic (PLEG): container finished" podID="9095843d-0f41-4363-9bd3-d7516c532136" containerID="7b68f754274e4c2f753984f7a82af1edf876a949d952cdfed0fb9ab08c6891c2" exitCode=0
Oct 30 21:11:31.194492 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.194340    4522 generic.go:356] "Generic (PLEG): container finished" podID="9095843d-0f41-4363-9bd3-d7516c532136" containerID="224451de2094648c564cbe6c55a885aaec9fe5d5eab3c9d0cdad731809fb97c4" exitCode=0
Oct 30 21:11:31.194492 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.194345    4522 generic.go:356] "Generic (PLEG): container finished" podID="9095843d-0f41-4363-9bd3-d7516c532136" containerID="ccbe3bb8f36e954d980d89c202f4619b141486ea23897cd449bcd96dfa4da44e" exitCode=0
Oct 30 21:11:31.210573 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.210550    4522 generic.go:356] "Generic (PLEG): container finished" podID="bad8c0bc4ce6ec32ae0c638173a27350" containerID="ed704fc6f5192224465bcc9fb13e10085a4917efa184135ce7e692b67af20fc2" exitCode=0
Oct 30 21:11:31.218559 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.218540    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:11:31.218926 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.218903    4522 generic.go:356] "Generic (PLEG): container finished" podID="886735ce-b78e-4b99-898d-35d295a1b059" containerID="ac4944d2452f676a3ac844b35def1139164075bc952a292f68c3012e21147cff" exitCode=1
Oct 30 21:11:31.226910 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.226896    4522 manager.go:324] Recovery completed
Oct 30 21:11:31.241084 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.241066    4522 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:11:31.242058 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.242043    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:11:31.242124 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.242070    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:11:31.242124 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.242083    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:11:31.243353 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.243333    4522 cpu_manager.go:226] "Starting" policy="none"
Oct 30 21:11:31.243353 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.243350    4522 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 21:11:31.243500 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.243374    4522 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 21:11:31.243500 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.243399    4522 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:11:31.243610 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.243518    4522 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 21:11:31.243610 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.243534    4522 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 21:11:31.243610 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.243556    4522 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 21:11:31.243610 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.243563    4522 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 21:11:31.243610 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.243572    4522 policy_none.go:50] "Start"
Oct 30 21:11:31.243610 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.243585    4522 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 21:11:31.243610 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.243608    4522 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 21:11:31.243849 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.243729    4522 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 21:11:31.243849 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.243735    4522 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 21:11:31.243849 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.243741    4522 policy_none.go:44] "Start"
Oct 30 21:11:31.244216 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.244194    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:11:31.244295 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.244227    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:11:31.244295 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.244242    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:11:31.247845 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.247822    4522 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 21:11:31.250814 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.250802    4522 manager.go:341] "Starting Device Plugin manager"
Oct 30 21:11:31.250872 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:31.250825    4522 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 21:11:31.250872 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.250834    4522 server.go:87] "Starting device plugin registration server"
Oct 30 21:11:31.251065 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.251054    4522 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 21:11:31.251096 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.251067    4522 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 21:11:31.251174 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.251156    4522 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 21:11:31.251285 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.251247    4522 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 21:11:31.251347 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.251287    4522 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 21:11:31.251347 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.251292    4522 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 21:11:31.251417 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.251343    4522 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T21:11:31.251279535Z","UUID":"c41b73ec-4539-4e85-abfd-8a3a79fcf63a","Handler":null,"Name":"","Endpoint":""}
Oct 30 21:11:31.252493 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:31.252475    4522 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 21:11:31.252570 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:31.252515    4522 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-237.us-west-1.compute.internal\" not found"
Oct 30 21:11:31.252630 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.252610    4522 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 21:11:31.252630 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.252630    4522 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 21:11:31.285973 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.285506    4522 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal"]
Oct 30 21:11:31.286038 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.286020    4522 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:11:31.286765 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.286746    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:11:31.286836 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.286774    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:11:31.286836 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.286783    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:11:31.286989 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.286980    4522 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:11:31.287122 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.287109    4522 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:11:31.287679 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.287663    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:11:31.287679 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.287674    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:11:31.287679 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.287683    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:11:31.287834 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.287691    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:11:31.287834 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.287692    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:11:31.287834 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.287703    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:11:31.287908 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:31.287836    4522 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-237.us-west-1.compute.internal\" not found" node="ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:31.287935 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.287908    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal" event={"ID":"f52de7228915512f349d24482d38315b","Type":"ContainerStarted","Data":"ab822b46944724815609b760bdd872982d5948384a3cdfa84aa5524bce974501"}
Oct 30 21:11:31.287967 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.287937    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal" event={"ID":"f52de7228915512f349d24482d38315b","Type":"ContainerStarted","Data":"ad9cdf4d7bf1cd250086bc58198518185e96ad68875e6bfd405291bb078f7127"}
Oct 30 21:11:31.288038 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.287965    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal" event={"ID":"bad8c0bc4ce6ec32ae0c638173a27350","Type":"ContainerStarted","Data":"8cb2b3960abd134672edb22f089d347eb627f6e3fcfe5ff86b3165ef7aa79af2"}
Oct 30 21:11:31.288038 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.287978    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal" event={"ID":"bad8c0bc4ce6ec32ae0c638173a27350","Type":"ContainerDied","Data":"ed704fc6f5192224465bcc9fb13e10085a4917efa184135ce7e692b67af20fc2"}
Oct 30 21:11:31.288038 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.287991    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal" event={"ID":"bad8c0bc4ce6ec32ae0c638173a27350","Type":"ContainerStarted","Data":"813c6690ba4f95b19636bc400c7adfa0cc1ec08139b4baf443b90b5530e52310"}
Oct 30 21:11:31.288038 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.288000    4522 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:11:31.288670 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.288657    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:11:31.288731 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.288677    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:11:31.288731 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.288691    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:11:31.288933 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:31.288793    4522 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-237.us-west-1.compute.internal\" not found" node="ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:31.350655 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.350629    4522 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:11:31.350797 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.350774    4522 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 21:11:31.351141 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.351113    4522 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:11:31.351220 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.351141    4522 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:11:31.351304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.351290    4522 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:11:31.351941 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.351925    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:11:31.352006 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.351950    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:11:31.352006 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.351960    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:11:31.352006 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.351987    4522 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:31.354085 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.354071    4522 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:31.400675 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.400657    4522 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:11:31.450896 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.450862    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bad8c0bc4ce6ec32ae0c638173a27350-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal\" (UID: \"bad8c0bc4ce6ec32ae0c638173a27350\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:31.450896 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.450898    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bad8c0bc4ce6ec32ae0c638173a27350-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal\" (UID: \"bad8c0bc4ce6ec32ae0c638173a27350\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:31.451023 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.450917    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f52de7228915512f349d24482d38315b-config\") pod \"kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal\" (UID: \"f52de7228915512f349d24482d38315b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:31.460547 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.460528    4522 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:11:31.460628 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:31.460560    4522 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:31.460628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.460570    4522 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:31.492583 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.492563    4522 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:31.492670 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.492615    4522 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:31.493129 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.493115    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeNotReady"
Oct 30 21:11:31.493163 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.493143    4522 setters.go:546] "Node became not ready" node="ip-10-0-142-237.us-west-1.compute.internal" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-10-30T21:11:31Z","lastTransitionTime":"2026-10-30T21:11:31Z","reason":"KubeletNotReady","message":"CSINode is not yet initialized"}
Oct 30 21:11:31.511976 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.511956    4522 nodeinfomanager.go:471] existing CSINode "ip-10-0-142-237.us-west-1.compute.internal" is owned by different node (oldNodeID="b91d7448-485a-4d02-92f7-e2ee5c4ef097", newNodeID=""), cleaning up...
Oct 30 21:11:31.517695 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.517673    4522 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:11:31.517761 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:31.517715    4522 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:31.551246 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.551200    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bad8c0bc4ce6ec32ae0c638173a27350-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal\" (UID: \"bad8c0bc4ce6ec32ae0c638173a27350\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:31.551246 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.551225    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bad8c0bc4ce6ec32ae0c638173a27350-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal\" (UID: \"bad8c0bc4ce6ec32ae0c638173a27350\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:31.551246 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.551241    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f52de7228915512f349d24482d38315b-config\") pod \"kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal\" (UID: \"f52de7228915512f349d24482d38315b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:31.551371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.551279    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f52de7228915512f349d24482d38315b-config\") pod \"kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal\" (UID: \"f52de7228915512f349d24482d38315b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:31.551371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.551311    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bad8c0bc4ce6ec32ae0c638173a27350-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal\" (UID: \"bad8c0bc4ce6ec32ae0c638173a27350\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:31.551371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:31.551312    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bad8c0bc4ce6ec32ae0c638173a27350-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal\" (UID: \"bad8c0bc4ce6ec32ae0c638173a27350\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:32.141947 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.141924    4522 apiserver.go:52] "Watching apiserver"
Oct 30 21:11:32.222391 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.222340    4522 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:32.252002 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.251976    4522 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 21:11:32.252448 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.252425    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal","openshift-kube-storage-version-migrator/migrator-66df5d496b-kv82x","openshift-dns/node-resolver-lzdr5","openshift-image-registry/node-ca-5548s","openshift-network-operator/iptables-alerter-wlqbw","kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal","openshift-cluster-node-tuning-operator/tuned-tnk8v","openshift-insights/insights-runtime-extractor-p9vq8","kube-system/konnectivity-agent-ttsq4","openshift-multus/multus-additional-cni-plugins-58btz","openshift-dns/dns-default-9nf28","kube-system/global-pull-secret-syncer-6gs88","openshift-network-diagnostics/network-check-target-m4t5j","openshift-insights/periodic-gathering-8nc9h-csrmt","openshift-service-ca/service-ca-5fffc97bdf-64r42","openshift-ingress-canary/ingress-canary-cvjpd","openshift-multus/multus-cx7lm","openshift-multus/network-metrics-daemon-58v4c","openshift-ovn-kubernetes/ovnkube-node-8vk2q","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"]
Oct 30 21:11:32.256313 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.256289    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkx85\" (UniqueName: \"kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85\") pod \"network-check-target-m4t5j\" (UID: \"32468c74-2a0c-4a3b-a073-98961fc3ffd6\") " pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:32.256426 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.256325    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0f88e16-68d7-49b8-b50a-29786cf11a17-tmp-dir\") pod \"node-resolver-lzdr5\" (UID: \"b0f88e16-68d7-49b8-b50a-29786cf11a17\") " pod="openshift-dns/node-resolver-lzdr5"
Oct 30 21:11:32.256426 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.256354    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkt57\" (UniqueName: \"kubernetes.io/projected/b0f88e16-68d7-49b8-b50a-29786cf11a17-kube-api-access-jkt57\") pod \"node-resolver-lzdr5\" (UID: \"b0f88e16-68d7-49b8-b50a-29786cf11a17\") " pod="openshift-dns/node-resolver-lzdr5"
Oct 30 21:11:32.256426 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.256383    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-sysctl-d\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.256426 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.256356    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:32.256714 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.256413    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-host\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.256714 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.256451    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0f88e16-68d7-49b8-b50a-29786cf11a17-tmp-dir\") pod \"node-resolver-lzdr5\" (UID: \"b0f88e16-68d7-49b8-b50a-29786cf11a17\") " pod="openshift-dns/node-resolver-lzdr5"
Oct 30 21:11:32.257082 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.257058    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-kubernetes\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.257174 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.257100    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-run\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.257174 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.257127    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0f88e16-68d7-49b8-b50a-29786cf11a17-hosts-file\") pod \"node-resolver-lzdr5\" (UID: \"b0f88e16-68d7-49b8-b50a-29786cf11a17\") " pod="openshift-dns/node-resolver-lzdr5"
Oct 30 21:11:32.257290 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.257187    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-modprobe-d\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.257290 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.257232    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-sysconfig\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.257290 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.257265    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-sys\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.257410 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.257308    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-lib-modules\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.257410 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.257350    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-var-lib-kubelet\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.257410 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.257401    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-tuned\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.257535 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.257472    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-tmp\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.257535 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.257512    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-sysctl-conf\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.257599 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.257543    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-systemd\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.257636 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.257618    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc5ds\" (UniqueName: \"kubernetes.io/projected/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-kube-api-access-wc5ds\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.257949 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.257932    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-tmp\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.258009 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.257951    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-tuned\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.259439 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.259422    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:32.260477 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.260449    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:32.281518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.281500    4522 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:11:32.281583 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:32.281533    4522 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-237.us-west-1.compute.internal"
Oct 30 21:11:32.304970 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.304952    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 21:11:32.305929 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.305913    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xkwpv\""
Oct 30 21:11:32.305992 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.305931    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-swkpp\""
Oct 30 21:11:32.306156 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.306137    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-z8gbk\""
Oct 30 21:11:32.306156 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.306143    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zwgx7\""
Oct 30 21:11:32.306743 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.306729    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cb6bb\""
Oct 30 21:11:32.307644 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.307631    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-x9kft\""
Oct 30 21:11:32.329514 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.329501    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 21:11:32.329593 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.329578    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 21:11:32.332113 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.332091    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 21:11:32.332322 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.332307    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 21:11:32.332366 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.332346    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Oct 30 21:11:32.332366 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.332356    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t4qh6\""
Oct 30 21:11:32.332469 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.332352    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 21:11:32.332469 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.332385    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-tklwz\""
Oct 30 21:11:32.332579 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.332548    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 21:11:32.332579 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.332576    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qmnsm\""
Oct 30 21:11:32.332695 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.332576    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r8s65\""
Oct 30 21:11:32.332695 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.332616    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-mfb44\""
Oct 30 21:11:32.332695 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.332625    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-rvh9q\""
Oct 30 21:11:32.332695 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.332627    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-k8b2g\""
Oct 30 21:11:32.332695 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.332649    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-c2dlm\""
Oct 30 21:11:32.332842 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.332790    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 21:11:32.332842 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.332794    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wtj2v\""
Oct 30 21:11:32.332842 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.332831    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dssbm\""
Oct 30 21:11:32.332842 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.332833    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9zfm5\""
Oct 30 21:11:32.333273 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.333263    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 21:11:32.353318 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.353300    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-87wxx\""
Oct 30 21:11:32.354021 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.354009    4522 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 21:11:32.358159 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358145    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-slash\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.358210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358168    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs\") pod \"network-metrics-daemon-58v4c\" (UID: \"46c8ff3a-870d-4939-94f3-8c73beab6ecb\") " pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:32.358210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358185    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-cni-binary-copy\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.358210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358205    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:11:32.358298 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358287    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9095843d-0f41-4363-9bd3-d7516c532136-cnibin\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:11:32.358326 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358313    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/886735ce-b78e-4b99-898d-35d295a1b059-ovnkube-script-lib\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.358385 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358370    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0855c11-d0dc-4d51-92a9-3913d9946069-tmp-dir\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:32.358427 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358398    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-var-lib-kubelet\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.358470 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358427    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-systemd-units\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.358512 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358451    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-run-netns\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.358512 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358481    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-var-lib-kubelet\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.358512 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358483    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0855c11-d0dc-4d51-92a9-3913d9946069-tmp-dir\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:32.358512 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358492    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-socket-dir-parent\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.358630 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358524    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxpxg\" (UniqueName: \"kubernetes.io/projected/45d347ba-b99f-402d-92e2-db767c723fab-kube-api-access-dxpxg\") pod \"ingress-canary-cvjpd\" (UID: \"45d347ba-b99f-402d-92e2-db767c723fab\") " pod="openshift-ingress-canary/ingress-canary-cvjpd"
Oct 30 21:11:32.358630 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358560    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b22257b3-075e-4545-abac-4d37820d073e-signing-key\") pod \"service-ca-5fffc97bdf-64r42\" (UID: \"b22257b3-075e-4545-abac-4d37820d073e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-64r42"
Oct 30 21:11:32.358695 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358671    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95b8w\" (UniqueName: \"kubernetes.io/projected/9095843d-0f41-4363-9bd3-d7516c532136-kube-api-access-95b8w\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:11:32.358756 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358735    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-etc-openvswitch\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.358807 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358792    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3f3d6657-b9dd-4d70-889a-e480fa537ed9-archives-path\") pod \"periodic-gathering-8nc9h-csrmt\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") " pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:32.358855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358819    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-run-openvswitch\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.358855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358832    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3f3d6657-b9dd-4d70-889a-e480fa537ed9-archives-path\") pod \"periodic-gathering-8nc9h-csrmt\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") " pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:32.358855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358794    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b22257b3-075e-4545-abac-4d37820d073e-signing-key\") pod \"service-ca-5fffc97bdf-64r42\" (UID: \"b22257b3-075e-4545-abac-4d37820d073e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-64r42"
Oct 30 21:11:32.358855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358846    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4jsr\" (UniqueName: \"kubernetes.io/projected/46c8ff3a-870d-4939-94f3-8c73beab6ecb-kube-api-access-n4jsr\") pod \"network-metrics-daemon-58v4c\" (UID: \"46c8ff3a-870d-4939-94f3-8c73beab6ecb\") " pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:32.359034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358874    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-etc-kubernetes\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.359034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358899    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-kubernetes\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.359034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358935    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-run\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.359034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358966    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-run-k8s-cni-cncf-io\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.359034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358968    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-kubernetes\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.359034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.358984    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-conf-dir\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.359034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359001    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b0855c11-d0dc-4d51-92a9-3913d9946069-config-volume\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:32.359034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359020    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-run\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.359034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359028    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8tpp\" (UniqueName: \"kubernetes.io/projected/3f3d6657-b9dd-4d70-889a-e480fa537ed9-kube-api-access-j8tpp\") pod \"periodic-gathering-8nc9h-csrmt\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") " pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:32.359292 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359071    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-sys\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.359292 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359088    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-cni-bin\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.359292 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359125    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-sys\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.359292 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359148    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/886735ce-b78e-4b99-898d-35d295a1b059-ovn-node-metrics-cert\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.359292 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359168    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-system-cni-dir\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.359292 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359183    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-cni-dir\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.359292 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359197    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:32.359292 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359214    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-sysctl-conf\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.359292 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359269    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:32.359292 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359287    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/886735ce-b78e-4b99-898d-35d295a1b059-ovn-node-metrics-cert\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.359669 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359315    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.359669 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359344    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-run-netns\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.359669 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359368    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-sysctl-conf\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.359669 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359381    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-device-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:11:32.359669 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359407    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:32.359669 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359427    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-host\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.359669 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359473    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-host\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.359669 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359480    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng8xl\" (UniqueName: \"kubernetes.io/projected/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-api-access-ng8xl\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:32.359669 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359511    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-669nt\" (UniqueName: \"kubernetes.io/projected/ca23ae9d-6ade-4f64-ba4c-a77e7ad9f639-kube-api-access-669nt\") pod \"migrator-66df5d496b-kv82x\" (UID: \"ca23ae9d-6ade-4f64-ba4c-a77e7ad9f639\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-kv82x"
Oct 30 21:11:32.359669 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359540    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-run-systemd\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.359669 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359564    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-node-log\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.359669 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359602    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-cni-netd\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.359669 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359647    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sc76\" (UniqueName: \"kubernetes.io/projected/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-kube-api-access-9sc76\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:11:32.360118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359690    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0f88e16-68d7-49b8-b50a-29786cf11a17-hosts-file\") pod \"node-resolver-lzdr5\" (UID: \"b0f88e16-68d7-49b8-b50a-29786cf11a17\") " pod="openshift-dns/node-resolver-lzdr5"
Oct 30 21:11:32.360118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359711    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de7df116-a968-473a-85b7-cd508eb8edc5-original-pull-secret\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:32.360118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359717    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6de535fe-3a22-40e2-9a24-86fcc6292b0f-crio-socket\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:32.360118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359734    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0f88e16-68d7-49b8-b50a-29786cf11a17-hosts-file\") pod \"node-resolver-lzdr5\" (UID: \"b0f88e16-68d7-49b8-b50a-29786cf11a17\") " pod="openshift-dns/node-resolver-lzdr5"
Oct 30 21:11:32.360118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359745    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h4ts\" (UniqueName: \"kubernetes.io/projected/b22257b3-075e-4545-abac-4d37820d073e-kube-api-access-8h4ts\") pod \"service-ca-5fffc97bdf-64r42\" (UID: \"b22257b3-075e-4545-abac-4d37820d073e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-64r42"
Oct 30 21:11:32.360118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359772    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d67402d3-89aa-453d-991b-56606214dfa4-host-slash\") pod \"iptables-alerter-wlqbw\" (UID: \"d67402d3-89aa-453d-991b-56606214dfa4\") " pod="openshift-network-operator/iptables-alerter-wlqbw"
Oct 30 21:11:32.360118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359813    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9095843d-0f41-4363-9bd3-d7516c532136-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:11:32.360118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359835    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-var-lib-openvswitch\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.360118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359852    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/886735ce-b78e-4b99-898d-35d295a1b059-ovnkube-config\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.360118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359868    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-lib-modules\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.360118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359902    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45d347ba-b99f-402d-92e2-db767c723fab-cert\") pod \"ingress-canary-cvjpd\" (UID: \"45d347ba-b99f-402d-92e2-db767c723fab\") " pod="openshift-ingress-canary/ingress-canary-cvjpd"
Oct 30 21:11:32.360118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359920    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-cnibin\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.360118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359963    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-var-lib-cni-bin\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.360118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.359982    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-var-lib-kubelet\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.360118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360026    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-lib-modules\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.360118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360048    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-daemon-config\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.360118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360087    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-socket-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:11:32.360118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360109    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6de535fe-3a22-40e2-9a24-86fcc6292b0f-data-volume\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:32.360597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360142    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45d347ba-b99f-402d-92e2-db767c723fab-cert\") pod \"ingress-canary-cvjpd\" (UID: \"45d347ba-b99f-402d-92e2-db767c723fab\") " pod="openshift-ingress-canary/ingress-canary-cvjpd"
Oct 30 21:11:32.360597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360168    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6de535fe-3a22-40e2-9a24-86fcc6292b0f-data-volume\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:32.360597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360206    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pps44\" (UniqueName: \"kubernetes.io/projected/d67402d3-89aa-453d-991b-56606214dfa4-kube-api-access-pps44\") pod \"iptables-alerter-wlqbw\" (UID: \"d67402d3-89aa-453d-991b-56606214dfa4\") " pod="openshift-network-operator/iptables-alerter-wlqbw"
Oct 30 21:11:32.360597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360266    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9095843d-0f41-4363-9bd3-d7516c532136-tuning-conf-dir\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:11:32.360597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360299    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9095843d-0f41-4363-9bd3-d7516c532136-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:11:32.360597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360328    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/886735ce-b78e-4b99-898d-35d295a1b059-env-overrides\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.360597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360366    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-registration-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:11:32.360597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360406    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-etc-selinux\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:11:32.360597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360435    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9095843d-0f41-4363-9bd3-d7516c532136-cni-binary-copy\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:11:32.360597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360483    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-run-ovn\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.360597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360508    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-log-socket\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.360597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360530    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-run-multus-certs\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.360597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360564    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-sys-fs\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:11:32.360597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360586    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/de7df116-a968-473a-85b7-cd508eb8edc5-kubelet-config\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:32.360975 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360601    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/de7df116-a968-473a-85b7-cd508eb8edc5-dbus\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:32.360975 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360643    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47c8f18e-4ca1-413e-b665-d4b4a51dcab4-serviceca\") pod \"node-ca-5548s\" (UID: \"47c8f18e-4ca1-413e-b665-d4b4a51dcab4\") " pod="openshift-image-registry/node-ca-5548s"
Oct 30 21:11:32.360975 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360670    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d67402d3-89aa-453d-991b-56606214dfa4-iptables-alerter-script\") pod \"iptables-alerter-wlqbw\" (UID: \"d67402d3-89aa-453d-991b-56606214dfa4\") " pod="openshift-network-operator/iptables-alerter-wlqbw"
Oct 30 21:11:32.360975 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360688    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9095843d-0f41-4363-9bd3-d7516c532136-system-cni-dir\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:11:32.360975 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360731    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6626e30d-3f05-406c-8ea5-5329ea58dd07-konnectivity-ca\") pod \"konnectivity-agent-ttsq4\" (UID: \"6626e30d-3f05-406c-8ea5-5329ea58dd07\") " pod="kube-system/konnectivity-agent-ttsq4"
Oct 30 21:11:32.360975 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360762    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7nf7\" (UniqueName: \"kubernetes.io/projected/b0855c11-d0dc-4d51-92a9-3913d9946069-kube-api-access-x7nf7\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:32.360975 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360801    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3d6657-b9dd-4d70-889a-e480fa537ed9-trusted-ca-bundle\") pod \"periodic-gathering-8nc9h-csrmt\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") " pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:32.360975 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360924    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-modprobe-d\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.360975 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360963    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-sysconfig\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.361204 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.360999    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b22257b3-075e-4545-abac-4d37820d073e-signing-cabundle\") pod \"service-ca-5fffc97bdf-64r42\" (UID: \"b22257b3-075e-4545-abac-4d37820d073e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-64r42"
Oct 30 21:11:32.361204 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.361017    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-modprobe-d\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.361204 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.361024    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-sysconfig\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.361204 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.361026    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-kubelet\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.361204 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.361073    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6626e30d-3f05-406c-8ea5-5329ea58dd07-agent-certs\") pod \"konnectivity-agent-ttsq4\" (UID: \"6626e30d-3f05-406c-8ea5-5329ea58dd07\") " pod="kube-system/konnectivity-agent-ttsq4"
Oct 30 21:11:32.361204 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.361093    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-var-lib-cni-multus\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.361204 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.361108    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-systemd\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.361204 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.361122    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47c8f18e-4ca1-413e-b665-d4b4a51dcab4-host\") pod \"node-ca-5548s\" (UID: \"47c8f18e-4ca1-413e-b665-d4b4a51dcab4\") " pod="openshift-image-registry/node-ca-5548s"
Oct 30 21:11:32.361204 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.361137    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-run-ovn-kubernetes\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.361204 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.361171    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74jsm\" (UniqueName: \"kubernetes.io/projected/886735ce-b78e-4b99-898d-35d295a1b059-kube-api-access-74jsm\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.361452 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.361246    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-hostroot\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.361452 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.361276    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-systemd\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.361452 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.361331    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25hjt\" (UniqueName: \"kubernetes.io/projected/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-kube-api-access-25hjt\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.361452 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.361354    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6626e30d-3f05-406c-8ea5-5329ea58dd07-agent-certs\") pod \"konnectivity-agent-ttsq4\" (UID: \"6626e30d-3f05-406c-8ea5-5329ea58dd07\") " pod="kube-system/konnectivity-agent-ttsq4"
Oct 30 21:11:32.361452 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.361363    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-sysctl-d\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.361452 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.361394    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3d6657-b9dd-4d70-889a-e480fa537ed9-service-ca-bundle\") pod \"periodic-gathering-8nc9h-csrmt\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") " pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:32.361452 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.361420    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:32.361452 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.361441    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-etc-sysctl-d\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.361452 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.361444    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lkhv\" (UniqueName: \"kubernetes.io/projected/47c8f18e-4ca1-413e-b665-d4b4a51dcab4-kube-api-access-5lkhv\") pod \"node-ca-5548s\" (UID: \"47c8f18e-4ca1-413e-b665-d4b4a51dcab4\") " pod="openshift-image-registry/node-ca-5548s"
Oct 30 21:11:32.405272 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.405248    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 21:11:32.405423 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.405260    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 21:11:32.405423 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.405298    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 21:11:32.405423 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.405324    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 21:11:32.405423 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.405328    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Oct 30 21:11:32.405823 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.405641    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:11:32.405823 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.405678    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 21:11:32.405823 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.405698    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 21:11:32.405823 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.405698    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 21:11:32.405823 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.405763    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 21:11:32.406195 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406179    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 21:11:32.406255 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406187    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 21:11:32.406302 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406257    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 21:11:32.406302 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406265    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Oct 30 21:11:32.406302 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406276    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 21:11:32.406302 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406284    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 21:11:32.406302 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406300    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:11:32.406518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406355    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 21:11:32.406518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406408    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 21:11:32.406518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406418    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 21:11:32.406518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406425    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 21:11:32.406518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406431    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 21:11:32.406518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406425    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 21:11:32.406518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406446    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 21:11:32.406518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406487    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 21:11:32.406518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406488    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Oct 30 21:11:32.406518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406501    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 21:11:32.406518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406489    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 21:11:32.406518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406496    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 21:11:32.406518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406516    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 21:11:32.406518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406506    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 21:11:32.407136 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406541    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 21:11:32.407136 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406556    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 21:11:32.407136 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406558    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 21:11:32.407136 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406576    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 21:11:32.407136 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406635    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 21:11:32.407136 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.406850    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 21:11:32.410033 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.407973    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 21:11:32.410191 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.410172    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9095843d-0f41-4363-9bd3-d7516c532136-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:11:32.410191 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.410190    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-cni-binary-copy\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.410191 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.410198    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/886735ce-b78e-4b99-898d-35d295a1b059-ovnkube-config\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.410362 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.410246    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/886735ce-b78e-4b99-898d-35d295a1b059-ovnkube-script-lib\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.410540 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.410448    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b0855c11-d0dc-4d51-92a9-3913d9946069-config-volume\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:32.410595 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.410526    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-daemon-config\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.411242 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.410982    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9095843d-0f41-4363-9bd3-d7516c532136-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:11:32.411242 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.410989    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6626e30d-3f05-406c-8ea5-5329ea58dd07-konnectivity-ca\") pod \"konnectivity-agent-ttsq4\" (UID: \"6626e30d-3f05-406c-8ea5-5329ea58dd07\") " pod="kube-system/konnectivity-agent-ttsq4"
Oct 30 21:11:32.411242 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.411018    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9095843d-0f41-4363-9bd3-d7516c532136-cni-binary-copy\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:11:32.411242 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.411046    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47c8f18e-4ca1-413e-b665-d4b4a51dcab4-serviceca\") pod \"node-ca-5548s\" (UID: \"47c8f18e-4ca1-413e-b665-d4b4a51dcab4\") " pod="openshift-image-registry/node-ca-5548s"
Oct 30 21:11:32.411242 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.411103    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/886735ce-b78e-4b99-898d-35d295a1b059-env-overrides\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.411242 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.411126    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkt57\" (UniqueName: \"kubernetes.io/projected/b0f88e16-68d7-49b8-b50a-29786cf11a17-kube-api-access-jkt57\") pod \"node-resolver-lzdr5\" (UID: \"b0f88e16-68d7-49b8-b50a-29786cf11a17\") " pod="openshift-dns/node-resolver-lzdr5"
Oct 30 21:11:32.411242 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.411216    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b22257b3-075e-4545-abac-4d37820d073e-signing-cabundle\") pod \"service-ca-5fffc97bdf-64r42\" (UID: \"b22257b3-075e-4545-abac-4d37820d073e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-64r42"
Oct 30 21:11:32.411242 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.411232    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d67402d3-89aa-453d-991b-56606214dfa4-iptables-alerter-script\") pod \"iptables-alerter-wlqbw\" (UID: \"d67402d3-89aa-453d-991b-56606214dfa4\") " pod="openshift-network-operator/iptables-alerter-wlqbw"
Oct 30 21:11:32.411549 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.411424    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3d6657-b9dd-4d70-889a-e480fa537ed9-trusted-ca-bundle\") pod \"periodic-gathering-8nc9h-csrmt\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") " pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:32.411549 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.411513    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkx85\" (UniqueName: \"kubernetes.io/projected/32468c74-2a0c-4a3b-a073-98961fc3ffd6-kube-api-access-mkx85\") pod \"network-check-target-m4t5j\" (UID: \"32468c74-2a0c-4a3b-a073-98961fc3ffd6\") " pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:32.411603 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.411550    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3d6657-b9dd-4d70-889a-e480fa537ed9-service-ca-bundle\") pod \"periodic-gathering-8nc9h-csrmt\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") " pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:32.411640 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.411624    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:32.413337 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.413318    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95b8w\" (UniqueName: \"kubernetes.io/projected/9095843d-0f41-4363-9bd3-d7516c532136-kube-api-access-95b8w\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:11:32.413520 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.413500    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8tpp\" (UniqueName: \"kubernetes.io/projected/3f3d6657-b9dd-4d70-889a-e480fa537ed9-kube-api-access-j8tpp\") pod \"periodic-gathering-8nc9h-csrmt\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") " pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:11:32.413778 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.413763    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4jsr\" (UniqueName: \"kubernetes.io/projected/46c8ff3a-870d-4939-94f3-8c73beab6ecb-kube-api-access-n4jsr\") pod \"network-metrics-daemon-58v4c\" (UID: \"46c8ff3a-870d-4939-94f3-8c73beab6ecb\") " pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:32.413810 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.413790    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxpxg\" (UniqueName: \"kubernetes.io/projected/45d347ba-b99f-402d-92e2-db767c723fab-kube-api-access-dxpxg\") pod \"ingress-canary-cvjpd\" (UID: \"45d347ba-b99f-402d-92e2-db767c723fab\") " pod="openshift-ingress-canary/ingress-canary-cvjpd"
Oct 30 21:11:32.413838 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.413825    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc5ds\" (UniqueName: \"kubernetes.io/projected/1d1ae5a7-dbca-4614-bd43-3ed9e0558360-kube-api-access-wc5ds\") pod \"tuned-tnk8v\" (UID: \"1d1ae5a7-dbca-4614-bd43-3ed9e0558360\") " pod="openshift-cluster-node-tuning-operator/tuned-tnk8v"
Oct 30 21:11:32.414028 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.414015    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-669nt\" (UniqueName: \"kubernetes.io/projected/ca23ae9d-6ade-4f64-ba4c-a77e7ad9f639-kube-api-access-669nt\") pod \"migrator-66df5d496b-kv82x\" (UID: \"ca23ae9d-6ade-4f64-ba4c-a77e7ad9f639\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-kv82x"
Oct 30 21:11:32.414180 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.414157    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h4ts\" (UniqueName: \"kubernetes.io/projected/b22257b3-075e-4545-abac-4d37820d073e-kube-api-access-8h4ts\") pod \"service-ca-5fffc97bdf-64r42\" (UID: \"b22257b3-075e-4545-abac-4d37820d073e\") " pod="openshift-service-ca/service-ca-5fffc97bdf-64r42"
Oct 30 21:11:32.414571 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.414556    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pps44\" (UniqueName: \"kubernetes.io/projected/d67402d3-89aa-453d-991b-56606214dfa4-kube-api-access-pps44\") pod \"iptables-alerter-wlqbw\" (UID: \"d67402d3-89aa-453d-991b-56606214dfa4\") " pod="openshift-network-operator/iptables-alerter-wlqbw"
Oct 30 21:11:32.414632 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.414615    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sc76\" (UniqueName: \"kubernetes.io/projected/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-kube-api-access-9sc76\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:11:32.414842 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.414829    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng8xl\" (UniqueName: \"kubernetes.io/projected/6de535fe-3a22-40e2-9a24-86fcc6292b0f-kube-api-access-ng8xl\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:32.416416 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.416399    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25hjt\" (UniqueName: \"kubernetes.io/projected/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-kube-api-access-25hjt\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.416608 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.416588    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lkhv\" (UniqueName: \"kubernetes.io/projected/47c8f18e-4ca1-413e-b665-d4b4a51dcab4-kube-api-access-5lkhv\") pod \"node-ca-5548s\" (UID: \"47c8f18e-4ca1-413e-b665-d4b4a51dcab4\") " pod="openshift-image-registry/node-ca-5548s"
Oct 30 21:11:32.416802 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.416789    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74jsm\" (UniqueName: \"kubernetes.io/projected/886735ce-b78e-4b99-898d-35d295a1b059-kube-api-access-74jsm\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.416899 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.416882    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7nf7\" (UniqueName: \"kubernetes.io/projected/b0855c11-d0dc-4d51-92a9-3913d9946069-kube-api-access-x7nf7\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:32.462109 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462086    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:32.462194 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462112    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.462194 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462128    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-run-netns\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.462194 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462143    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-device-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:11:32.462290 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462197    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-run-systemd\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.462290 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462217    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-run-netns\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.462290 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462222    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-node-log\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.462290 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:32.462240    4522 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:11:32.462290 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462248    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-node-log\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.462290 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462251    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-device-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:11:32.462290 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462195    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.462290 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462262    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-cni-netd\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.462290 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462288    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6de535fe-3a22-40e2-9a24-86fcc6292b0f-crio-socket\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:32.462650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462294    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-cni-netd\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.462650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462303    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d67402d3-89aa-453d-991b-56606214dfa4-host-slash\") pod \"iptables-alerter-wlqbw\" (UID: \"d67402d3-89aa-453d-991b-56606214dfa4\") " pod="openshift-network-operator/iptables-alerter-wlqbw"
Oct 30 21:11:32.462650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462320    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-var-lib-openvswitch\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.462650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462321    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-run-systemd\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.462650 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:32.462350    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls podName:6de535fe-3a22-40e2-9a24-86fcc6292b0f nodeName:}" failed. No retries permitted until 2026-10-30 21:11:32.962331679 +0000 UTC m=+1.907277040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p9vq8" (UID: "6de535fe-3a22-40e2-9a24-86fcc6292b0f") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:11:32.462650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462352    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d67402d3-89aa-453d-991b-56606214dfa4-host-slash\") pod \"iptables-alerter-wlqbw\" (UID: \"d67402d3-89aa-453d-991b-56606214dfa4\") " pod="openshift-network-operator/iptables-alerter-wlqbw"
Oct 30 21:11:32.462650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462372    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-cnibin\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.462650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462356    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-var-lib-openvswitch\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.462650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462354    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6de535fe-3a22-40e2-9a24-86fcc6292b0f-crio-socket\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:32.462650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462407    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-var-lib-cni-bin\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.462650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462430    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-cnibin\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.462650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462484    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-var-lib-kubelet\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.462650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462515    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-var-lib-cni-bin\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.462650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462570    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-socket-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:11:32.462650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462612    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-var-lib-kubelet\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.462650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462633    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9095843d-0f41-4363-9bd3-d7516c532136-tuning-conf-dir\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:11:32.462650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462650    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-registration-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:11:32.462650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462651    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-socket-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462664    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-etc-selinux\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462678    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-run-ovn\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462689    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9095843d-0f41-4363-9bd3-d7516c532136-tuning-conf-dir\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462735    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-etc-selinux\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462761    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-registration-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462781    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-run-ovn\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462808    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-log-socket\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462831    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-log-socket\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462831    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-run-multus-certs\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462855    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-sys-fs\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462861    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-run-multus-certs\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462869    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/de7df116-a968-473a-85b7-cd508eb8edc5-kubelet-config\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462886    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/de7df116-a968-473a-85b7-cd508eb8edc5-dbus\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462918    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9095843d-0f41-4363-9bd3-d7516c532136-system-cni-dir\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462932    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/de7df116-a968-473a-85b7-cd508eb8edc5-kubelet-config\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462944    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/de7df116-a968-473a-85b7-cd508eb8edc5-dbus\") pod \"global-pull-secret-syncer-6gs88\" (UID: \"de7df116-a968-473a-85b7-cd508eb8edc5\") " pod="kube-system/global-pull-secret-syncer-6gs88"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462946    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-kubelet\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462946    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-sys-fs\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462964    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9095843d-0f41-4363-9bd3-d7516c532136-system-cni-dir\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462971    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-var-lib-cni-multus\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462978    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-kubelet\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.462985    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47c8f18e-4ca1-413e-b665-d4b4a51dcab4-host\") pod \"node-ca-5548s\" (UID: \"47c8f18e-4ca1-413e-b665-d4b4a51dcab4\") " pod="openshift-image-registry/node-ca-5548s"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463003    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-run-ovn-kubernetes\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463013    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-var-lib-cni-multus\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463018    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-hostroot\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463034    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-slash\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463034    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-run-ovn-kubernetes\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463044    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47c8f18e-4ca1-413e-b665-d4b4a51dcab4-host\") pod \"node-ca-5548s\" (UID: \"47c8f18e-4ca1-413e-b665-d4b4a51dcab4\") " pod="openshift-image-registry/node-ca-5548s"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463058    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-slash\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463068    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-hostroot\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463089    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs\") pod \"network-metrics-daemon-58v4c\" (UID: \"46c8ff3a-870d-4939-94f3-8c73beab6ecb\") " pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463106    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463125    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9095843d-0f41-4363-9bd3-d7516c532136-cnibin\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463150    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-systemd-units\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463158    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f6c8d5f3-1059-4847-ad18-af3750c7c7e8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xdmc5\" (UID: \"f6c8d5f3-1059-4847-ad18-af3750c7c7e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xdmc5"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463172    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9095843d-0f41-4363-9bd3-d7516c532136-cnibin\") pod \"multus-additional-cni-plugins-58btz\" (UID: \"9095843d-0f41-4363-9bd3-d7516c532136\") " pod="openshift-multus/multus-additional-cni-plugins-58btz"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463171    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-run-netns\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:32.463182    4522 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463192    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-socket-dir-parent\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463195    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-systemd-units\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463200    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-run-netns\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463209    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-etc-openvswitch\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:32.463228    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs podName:46c8ff3a-870d-4939-94f3-8c73beab6ecb nodeName:}" failed. No retries permitted until 2026-10-30 21:11:32.963211671 +0000 UTC m=+1.908157028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs") pod "network-metrics-daemon-58v4c" (UID: "46c8ff3a-870d-4939-94f3-8c73beab6ecb") : secret "metrics-daemon-secret" not found
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463235    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-etc-openvswitch\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463238    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-socket-dir-parent\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463260    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-run-openvswitch\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463276    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-etc-kubernetes\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463300    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-run-k8s-cni-cncf-io\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463303    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-run-openvswitch\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463314    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-conf-dir\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.463304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463331    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-cni-bin\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.464671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463348    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-system-cni-dir\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.464671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463350    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-etc-kubernetes\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.464671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463382    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-conf-dir\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.464671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463387    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-cni-dir\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.464671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463389    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/886735ce-b78e-4b99-898d-35d295a1b059-host-cni-bin\") pod \"ovnkube-node-8vk2q\" (UID: \"886735ce-b78e-4b99-898d-35d295a1b059\") " pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:32.464671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463411    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:32.464671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463406    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-system-cni-dir\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.464671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463423    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-multus-cni-dir\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.464671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.463389    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf-host-run-k8s-cni-cncf-io\") pod \"multus-cx7lm\" (UID: \"0426d3d3-3a43-4023-9b2f-2dbcb52e0dcf\") " pod="openshift-multus/multus-cx7lm"
Oct 30 21:11:32.464671 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:32.463513    4522 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:11:32.464671 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:32.463557    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls podName:b0855c11-d0dc-4d51-92a9-3913d9946069 nodeName:}" failed. No retries permitted until 2026-10-30 21:11:32.963547058 +0000 UTC m=+1.908492396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls") pod "dns-default-9nf28" (UID: "b0855c11-d0dc-4d51-92a9-3913d9946069") : secret "dns-default-metrics-tls" not found
Oct 30 21:11:32.966882 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.966848    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs\") pod \"network-metrics-daemon-58v4c\" (UID: \"46c8ff3a-870d-4939-94f3-8c73beab6ecb\") " pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:32.967042 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.966887    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:32.967042 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:32.966907    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:32.967042 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:32.966985    4522 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 21:11:32.967042 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:32.966998    4522 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:11:32.967042 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:32.966991    4522 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:11:32.967042 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:32.967039    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls podName:6de535fe-3a22-40e2-9a24-86fcc6292b0f nodeName:}" failed. No retries permitted until 2026-10-30 21:11:33.967028317 +0000 UTC m=+2.911973655 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p9vq8" (UID: "6de535fe-3a22-40e2-9a24-86fcc6292b0f") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:11:32.967232 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:32.967051    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs podName:46c8ff3a-870d-4939-94f3-8c73beab6ecb nodeName:}" failed. No retries permitted until 2026-10-30 21:11:33.967046186 +0000 UTC m=+2.911991524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs") pod "network-metrics-daemon-58v4c" (UID: "46c8ff3a-870d-4939-94f3-8c73beab6ecb") : secret "metrics-daemon-secret" not found
Oct 30 21:11:32.967232 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:32.967063    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls podName:b0855c11-d0dc-4d51-92a9-3913d9946069 nodeName:}" failed. No retries permitted until 2026-10-30 21:11:33.967055522 +0000 UTC m=+2.912000861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls") pod "dns-default-9nf28" (UID: "b0855c11-d0dc-4d51-92a9-3913d9946069") : secret "dns-default-metrics-tls" not found
Oct 30 21:11:33.366380 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:33.366321    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:33.500539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:33.500517    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:33.974050 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:33.974011    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:33.974050 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:33.974056    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:33.974330 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:33.974120    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs\") pod \"network-metrics-daemon-58v4c\" (UID: \"46c8ff3a-870d-4939-94f3-8c73beab6ecb\") " pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:33.974330 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:33.974185    4522 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:11:33.974330 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:33.974230    4522 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 21:11:33.974330 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:33.974260    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls podName:b0855c11-d0dc-4d51-92a9-3913d9946069 nodeName:}" failed. No retries permitted until 2026-10-30 21:11:35.974244249 +0000 UTC m=+4.919189587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls") pod "dns-default-9nf28" (UID: "b0855c11-d0dc-4d51-92a9-3913d9946069") : secret "dns-default-metrics-tls" not found
Oct 30 21:11:33.974330 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:33.974288    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs podName:46c8ff3a-870d-4939-94f3-8c73beab6ecb nodeName:}" failed. No retries permitted until 2026-10-30 21:11:35.974273091 +0000 UTC m=+4.919218430 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs") pod "network-metrics-daemon-58v4c" (UID: "46c8ff3a-870d-4939-94f3-8c73beab6ecb") : secret "metrics-daemon-secret" not found
Oct 30 21:11:33.974330 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:33.974230    4522 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:11:33.974330 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:33.974325    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls podName:6de535fe-3a22-40e2-9a24-86fcc6292b0f nodeName:}" failed. No retries permitted until 2026-10-30 21:11:35.974317198 +0000 UTC m=+4.919262550 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p9vq8" (UID: "6de535fe-3a22-40e2-9a24-86fcc6292b0f") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:11:34.226110 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:34.226048    4522 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:11:35.985470 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:35.985422    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs\") pod \"network-metrics-daemon-58v4c\" (UID: \"46c8ff3a-870d-4939-94f3-8c73beab6ecb\") " pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:35.985882 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:35.985508    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:35.985882 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:35.985535    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:35.985882 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:35.985563    4522 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 21:11:35.985882 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:35.985632    4522 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:11:35.985882 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:35.985644    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs podName:46c8ff3a-870d-4939-94f3-8c73beab6ecb nodeName:}" failed. No retries permitted until 2026-10-30 21:11:39.985628205 +0000 UTC m=+8.930573566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs") pod "network-metrics-daemon-58v4c" (UID: "46c8ff3a-870d-4939-94f3-8c73beab6ecb") : secret "metrics-daemon-secret" not found
Oct 30 21:11:35.985882 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:35.985670    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls podName:6de535fe-3a22-40e2-9a24-86fcc6292b0f nodeName:}" failed. No retries permitted until 2026-10-30 21:11:39.985660298 +0000 UTC m=+8.930605636 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p9vq8" (UID: "6de535fe-3a22-40e2-9a24-86fcc6292b0f") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:11:35.985882 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:35.985632    4522 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:11:35.985882 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:35.985694    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls podName:b0855c11-d0dc-4d51-92a9-3913d9946069 nodeName:}" failed. No retries permitted until 2026-10-30 21:11:39.985688438 +0000 UTC m=+8.930633777 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls") pod "dns-default-9nf28" (UID: "b0855c11-d0dc-4d51-92a9-3913d9946069") : secret "dns-default-metrics-tls" not found
Oct 30 21:11:38.670653 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:38.670620    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:11:39.248162 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:39.248132    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:39.398895 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:39.398868    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8vk2q"
Oct 30 21:11:39.501334 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:39.501247    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:39.814216 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:39.814132    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:40.009563 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:40.009529    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:40.011699 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:40.011656    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:40.011767 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:40.011719    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:40.011822 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:40.011783    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs\") pod \"network-metrics-daemon-58v4c\" (UID: \"46c8ff3a-870d-4939-94f3-8c73beab6ecb\") " pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:40.012065 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:40.012044    4522 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 21:11:40.014170 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:40.014146    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6de535fe-3a22-40e2-9a24-86fcc6292b0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p9vq8\" (UID: \"6de535fe-3a22-40e2-9a24-86fcc6292b0f\") " pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:40.014541 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:40.014524    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46c8ff3a-870d-4939-94f3-8c73beab6ecb-metrics-certs\") pod \"network-metrics-daemon-58v4c\" (UID: \"46c8ff3a-870d-4939-94f3-8c73beab6ecb\") " pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:40.014761 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:40.014746    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0855c11-d0dc-4d51-92a9-3913d9946069-metrics-tls\") pod \"dns-default-9nf28\" (UID: \"b0855c11-d0dc-4d51-92a9-3913d9946069\") " pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:40.057494 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:40.057472    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58v4c"
Oct 30 21:11:40.059984 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:40.059960    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:40.060761 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:40.060748    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p9vq8"
Oct 30 21:11:40.277078 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:40.277052    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:40.435566 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:40.435532    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-58v4c"]
Oct 30 21:11:40.478170 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:40.478137    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c8ff3a_870d_4939_94f3_8c73beab6ecb.slice/crio-44b07aac5676fa70bdba2b8e1aaa8839bca145611d6c1cbbdb499c90b4282433 WatchSource:0}: Error finding container 44b07aac5676fa70bdba2b8e1aaa8839bca145611d6c1cbbdb499c90b4282433: Status 404 returned error can't find the container with id 44b07aac5676fa70bdba2b8e1aaa8839bca145611d6c1cbbdb499c90b4282433
Oct 30 21:11:40.480172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:40.480157    4522 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:11:40.487595 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:40.487572    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9nf28"]
Oct 30 21:11:40.491206 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:40.491178    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0855c11_d0dc_4d51_92a9_3913d9946069.slice/crio-0aa77da4644db2530cf90cc53ccfea68844d2e3f0f93ff8303c1735a75b8cba2 WatchSource:0}: Error finding container 0aa77da4644db2530cf90cc53ccfea68844d2e3f0f93ff8303c1735a75b8cba2: Status 404 returned error can't find the container with id 0aa77da4644db2530cf90cc53ccfea68844d2e3f0f93ff8303c1735a75b8cba2
Oct 30 21:11:40.495360 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:40.495339    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p9vq8"]
Oct 30 21:11:40.498691 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:40.498675    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de535fe_3a22_40e2_9a24_86fcc6292b0f.slice/crio-855d7d526e205da66967a4b73be4c5b5f3394871bc4e1aba96f550a6265c642f WatchSource:0}: Error finding container 855d7d526e205da66967a4b73be4c5b5f3394871bc4e1aba96f550a6265c642f: Status 404 returned error can't find the container with id 855d7d526e205da66967a4b73be4c5b5f3394871bc4e1aba96f550a6265c642f
Oct 30 21:11:40.666581 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:40.666549    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:41.245636 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:41.245602    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p9vq8" event={"ID":"6de535fe-3a22-40e2-9a24-86fcc6292b0f","Type":"ContainerStarted","Data":"877b5a8be979c33f2d98fb05d03e835d7dd4613774d611efe6ac60e992a28014"}
Oct 30 21:11:41.246023 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:41.245681    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p9vq8" event={"ID":"6de535fe-3a22-40e2-9a24-86fcc6292b0f","Type":"ContainerStarted","Data":"855d7d526e205da66967a4b73be4c5b5f3394871bc4e1aba96f550a6265c642f"}
Oct 30 21:11:41.246696 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:41.246672    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9nf28" event={"ID":"b0855c11-d0dc-4d51-92a9-3913d9946069","Type":"ContainerStarted","Data":"0aa77da4644db2530cf90cc53ccfea68844d2e3f0f93ff8303c1735a75b8cba2"}
Oct 30 21:11:41.247627 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:41.247610    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58v4c" event={"ID":"46c8ff3a-870d-4939-94f3-8c73beab6ecb","Type":"ContainerStarted","Data":"44b07aac5676fa70bdba2b8e1aaa8839bca145611d6c1cbbdb499c90b4282433"}
Oct 30 21:11:41.374437 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:41.374414    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:41.574227 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:41.574141    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:41.674481 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:41.674437    4522 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-237.us-west-1.compute.internal" event="NodeReady"
Oct 30 21:11:41.768242 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:41.768169    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:42.070239 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.070215    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:42.253927 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.253845    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58v4c" event={"ID":"46c8ff3a-870d-4939-94f3-8c73beab6ecb","Type":"ContainerStarted","Data":"93f2f1f5b615c3b2c78deb23a10e7a97a3e379e8c045d34cdfe915e9c70c227d"}
Oct 30 21:11:42.253927 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.253910    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58v4c" event={"ID":"46c8ff3a-870d-4939-94f3-8c73beab6ecb","Type":"ContainerStarted","Data":"5ee1a5e40172fcbb8a2cc217007c1eddba15578824a6d9a58ca996d95cd7c91a"}
Oct 30 21:11:42.257497 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.257449    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p9vq8" event={"ID":"6de535fe-3a22-40e2-9a24-86fcc6292b0f","Type":"ContainerStarted","Data":"17c660a5a350179e128bf9af837dc1ae7105d6fd10732610ad813a180301d889"}
Oct 30 21:11:42.269421 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.269396    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:42.374081 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.374048    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76bc567ddd-zhdrc"]
Oct 30 21:11:42.375813 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.375788    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.429964 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.429924    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-ca-trust-extracted\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.429964 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.429968    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-certificates\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.430158 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.430069    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-trusted-ca\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.430158 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.430110    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2748\" (UniqueName: \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-kube-api-access-g2748\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.430158 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.430140    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-tls\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.430287 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.430230    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-installation-pull-secrets\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.430287 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.430261    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-bound-sa-token\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.430363 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.430304    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-image-registry-private-configuration\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.432664 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.432643    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 21:11:42.432803 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.432682    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 21:11:42.432803 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.432780    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rvqfx\""
Oct 30 21:11:42.433102 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.433086    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 21:11:42.473273 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.473240    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:42.506778 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.506707    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 21:11:42.531279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.531246    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-tls\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.531422 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.531304    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-installation-pull-secrets\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.531422 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.531337    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-bound-sa-token\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.531422 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.531376    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-image-registry-private-configuration\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.531422 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.531399    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-ca-trust-extracted\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.531422 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:42.531399    4522 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:11:42.531422 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.531413    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-certificates\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.531752 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.531437    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-trusted-ca\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.531752 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.531454    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2748\" (UniqueName: \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-kube-api-access-g2748\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.531752 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:42.531418    4522 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76bc567ddd-zhdrc: secret "image-registry-tls" not found
Oct 30 21:11:42.531893 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:42.531761    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-tls podName:7e64de4b-10d4-4bd0-94bb-d6fb6585146b nodeName:}" failed. No retries permitted until 2026-10-30 21:11:43.031737371 +0000 UTC m=+11.976682729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-tls") pod "image-registry-76bc567ddd-zhdrc" (UID: "7e64de4b-10d4-4bd0-94bb-d6fb6585146b") : secret "image-registry-tls" not found
Oct 30 21:11:42.532108 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.532089    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-ca-trust-extracted\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.532321 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.532300    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76bc567ddd-zhdrc"]
Oct 30 21:11:42.532759 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.532732    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-certificates\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.533117 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.533092    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-trusted-ca\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.534033 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.534012    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-image-registry-private-configuration\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.534162 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.534137    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-installation-pull-secrets\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.588272 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.588242    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2748\" (UniqueName: \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-kube-api-access-g2748\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.588495 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.588454    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-bound-sa-token\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:42.661961 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.661939    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:42.933574 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:42.933540    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:43.034426 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:43.034365    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-tls\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:43.034598 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:43.034555    4522 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:11:43.034598 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:43.034575    4522 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76bc567ddd-zhdrc: secret "image-registry-tls" not found
Oct 30 21:11:43.034746 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:43.034643    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-tls podName:7e64de4b-10d4-4bd0-94bb-d6fb6585146b nodeName:}" failed. No retries permitted until 2026-10-30 21:11:44.034624142 +0000 UTC m=+12.979569497 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-tls") pod "image-registry-76bc567ddd-zhdrc" (UID: "7e64de4b-10d4-4bd0-94bb-d6fb6585146b") : secret "image-registry-tls" not found
Oct 30 21:11:43.121770 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:43.121737    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:43.262527 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:43.262490    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9nf28" event={"ID":"b0855c11-d0dc-4d51-92a9-3913d9946069","Type":"ContainerStarted","Data":"773e1eba0554a74e87ef48ed2776653b5b01be13601aaaf90385054fece99dac"}
Oct 30 21:11:43.262970 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:43.262552    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9nf28" event={"ID":"b0855c11-d0dc-4d51-92a9-3913d9946069","Type":"ContainerStarted","Data":"edbacb705263b5271462d9adf779b9ce2bbb3fefb8d9363333d3350647fa3067"}
Oct 30 21:11:43.461110 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:43.461076    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:43.667911 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:43.667883    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:44.041331 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:44.041260    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-tls\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:44.041821 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:44.041806    4522 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:11:44.041867 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:44.041822    4522 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76bc567ddd-zhdrc: secret "image-registry-tls" not found
Oct 30 21:11:44.041898 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:11:44.041875    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-tls podName:7e64de4b-10d4-4bd0-94bb-d6fb6585146b nodeName:}" failed. No retries permitted until 2026-10-30 21:11:46.041858499 +0000 UTC m=+14.986803857 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-tls") pod "image-registry-76bc567ddd-zhdrc" (UID: "7e64de4b-10d4-4bd0-94bb-d6fb6585146b") : secret "image-registry-tls" not found
Oct 30 21:11:44.063697 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:44.063667    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:44.269916 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:44.269884    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:44.270760 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:44.270738    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p9vq8" event={"ID":"6de535fe-3a22-40e2-9a24-86fcc6292b0f","Type":"ContainerStarted","Data":"0e3ff2cc60dea2292885cec343ae360f7f09eb22b3e617d8a324e4195f5f2858"}
Oct 30 21:11:44.270928 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:44.270912    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:44.871643 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:44.871595    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:45.474138 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.474105    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:45.533097 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.533065    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57db9bb55b-2qbnr"]
Oct 30 21:11:45.534975 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.534957    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.616638 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.616606    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57db9bb55b-2qbnr"]
Oct 30 21:11:45.653840 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.653809    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/acfadece-9a24-43a4-b4bb-dda4a5fa8501-ca-trust-extracted\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.653840 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.653843    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acfadece-9a24-43a4-b4bb-dda4a5fa8501-registry-tls\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.654026 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.653859    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acfadece-9a24-43a4-b4bb-dda4a5fa8501-bound-sa-token\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.654026 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.653878    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp2v5\" (UniqueName: \"kubernetes.io/projected/acfadece-9a24-43a4-b4bb-dda4a5fa8501-kube-api-access-hp2v5\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.654087 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.654035    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/acfadece-9a24-43a4-b4bb-dda4a5fa8501-trusted-ca\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.654087 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.654074    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/acfadece-9a24-43a4-b4bb-dda4a5fa8501-image-registry-private-configuration\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.654145 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.654122    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/acfadece-9a24-43a4-b4bb-dda4a5fa8501-installation-pull-secrets\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.654230 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.654210    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/acfadece-9a24-43a4-b4bb-dda4a5fa8501-registry-certificates\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.661408 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.661380    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:45.755091 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.755008    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/acfadece-9a24-43a4-b4bb-dda4a5fa8501-installation-pull-secrets\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.755091 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.755055    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/acfadece-9a24-43a4-b4bb-dda4a5fa8501-registry-certificates\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.755091 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.755081    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/acfadece-9a24-43a4-b4bb-dda4a5fa8501-ca-trust-extracted\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.755373 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.755096    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acfadece-9a24-43a4-b4bb-dda4a5fa8501-registry-tls\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.755373 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.755116    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acfadece-9a24-43a4-b4bb-dda4a5fa8501-bound-sa-token\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.755373 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.755143    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp2v5\" (UniqueName: \"kubernetes.io/projected/acfadece-9a24-43a4-b4bb-dda4a5fa8501-kube-api-access-hp2v5\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.755373 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.755176    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/acfadece-9a24-43a4-b4bb-dda4a5fa8501-trusted-ca\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.755373 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.755211    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/acfadece-9a24-43a4-b4bb-dda4a5fa8501-image-registry-private-configuration\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.755636 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.755478    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/acfadece-9a24-43a4-b4bb-dda4a5fa8501-ca-trust-extracted\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.756044 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.756012    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/acfadece-9a24-43a4-b4bb-dda4a5fa8501-registry-certificates\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.756216 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.756198    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/acfadece-9a24-43a4-b4bb-dda4a5fa8501-trusted-ca\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.757871 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.757851    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/acfadece-9a24-43a4-b4bb-dda4a5fa8501-registry-tls\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.758061 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.758046    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/acfadece-9a24-43a4-b4bb-dda4a5fa8501-installation-pull-secrets\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.758232 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.758212    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/acfadece-9a24-43a4-b4bb-dda4a5fa8501-image-registry-private-configuration\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.811755 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.811725    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acfadece-9a24-43a4-b4bb-dda4a5fa8501-bound-sa-token\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.811873 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.811822    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp2v5\" (UniqueName: \"kubernetes.io/projected/acfadece-9a24-43a4-b4bb-dda4a5fa8501-kube-api-access-hp2v5\") pod \"image-registry-57db9bb55b-2qbnr\" (UID: \"acfadece-9a24-43a4-b4bb-dda4a5fa8501\") " pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.844858 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.844828    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:45.846488 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:45.846446    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:46.057275 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:46.057212    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-tls\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:46.059336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:46.059318    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-tls\") pod \"image-registry-76bc567ddd-zhdrc\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") " pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:46.068084 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:46.068056    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:46.250092 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:46.250064    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:46.261347 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:46.261287    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57db9bb55b-2qbnr"]
Oct 30 21:11:46.264598 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:46.264576    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacfadece_9a24_43a4_b4bb_dda4a5fa8501.slice/crio-6401fdd7751f7292bde00fc130999fefe56ebe0e76ec51d6c5cfa3fc657b0ff2 WatchSource:0}: Error finding container 6401fdd7751f7292bde00fc130999fefe56ebe0e76ec51d6c5cfa3fc657b0ff2: Status 404 returned error can't find the container with id 6401fdd7751f7292bde00fc130999fefe56ebe0e76ec51d6c5cfa3fc657b0ff2
Oct 30 21:11:46.278056 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:46.278029    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr" event={"ID":"acfadece-9a24-43a4-b4bb-dda4a5fa8501","Type":"ContainerStarted","Data":"6401fdd7751f7292bde00fc130999fefe56ebe0e76ec51d6c5cfa3fc657b0ff2"}
Oct 30 21:11:46.286505 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:46.286484    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:46.445333 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:46.445307    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:46.646511 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:46.646432    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:46.705924 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:46.705884    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76bc567ddd-zhdrc"]
Oct 30 21:11:46.709712 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:11:46.709690    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e64de4b_10d4_4bd0_94bb_d6fb6585146b.slice/crio-649f04c2f4e1c7f1b5fc0c9e0f7edd4417667b3f41cfc14c9735c1dab71b1568 WatchSource:0}: Error finding container 649f04c2f4e1c7f1b5fc0c9e0f7edd4417667b3f41cfc14c9735c1dab71b1568: Status 404 returned error can't find the container with id 649f04c2f4e1c7f1b5fc0c9e0f7edd4417667b3f41cfc14c9735c1dab71b1568
Oct 30 21:11:46.863553 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:46.863522    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:47.185867 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:47.185809    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:47.281997 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:47.281970    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc" event={"ID":"7e64de4b-10d4-4bd0-94bb-d6fb6585146b","Type":"ContainerStarted","Data":"14d3a7480bb18ea9b34393ce31c63b6c37ed4f28252e771a31a4be273cfa92aa"}
Oct 30 21:11:47.282153 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:47.282012    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc" event={"ID":"7e64de4b-10d4-4bd0-94bb-d6fb6585146b","Type":"ContainerStarted","Data":"649f04c2f4e1c7f1b5fc0c9e0f7edd4417667b3f41cfc14c9735c1dab71b1568"}
Oct 30 21:11:47.282153 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:47.282091    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:11:47.283475 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:47.283443    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr" event={"ID":"acfadece-9a24-43a4-b4bb-dda4a5fa8501","Type":"ContainerStarted","Data":"e8c34e1e07f8d47379efb0d4d17543704a69bc47f06f7fe0753575ecb9e9c57c"}
Oct 30 21:11:47.283598 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:47.283583    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:11:47.402311 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:47.402266    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc" podStartSLOduration=5.402255816 podStartE2EDuration="5.402255816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:11:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:11:47.401682963 +0000 UTC m=+16.346628324" watchObservedRunningTime="2026-10-30 21:11:47.402255816 +0000 UTC m=+16.347201176"
Oct 30 21:11:47.403702 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:47.403681    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:47.523144 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:47.523003    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr" podStartSLOduration=2.522986927 podStartE2EDuration="2.522986927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:11:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:11:47.522162731 +0000 UTC m=+16.467108090" watchObservedRunningTime="2026-10-30 21:11:47.522986927 +0000 UTC m=+16.467932290"
Oct 30 21:11:47.589108 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:47.589083    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:47.775744 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:47.775677    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:48.114119 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:48.114044    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:48.306412 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:48.306380    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:48.847553 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:48.847524    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:49.035733 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:49.035700    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:49.467609 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:49.467576    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:49.677216 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:49.677173    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:49.877934 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:49.877866    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:50.074278 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:50.074255    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:54.275820 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:54.275771    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9nf28"
Oct 30 21:11:59.630734 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:11:59.630704    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ttsq4"
Oct 30 21:12:01.234246 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:01.234214    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:01.423604 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:01.423572    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:02.174921 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:02.174890    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:02.362835 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:02.362803    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:03.548385 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:03.548355    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:03.736246 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:03.736211    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:03.923921 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:03.923894    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:04.118767 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:04.118741    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:04.587633 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:04.587602    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:04.777062 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:04.777028    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:04.970014 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:04.969982    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:05.478349 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:05.478320    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:07.876257 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:07.876231    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:07.986318 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:12:07.986284    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:12:08.064245 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:08.064215    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:08.268908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:08.268880    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:08.290405 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:08.290385    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:12:08.290542 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:08.290441    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57db9bb55b-2qbnr"
Oct 30 21:12:08.468794 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:08.468766    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:08.601798 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:08.601725    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76bc567ddd-zhdrc"]
Oct 30 21:12:08.673647 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:08.673624    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m4t5j"
Oct 30 21:12:08.741173 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:08.741145    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:08.929168 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:08.929141    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:09.398632 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:09.398562    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:09.577950 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:09.577920    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:10.804116 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:10.804083    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:10.991263 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:10.991234    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:11.183671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:11.183645    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:12.596265 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:12.596233    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:12.791578 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:12.791548    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:13.219454 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:13.219423    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:13.433965 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:13.433929    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:13.615911 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:13.615805    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:13.803396 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:13.803367    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:13.974076 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:13.974047    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qcvr5"]
Oct 30 21:12:13.975993 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:13.975978    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.006109 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.006086    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:14.036690 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.036670    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2cdd0ed9-ecee-414f-b054-48803997e5d0-node-exporter-wtmp\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.036794 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.036698    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2cdd0ed9-ecee-414f-b054-48803997e5d0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.036794 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.036733    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cdd0ed9-ecee-414f-b054-48803997e5d0-sys\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.036882 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.036865    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2cdd0ed9-ecee-414f-b054-48803997e5d0-node-exporter-textfile\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.036941 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.036928    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2cdd0ed9-ecee-414f-b054-48803997e5d0-node-exporter-tls\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.036975 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.036956    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2cdd0ed9-ecee-414f-b054-48803997e5d0-metrics-client-ca\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.037006 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.036974    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9ck5\" (UniqueName: \"kubernetes.io/projected/2cdd0ed9-ecee-414f-b054-48803997e5d0-kube-api-access-t9ck5\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.037035 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.037002    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2cdd0ed9-ecee-414f-b054-48803997e5d0-root\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.037079 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.037065    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2cdd0ed9-ecee-414f-b054-48803997e5d0-node-exporter-accelerators-collector-config\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.048975 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.048958    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:12:14.076799 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.076782    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:12:14.076877 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.076823    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 21:12:14.076877 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.076859    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 21:12:14.126224 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.126205    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 21:12:14.126224 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.126219    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wxcc9\""
Oct 30 21:12:14.126360 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.126208    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 21:12:14.137668 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.137646    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2cdd0ed9-ecee-414f-b054-48803997e5d0-node-exporter-tls\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.137729 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.137678    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2cdd0ed9-ecee-414f-b054-48803997e5d0-metrics-client-ca\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.137729 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.137700    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9ck5\" (UniqueName: \"kubernetes.io/projected/2cdd0ed9-ecee-414f-b054-48803997e5d0-kube-api-access-t9ck5\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.137803 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.137728    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2cdd0ed9-ecee-414f-b054-48803997e5d0-root\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.137803 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.137761    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2cdd0ed9-ecee-414f-b054-48803997e5d0-node-exporter-accelerators-collector-config\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.137803 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.137792    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2cdd0ed9-ecee-414f-b054-48803997e5d0-node-exporter-wtmp\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.137991 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.137853    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2cdd0ed9-ecee-414f-b054-48803997e5d0-root\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.137991 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.137911    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2cdd0ed9-ecee-414f-b054-48803997e5d0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.138094 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.137968    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cdd0ed9-ecee-414f-b054-48803997e5d0-sys\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.138094 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.138006    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2cdd0ed9-ecee-414f-b054-48803997e5d0-node-exporter-wtmp\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.138094 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.138027    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2cdd0ed9-ecee-414f-b054-48803997e5d0-node-exporter-textfile\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.138094 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.138054    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cdd0ed9-ecee-414f-b054-48803997e5d0-sys\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.138327 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.138249    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2cdd0ed9-ecee-414f-b054-48803997e5d0-metrics-client-ca\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.138327 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.138288    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2cdd0ed9-ecee-414f-b054-48803997e5d0-node-exporter-textfile\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.138327 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.138295    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2cdd0ed9-ecee-414f-b054-48803997e5d0-node-exporter-accelerators-collector-config\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.140059 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.140041    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2cdd0ed9-ecee-414f-b054-48803997e5d0-node-exporter-tls\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.140137 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.140086    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2cdd0ed9-ecee-414f-b054-48803997e5d0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.194245 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.194207    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9ck5\" (UniqueName: \"kubernetes.io/projected/2cdd0ed9-ecee-414f-b054-48803997e5d0-kube-api-access-t9ck5\") pod \"node-exporter-qcvr5\" (UID: \"2cdd0ed9-ecee-414f-b054-48803997e5d0\") " pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.197767 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.197745    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:14.287824 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.287773    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qcvr5"
Oct 30 21:12:14.296603 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:12:14.296581    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cdd0ed9_ecee_414f_b054_48803997e5d0.slice/crio-d2daec3c13c49b15444ca6af03197b01146aeeecb263bf077b5482657d054a8a WatchSource:0}: Error finding container d2daec3c13c49b15444ca6af03197b01146aeeecb263bf077b5482657d054a8a: Status 404 returned error can't find the container with id d2daec3c13c49b15444ca6af03197b01146aeeecb263bf077b5482657d054a8a
Oct 30 21:12:14.360173 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.360149    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qcvr5" event={"ID":"2cdd0ed9-ecee-414f-b054-48803997e5d0","Type":"ContainerStarted","Data":"d2daec3c13c49b15444ca6af03197b01146aeeecb263bf077b5482657d054a8a"}
Oct 30 21:12:14.388772 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.388749    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:14.585691 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:14.585597    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:15.247596 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:15.247560    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:15.432008 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:15.431977    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:15.706847 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:15.706823    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:16.264585 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:16.264527    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:16.368571 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:16.368541    4522 generic.go:356] "Generic (PLEG): container finished" podID="2cdd0ed9-ecee-414f-b054-48803997e5d0" containerID="db4e9664a1711e5c251f1d28b34dda1ae76fd075a66e7fc96840322aed76174b" exitCode=0
Oct 30 21:12:16.368690 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:16.368578    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qcvr5" event={"ID":"2cdd0ed9-ecee-414f-b054-48803997e5d0","Type":"ContainerDied","Data":"db4e9664a1711e5c251f1d28b34dda1ae76fd075a66e7fc96840322aed76174b"}
Oct 30 21:12:16.480765 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:16.480742    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:17.373964 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:17.373930    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qcvr5" event={"ID":"2cdd0ed9-ecee-414f-b054-48803997e5d0","Type":"ContainerStarted","Data":"b00a0d54780f8c97c6aa9d3ab633418633d937c3e84df753aab6c30a8f7e8b0e"}
Oct 30 21:12:17.374337 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:17.373988    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qcvr5" event={"ID":"2cdd0ed9-ecee-414f-b054-48803997e5d0","Type":"ContainerStarted","Data":"1d6544ebfaa80c0e0b2ada8492ce2a35650422e92e4855e3a75f362c0bbd600b"}
Oct 30 21:12:17.539429 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:17.539376    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qcvr5" podStartSLOduration=3.090704494 podStartE2EDuration="4.539359969s" totalImagesPullingTime="1.384791263s" totalInitContainerRuntime="63.864212ms" isStatefulPod=true podCreationTimestamp="2026-10-30 21:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:12:17.538827745 +0000 UTC m=+46.483773105" watchObservedRunningTime="2026-10-30 21:12:17.539359969 +0000 UTC m=+46.484305329"
Oct 30 21:12:18.075995 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:18.075964    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:18.267352 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:18.267324    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:18.459176 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:18.459148    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:18.653864 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:18.653829    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:18.923556 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:18.923526    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:19.116003 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:19.115973    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:23.030768 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.030733    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:23.050191 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.050165    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:12:23.052771 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.052751    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.105073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.105050    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 21:12:23.136615 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.136592    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:12:23.144169 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.144143    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 21:12:23.144490 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.144470    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 21:12:23.144593 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.144478    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 21:12:23.144593 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.144485    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 21:12:23.144593 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.144514    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 21:12:23.170812 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.170788    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 21:12:23.170913 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.170813    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 21:12:23.170913 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.170819    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fbr78\""
Oct 30 21:12:23.170913 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.170846    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 21:12:23.171041 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.171004    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 21:12:23.171090 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.171047    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1qcj4gm7c3o7k\""
Oct 30 21:12:23.198119 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.198095    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.198224 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.198131    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.198224 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.198155    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.198302 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.198223    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d01bf041-68dd-4d42-b13c-1a83211f909a-config-out\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.198302 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.198274    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h55wq\" (UniqueName: \"kubernetes.io/projected/d01bf041-68dd-4d42-b13c-1a83211f909a-kube-api-access-h55wq\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.198421 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.198307    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.198421 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.198325    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.198421 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.198353    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.198421 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.198391    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.198421 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.198414    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-web-config\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.198630 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.198485    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.198630 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.198504    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-config\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.198630 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.198518    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.198630 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.198534    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.198630 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.198548    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.198630 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.198580    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d01bf041-68dd-4d42-b13c-1a83211f909a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.198630 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.198608    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.198924 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.198707    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.198924 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.198768    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.198924 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.198798    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.206296 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.206275    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 21:12:23.206296 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.206277    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 21:12:23.206433 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.206278    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 21:12:23.256124 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.256103    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 21:12:23.256312 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.256298    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 21:12:23.299536 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.299488    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.299536 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.299516    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.299677 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.299537    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.299677 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.299564    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.299677 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.299582    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.299811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.299693    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d01bf041-68dd-4d42-b13c-1a83211f909a-config-out\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.299811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.299731    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h55wq\" (UniqueName: \"kubernetes.io/projected/d01bf041-68dd-4d42-b13c-1a83211f909a-kube-api-access-h55wq\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.299811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.299760    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.299811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.299786    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.299988 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.299812    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.299988 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.299836    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.299988 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.299855    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-web-config\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.299988 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.299901    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.299988 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.299924    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-config\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.299988 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.299948    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.300265 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.300081    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.300265 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.300197    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.300373 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.300316    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.300734 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.300710    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.300872 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.300852    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.300939 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.300902    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.300939 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.300931    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d01bf041-68dd-4d42-b13c-1a83211f909a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.301038 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.300955    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.301038 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.300986    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.301717 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.301691    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.302698 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.302676    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.302824 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.302802    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d01bf041-68dd-4d42-b13c-1a83211f909a-config-out\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.302903 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.302747    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.302903 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.302738    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.303083 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.303056    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.303204 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.303180    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.303345 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.303325    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.303580 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.303536    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.304899 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.304882    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-web-config\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.305211 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.305190    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-config\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.305296 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.305191    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.305648 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.305632    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.305979 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.305957    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d01bf041-68dd-4d42-b13c-1a83211f909a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.306085 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.306069    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.355539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.355518    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h55wq\" (UniqueName: \"kubernetes.io/projected/d01bf041-68dd-4d42-b13c-1a83211f909a-kube-api-access-h55wq\") pod \"prometheus-k8s-0\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.368573 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.368554    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:23.795080 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:23.795056    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:12:23.797887 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:12:23.797860    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd01bf041_68dd_4d42_b13c_1a83211f909a.slice/crio-5ed34b2028ed2629284a159409e1de35a2f9e03543242c4b97eb13eefb23fb7c WatchSource:0}: Error finding container 5ed34b2028ed2629284a159409e1de35a2f9e03543242c4b97eb13eefb23fb7c: Status 404 returned error can't find the container with id 5ed34b2028ed2629284a159409e1de35a2f9e03543242c4b97eb13eefb23fb7c
Oct 30 21:12:24.398685 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:24.398651    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01bf041-68dd-4d42-b13c-1a83211f909a","Type":"ContainerStarted","Data":"5ed34b2028ed2629284a159409e1de35a2f9e03543242c4b97eb13eefb23fb7c"}
Oct 30 21:12:24.956039 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:24.956012    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:25.402883 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:25.402823    4522 generic.go:356] "Generic (PLEG): container finished" podID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerID="93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0" exitCode=0
Oct 30 21:12:25.402883 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:25.402876    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01bf041-68dd-4d42-b13c-1a83211f909a","Type":"ContainerDied","Data":"93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0"}
Oct 30 21:12:28.367900 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:28.367861    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:28.556341 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:28.556291    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:29.153580 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:29.153551    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:29.361152 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:29.361113    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:29.418809 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:29.418779    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01bf041-68dd-4d42-b13c-1a83211f909a","Type":"ContainerStarted","Data":"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487"}
Oct 30 21:12:29.419143 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:29.418852    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01bf041-68dd-4d42-b13c-1a83211f909a","Type":"ContainerStarted","Data":"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02"}
Oct 30 21:12:31.427594 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:31.427561    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01bf041-68dd-4d42-b13c-1a83211f909a","Type":"ContainerStarted","Data":"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9"}
Oct 30 21:12:31.427966 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:31.427646    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01bf041-68dd-4d42-b13c-1a83211f909a","Type":"ContainerStarted","Data":"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba"}
Oct 30 21:12:31.427966 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:31.427673    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01bf041-68dd-4d42-b13c-1a83211f909a","Type":"ContainerStarted","Data":"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479"}
Oct 30 21:12:31.427966 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:31.427697    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01bf041-68dd-4d42-b13c-1a83211f909a","Type":"ContainerStarted","Data":"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4"}
Oct 30 21:12:31.698494 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:31.698387    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.881872903 podStartE2EDuration="9.69837374s" totalImagesPullingTime="6.797898463s" totalInitContainerRuntime="18.602374ms" isStatefulPod=false podCreationTimestamp="2026-10-30 21:12:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:12:31.649219522 +0000 UTC m=+60.594164895" watchObservedRunningTime="2026-10-30 21:12:31.69837374 +0000 UTC m=+60.643319130"
Oct 30 21:12:32.170183 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:32.170149    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:32.358359 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:32.358315    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:33.369443 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.369417    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:33.620191 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.620100    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc" podUID="7e64de4b-10d4-4bd0-94bb-d6fb6585146b" containerName="registry" containerID="cri-o://14d3a7480bb18ea9b34393ce31c63b6c37ed4f28252e771a31a4be273cfa92aa" gracePeriod=30
Oct 30 21:12:33.850702 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.850674    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:12:33.987805 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.987776    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-certificates\") pod \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") "
Oct 30 21:12:33.987957 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.987821    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-bound-sa-token\") pod \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") "
Oct 30 21:12:33.987957 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.987865    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-installation-pull-secrets\") pod \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") "
Oct 30 21:12:33.987957 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.987900    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-kube-api-access-g2748\" (UniqueName: \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-kube-api-access-g2748\") pod \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") "
Oct 30 21:12:33.988109 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.987956    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-image-registry-private-configuration\") pod \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") "
Oct 30 21:12:33.988109 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.987998    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-trusted-ca\") pod \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") "
Oct 30 21:12:33.988109 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.988070    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-ca-trust-extracted\") pod \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") "
Oct 30 21:12:33.988251 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.988187    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-tls\" (UniqueName: \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-tls\") pod \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\" (UID: \"7e64de4b-10d4-4bd0-94bb-d6fb6585146b\") "
Oct 30 21:12:33.988502 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.988384    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-certificates" pod "7e64de4b-10d4-4bd0-94bb-d6fb6585146b" (UID: "7e64de4b-10d4-4bd0-94bb-d6fb6585146b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:12:33.988502 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.988448    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-trusted-ca" pod "7e64de4b-10d4-4bd0-94bb-d6fb6585146b" (UID: "7e64de4b-10d4-4bd0-94bb-d6fb6585146b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:12:33.988693 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.988522    4522 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-trusted-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:33.988693 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.988540    4522 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-certificates\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:33.990426 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.990372    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-bound-sa-token" pod "7e64de4b-10d4-4bd0-94bb-d6fb6585146b" (UID: "7e64de4b-10d4-4bd0-94bb-d6fb6585146b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:12:33.990572 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.990509    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-image-registry-private-configuration" pod "7e64de4b-10d4-4bd0-94bb-d6fb6585146b" (UID: "7e64de4b-10d4-4bd0-94bb-d6fb6585146b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:12:33.990791 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.990739    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-installation-pull-secrets" pod "7e64de4b-10d4-4bd0-94bb-d6fb6585146b" (UID: "7e64de4b-10d4-4bd0-94bb-d6fb6585146b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:12:33.990897 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.990846    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-tls" pod "7e64de4b-10d4-4bd0-94bb-d6fb6585146b" (UID: "7e64de4b-10d4-4bd0-94bb-d6fb6585146b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:12:33.990897 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.990879    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-kube-api-access-g2748" pod "7e64de4b-10d4-4bd0-94bb-d6fb6585146b" (UID: "7e64de4b-10d4-4bd0-94bb-d6fb6585146b"). InnerVolumeSpecName "kube-api-access-g2748". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:12:33.994836 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:33.994815    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-ca-trust-extracted" pod "7e64de4b-10d4-4bd0-94bb-d6fb6585146b" (UID: "7e64de4b-10d4-4bd0-94bb-d6fb6585146b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:12:34.089354 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:34.089324    4522 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-image-registry-private-configuration\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:34.089354 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:34.089353    4522 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-ca-trust-extracted\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:34.089354 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:34.089363    4522 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-registry-tls\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:34.089534 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:34.089372    4522 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-bound-sa-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:34.089534 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:34.089382    4522 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-installation-pull-secrets\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:34.089534 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:34.089390    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2748\" (UniqueName: \"kubernetes.io/projected/7e64de4b-10d4-4bd0-94bb-d6fb6585146b-kube-api-access-g2748\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:34.441962 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:34.441936    4522 generic.go:356] "Generic (PLEG): container finished" podID="7e64de4b-10d4-4bd0-94bb-d6fb6585146b" containerID="14d3a7480bb18ea9b34393ce31c63b6c37ed4f28252e771a31a4be273cfa92aa" exitCode=0
Oct 30 21:12:34.442295 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:34.441980    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc" event={"ID":"7e64de4b-10d4-4bd0-94bb-d6fb6585146b","Type":"ContainerDied","Data":"14d3a7480bb18ea9b34393ce31c63b6c37ed4f28252e771a31a4be273cfa92aa"}
Oct 30 21:12:34.442295 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:34.441995    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc"
Oct 30 21:12:34.442295 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:34.442038    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76bc567ddd-zhdrc" event={"ID":"7e64de4b-10d4-4bd0-94bb-d6fb6585146b","Type":"ContainerDied","Data":"649f04c2f4e1c7f1b5fc0c9e0f7edd4417667b3f41cfc14c9735c1dab71b1568"}
Oct 30 21:12:34.442295 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:34.442057    4522 scope.go:122] "RemoveContainer" containerID="14d3a7480bb18ea9b34393ce31c63b6c37ed4f28252e771a31a4be273cfa92aa"
Oct 30 21:12:34.450406 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:34.450388    4522 scope.go:122] "RemoveContainer" containerID="14d3a7480bb18ea9b34393ce31c63b6c37ed4f28252e771a31a4be273cfa92aa"
Oct 30 21:12:34.450659 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:12:34.450640    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14d3a7480bb18ea9b34393ce31c63b6c37ed4f28252e771a31a4be273cfa92aa\": container with ID starting with 14d3a7480bb18ea9b34393ce31c63b6c37ed4f28252e771a31a4be273cfa92aa not found: ID does not exist" containerID="14d3a7480bb18ea9b34393ce31c63b6c37ed4f28252e771a31a4be273cfa92aa"
Oct 30 21:12:34.450711 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:34.450667    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14d3a7480bb18ea9b34393ce31c63b6c37ed4f28252e771a31a4be273cfa92aa"} err="failed to get container status \"14d3a7480bb18ea9b34393ce31c63b6c37ed4f28252e771a31a4be273cfa92aa\": rpc error: code = NotFound desc = could not find container \"14d3a7480bb18ea9b34393ce31c63b6c37ed4f28252e771a31a4be273cfa92aa\": container with ID starting with 14d3a7480bb18ea9b34393ce31c63b6c37ed4f28252e771a31a4be273cfa92aa not found: ID does not exist"
Oct 30 21:12:34.652109 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:34.652077    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76bc567ddd-zhdrc"]
Oct 30 21:12:34.701298 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:34.701236    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76bc567ddd-zhdrc"]
Oct 30 21:12:35.189067 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:35.189036    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7e64de4b-10d4-4bd0-94bb-d6fb6585146b" path="/var/lib/kubelet/pods/7e64de4b-10d4-4bd0-94bb-d6fb6585146b/volumes"
Oct 30 21:12:35.488684 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:35.488615    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:35.686223 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:35.686191    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:37.986697 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:12:37.986661    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:12:45.768843 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:45.768807    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:45.786587 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:45.786560    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:45.896734 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:45.896710    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:46.091425 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:46.091368    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:46.494807 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:46.494782    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:12:52.701907 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:52.701871    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:52.888022 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:52.887994    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:54.507751 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:54.507718    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:54.703156 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:54.703124    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:54.911270 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:54.911195    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:55.094693 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:55.094661    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:56.113450 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:56.113421    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:57.595919 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:57.595890    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-8nc9h-csrmt"]
Oct 30 21:12:57.596310 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:57.596077    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-8nc9h-csrmt" podUID="3f3d6657-b9dd-4d70-889a-e480fa537ed9" containerName="insights-gathering" containerID="cri-o://de03671cd054f2216748b3465f68ae9707ef9a521a58c99fc0e55bd62d948320" gracePeriod=30
Oct 30 21:12:57.859314 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:57.859256    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:12:57.953521 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:57.953489    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f3d6657-b9dd-4d70-889a-e480fa537ed9-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3f3d6657-b9dd-4d70-889a-e480fa537ed9-archives-path\") pod \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") "
Oct 30 21:12:57.953700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:57.953538    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3f3d6657-b9dd-4d70-889a-e480fa537ed9-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3d6657-b9dd-4d70-889a-e480fa537ed9-service-ca-bundle\") pod \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") "
Oct 30 21:12:57.953700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:57.953560    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3f3d6657-b9dd-4d70-889a-e480fa537ed9-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3d6657-b9dd-4d70-889a-e480fa537ed9-trusted-ca-bundle\") pod \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") "
Oct 30 21:12:57.953700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:57.953606    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3f3d6657-b9dd-4d70-889a-e480fa537ed9-kube-api-access-j8tpp\" (UniqueName: \"kubernetes.io/projected/3f3d6657-b9dd-4d70-889a-e480fa537ed9-kube-api-access-j8tpp\") pod \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\" (UID: \"3f3d6657-b9dd-4d70-889a-e480fa537ed9\") "
Oct 30 21:12:57.953917 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:57.953895    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3d6657-b9dd-4d70-889a-e480fa537ed9-archives-path" pod "3f3d6657-b9dd-4d70-889a-e480fa537ed9" (UID: "3f3d6657-b9dd-4d70-889a-e480fa537ed9"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:12:57.953971 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:57.953893    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f3d6657-b9dd-4d70-889a-e480fa537ed9-service-ca-bundle" pod "3f3d6657-b9dd-4d70-889a-e480fa537ed9" (UID: "3f3d6657-b9dd-4d70-889a-e480fa537ed9"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:12:57.953971 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:57.953933    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f3d6657-b9dd-4d70-889a-e480fa537ed9-trusted-ca-bundle" pod "3f3d6657-b9dd-4d70-889a-e480fa537ed9" (UID: "3f3d6657-b9dd-4d70-889a-e480fa537ed9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:12:57.955862 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:57.955839    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f3d6657-b9dd-4d70-889a-e480fa537ed9-kube-api-access-j8tpp" pod "3f3d6657-b9dd-4d70-889a-e480fa537ed9" (UID: "3f3d6657-b9dd-4d70-889a-e480fa537ed9"). InnerVolumeSpecName "kube-api-access-j8tpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:12:58.054123 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:58.054096    4522 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3d6657-b9dd-4d70-889a-e480fa537ed9-service-ca-bundle\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:58.054123 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:58.054120    4522 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3d6657-b9dd-4d70-889a-e480fa537ed9-trusted-ca-bundle\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:58.054270 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:58.054130    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8tpp\" (UniqueName: \"kubernetes.io/projected/3f3d6657-b9dd-4d70-889a-e480fa537ed9-kube-api-access-j8tpp\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:58.054270 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:58.054139    4522 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3f3d6657-b9dd-4d70-889a-e480fa537ed9-archives-path\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:58.516973 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:58.516938    4522 generic.go:356] "Generic (PLEG): container finished" podID="3f3d6657-b9dd-4d70-889a-e480fa537ed9" containerID="de03671cd054f2216748b3465f68ae9707ef9a521a58c99fc0e55bd62d948320" exitCode=2
Oct 30 21:12:58.517135 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:58.516980    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-8nc9h-csrmt"
Oct 30 21:12:58.517135 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:58.517004    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-8nc9h-csrmt" event={"ID":"3f3d6657-b9dd-4d70-889a-e480fa537ed9","Type":"ContainerDied","Data":"de03671cd054f2216748b3465f68ae9707ef9a521a58c99fc0e55bd62d948320"}
Oct 30 21:12:58.517135 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:58.517050    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-8nc9h-csrmt" event={"ID":"3f3d6657-b9dd-4d70-889a-e480fa537ed9","Type":"ContainerDied","Data":"7103501cdaf6df86cd317e1d49d96a4b2defa5b8bd036c548c754a3c43f7de98"}
Oct 30 21:12:58.517135 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:58.517071    4522 scope.go:122] "RemoveContainer" containerID="de03671cd054f2216748b3465f68ae9707ef9a521a58c99fc0e55bd62d948320"
Oct 30 21:12:58.531386 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:58.531366    4522 scope.go:122] "RemoveContainer" containerID="de03671cd054f2216748b3465f68ae9707ef9a521a58c99fc0e55bd62d948320"
Oct 30 21:12:58.531681 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:12:58.531661    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de03671cd054f2216748b3465f68ae9707ef9a521a58c99fc0e55bd62d948320\": container with ID starting with de03671cd054f2216748b3465f68ae9707ef9a521a58c99fc0e55bd62d948320 not found: ID does not exist" containerID="de03671cd054f2216748b3465f68ae9707ef9a521a58c99fc0e55bd62d948320"
Oct 30 21:12:58.531743 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:58.531694    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de03671cd054f2216748b3465f68ae9707ef9a521a58c99fc0e55bd62d948320"} err="failed to get container status \"de03671cd054f2216748b3465f68ae9707ef9a521a58c99fc0e55bd62d948320\": rpc error: code = NotFound desc = could not find container \"de03671cd054f2216748b3465f68ae9707ef9a521a58c99fc0e55bd62d948320\": container with ID starting with de03671cd054f2216748b3465f68ae9707ef9a521a58c99fc0e55bd62d948320 not found: ID does not exist"
Oct 30 21:12:58.678228 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:58.678194    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-8nc9h-csrmt"]
Oct 30 21:12:58.727304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:58.727281    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-8nc9h-csrmt"]
Oct 30 21:12:59.189213 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:12:59.189173    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3f3d6657-b9dd-4d70-889a-e480fa537ed9" path="/var/lib/kubelet/pods/3f3d6657-b9dd-4d70-889a-e480fa537ed9/volumes"
Oct 30 21:13:02.169988 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:02.169954    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:13:02.361650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:02.361617    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:13:06.035066 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.035035    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:13:06.035559 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.035345    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="prometheus" containerID="cri-o://2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02" gracePeriod=600
Oct 30 21:13:06.035559 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.035360    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="kube-rbac-proxy" containerID="cri-o://304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba" gracePeriod=600
Oct 30 21:13:06.035559 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.035401    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9" gracePeriod=600
Oct 30 21:13:06.035559 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.035419    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="thanos-sidecar" containerID="cri-o://dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4" gracePeriod=600
Oct 30 21:13:06.035559 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.035502    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="config-reloader" containerID="cri-o://1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487" gracePeriod=600
Oct 30 21:13:06.035940 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.035419    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="kube-rbac-proxy-web" containerID="cri-o://cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479" gracePeriod=600
Oct 30 21:13:06.281027 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.281006    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.310042 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.309996    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-2\") pod \"d01bf041-68dd-4d42-b13c-1a83211f909a\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") "
Oct 30 21:13:06.310042 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310027    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-serving-certs-ca-bundle\") pod \"d01bf041-68dd-4d42-b13c-1a83211f909a\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") "
Oct 30 21:13:06.310206 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310057    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d01bf041-68dd-4d42-b13c-1a83211f909a\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") "
Oct 30 21:13:06.310206 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310085    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-thanos-prometheus-http-client-file\") pod \"d01bf041-68dd-4d42-b13c-1a83211f909a\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") "
Oct 30 21:13:06.310206 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310112    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-metrics-client-ca\") pod \"d01bf041-68dd-4d42-b13c-1a83211f909a\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") "
Oct 30 21:13:06.310206 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310145    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d01bf041-68dd-4d42-b13c-1a83211f909a-kube-api-access-h55wq\" (UniqueName: \"kubernetes.io/projected/d01bf041-68dd-4d42-b13c-1a83211f909a-kube-api-access-h55wq\") pod \"d01bf041-68dd-4d42-b13c-1a83211f909a\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") "
Oct 30 21:13:06.310206 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310174    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-kubelet-serving-ca-bundle\") pod \"d01bf041-68dd-4d42-b13c-1a83211f909a\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") "
Oct 30 21:13:06.310438 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310222    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d01bf041-68dd-4d42-b13c-1a83211f909a-config-out\" (UniqueName: \"kubernetes.io/empty-dir/d01bf041-68dd-4d42-b13c-1a83211f909a-config-out\") pod \"d01bf041-68dd-4d42-b13c-1a83211f909a\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") "
Oct 30 21:13:06.310438 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310249    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-tls\") pod \"d01bf041-68dd-4d42-b13c-1a83211f909a\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") "
Oct 30 21:13:06.310438 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310283    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-web-config\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-web-config\") pod \"d01bf041-68dd-4d42-b13c-1a83211f909a\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") "
Oct 30 21:13:06.310438 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310316    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d01bf041-68dd-4d42-b13c-1a83211f909a\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") "
Oct 30 21:13:06.310438 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310360    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-1\") pod \"d01bf041-68dd-4d42-b13c-1a83211f909a\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") "
Oct 30 21:13:06.310438 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310371    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-serving-certs-ca-bundle" pod "d01bf041-68dd-4d42-b13c-1a83211f909a" (UID: "d01bf041-68dd-4d42-b13c-1a83211f909a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:13:06.310438 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310388    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-db\") pod \"d01bf041-68dd-4d42-b13c-1a83211f909a\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") "
Oct 30 21:13:06.310438 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310425    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-config\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-config\") pod \"d01bf041-68dd-4d42-b13c-1a83211f909a\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") "
Oct 30 21:13:06.310438 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310427    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-2" pod "d01bf041-68dd-4d42-b13c-1a83211f909a" (UID: "d01bf041-68dd-4d42-b13c-1a83211f909a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:13:06.310881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310454    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-grpc-tls\") pod \"d01bf041-68dd-4d42-b13c-1a83211f909a\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") "
Oct 30 21:13:06.310881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310520    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-0\") pod \"d01bf041-68dd-4d42-b13c-1a83211f909a\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") "
Oct 30 21:13:06.310881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310550    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-metrics-client-certs\") pod \"d01bf041-68dd-4d42-b13c-1a83211f909a\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") "
Oct 30 21:13:06.310881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310580    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-trusted-ca-bundle\") pod \"d01bf041-68dd-4d42-b13c-1a83211f909a\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") "
Oct 30 21:13:06.310881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310606    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-kube-rbac-proxy\") pod \"d01bf041-68dd-4d42-b13c-1a83211f909a\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") "
Oct 30 21:13:06.310881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310636    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d01bf041-68dd-4d42-b13c-1a83211f909a-tls-assets\" (UniqueName: \"kubernetes.io/projected/d01bf041-68dd-4d42-b13c-1a83211f909a-tls-assets\") pod \"d01bf041-68dd-4d42-b13c-1a83211f909a\" (UID: \"d01bf041-68dd-4d42-b13c-1a83211f909a\") "
Oct 30 21:13:06.310881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310765    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-metrics-client-ca" pod "d01bf041-68dd-4d42-b13c-1a83211f909a" (UID: "d01bf041-68dd-4d42-b13c-1a83211f909a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:13:06.310881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310864    4522 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:06.310881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310884    4522 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:06.311312 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310901    4522 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-metrics-client-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:06.311312 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.310775    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-kubelet-serving-ca-bundle" pod "d01bf041-68dd-4d42-b13c-1a83211f909a" (UID: "d01bf041-68dd-4d42-b13c-1a83211f909a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:13:06.313206 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.312789    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-trusted-ca-bundle" pod "d01bf041-68dd-4d42-b13c-1a83211f909a" (UID: "d01bf041-68dd-4d42-b13c-1a83211f909a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:13:06.313206 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.312845    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-thanos-prometheus-http-client-file" pod "d01bf041-68dd-4d42-b13c-1a83211f909a" (UID: "d01bf041-68dd-4d42-b13c-1a83211f909a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:13:06.313206 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.312855    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-1" pod "d01bf041-68dd-4d42-b13c-1a83211f909a" (UID: "d01bf041-68dd-4d42-b13c-1a83211f909a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:13:06.313206 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.312880    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-thanos-sidecar-tls" pod "d01bf041-68dd-4d42-b13c-1a83211f909a" (UID: "d01bf041-68dd-4d42-b13c-1a83211f909a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:13:06.313206 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.312926    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d01bf041-68dd-4d42-b13c-1a83211f909a-config-out" pod "d01bf041-68dd-4d42-b13c-1a83211f909a" (UID: "d01bf041-68dd-4d42-b13c-1a83211f909a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:13:06.313554 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.313332    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-grpc-tls" pod "d01bf041-68dd-4d42-b13c-1a83211f909a" (UID: "d01bf041-68dd-4d42-b13c-1a83211f909a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:13:06.313664 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.313640    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-tls" pod "d01bf041-68dd-4d42-b13c-1a83211f909a" (UID: "d01bf041-68dd-4d42-b13c-1a83211f909a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:13:06.313871 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.313848    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d01bf041-68dd-4d42-b13c-1a83211f909a-tls-assets" pod "d01bf041-68dd-4d42-b13c-1a83211f909a" (UID: "d01bf041-68dd-4d42-b13c-1a83211f909a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:13:06.314229 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.314203    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-metrics-client-certs" pod "d01bf041-68dd-4d42-b13c-1a83211f909a" (UID: "d01bf041-68dd-4d42-b13c-1a83211f909a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:13:06.314321 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.314264    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-db" pod "d01bf041-68dd-4d42-b13c-1a83211f909a" (UID: "d01bf041-68dd-4d42-b13c-1a83211f909a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:13:06.314676 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.314649    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d01bf041-68dd-4d42-b13c-1a83211f909a-kube-api-access-h55wq" pod "d01bf041-68dd-4d42-b13c-1a83211f909a" (UID: "d01bf041-68dd-4d42-b13c-1a83211f909a"). InnerVolumeSpecName "kube-api-access-h55wq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:13:06.314992 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.314964    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-0" pod "d01bf041-68dd-4d42-b13c-1a83211f909a" (UID: "d01bf041-68dd-4d42-b13c-1a83211f909a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:13:06.315086 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.315057    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-kube-rbac-proxy-web" pod "d01bf041-68dd-4d42-b13c-1a83211f909a" (UID: "d01bf041-68dd-4d42-b13c-1a83211f909a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:13:06.315270 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.315249    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-config" pod "d01bf041-68dd-4d42-b13c-1a83211f909a" (UID: "d01bf041-68dd-4d42-b13c-1a83211f909a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:13:06.315893 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.315876    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-kube-rbac-proxy" pod "d01bf041-68dd-4d42-b13c-1a83211f909a" (UID: "d01bf041-68dd-4d42-b13c-1a83211f909a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:13:06.322756 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.322737    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-web-config" pod "d01bf041-68dd-4d42-b13c-1a83211f909a" (UID: "d01bf041-68dd-4d42-b13c-1a83211f909a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:13:06.413063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.412239    4522 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-config\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:06.413063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.412268    4522 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-grpc-tls\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:06.413063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.412284    4522 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:06.413063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.412303    4522 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-metrics-client-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:06.413063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.412317    4522 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:06.413063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.412331    4522 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-kube-rbac-proxy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:06.413063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.412344    4522 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d01bf041-68dd-4d42-b13c-1a83211f909a-tls-assets\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:06.413063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.412362    4522 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:06.413063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.412377    4522 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:06.413063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.412390    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h55wq\" (UniqueName: \"kubernetes.io/projected/d01bf041-68dd-4d42-b13c-1a83211f909a-kube-api-access-h55wq\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:06.413063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.412403    4522 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:06.413063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.412420    4522 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d01bf041-68dd-4d42-b13c-1a83211f909a-config-out\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:06.413063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.412432    4522 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:06.413063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.412482    4522 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-web-config\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:06.413063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.412497    4522 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d01bf041-68dd-4d42-b13c-1a83211f909a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:06.413063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.412515    4522 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:06.413063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.412530    4522 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d01bf041-68dd-4d42-b13c-1a83211f909a-prometheus-k8s-db\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:06.546313 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.546277    4522 generic.go:356] "Generic (PLEG): container finished" podID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerID="b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9" exitCode=0
Oct 30 21:13:06.546313 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.546306    4522 generic.go:356] "Generic (PLEG): container finished" podID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerID="304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba" exitCode=0
Oct 30 21:13:06.546313 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.546312    4522 generic.go:356] "Generic (PLEG): container finished" podID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerID="cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479" exitCode=0
Oct 30 21:13:06.546313 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.546318    4522 generic.go:356] "Generic (PLEG): container finished" podID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerID="dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4" exitCode=0
Oct 30 21:13:06.546313 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.546323    4522 generic.go:356] "Generic (PLEG): container finished" podID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerID="1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487" exitCode=0
Oct 30 21:13:06.546661 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.546330    4522 generic.go:356] "Generic (PLEG): container finished" podID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerID="2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02" exitCode=0
Oct 30 21:13:06.546661 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.546342    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01bf041-68dd-4d42-b13c-1a83211f909a","Type":"ContainerDied","Data":"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9"}
Oct 30 21:13:06.546661 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.546374    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.546661 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.546436    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01bf041-68dd-4d42-b13c-1a83211f909a","Type":"ContainerDied","Data":"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba"}
Oct 30 21:13:06.546661 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.546479    4522 scope.go:122] "RemoveContainer" containerID="b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9"
Oct 30 21:13:06.546661 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.546484    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01bf041-68dd-4d42-b13c-1a83211f909a","Type":"ContainerDied","Data":"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479"}
Oct 30 21:13:06.546661 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.546510    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01bf041-68dd-4d42-b13c-1a83211f909a","Type":"ContainerDied","Data":"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4"}
Oct 30 21:13:06.546661 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.546534    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01bf041-68dd-4d42-b13c-1a83211f909a","Type":"ContainerDied","Data":"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487"}
Oct 30 21:13:06.546661 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.546559    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01bf041-68dd-4d42-b13c-1a83211f909a","Type":"ContainerDied","Data":"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02"}
Oct 30 21:13:06.546661 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.546581    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d01bf041-68dd-4d42-b13c-1a83211f909a","Type":"ContainerDied","Data":"5ed34b2028ed2629284a159409e1de35a2f9e03543242c4b97eb13eefb23fb7c"}
Oct 30 21:13:06.554145 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.554104    4522 scope.go:122] "RemoveContainer" containerID="304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba"
Oct 30 21:13:06.560606 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.560590    4522 scope.go:122] "RemoveContainer" containerID="cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479"
Oct 30 21:13:06.566435 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.566418    4522 scope.go:122] "RemoveContainer" containerID="dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4"
Oct 30 21:13:06.572086 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.572070    4522 scope.go:122] "RemoveContainer" containerID="1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487"
Oct 30 21:13:06.578102 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.578088    4522 scope.go:122] "RemoveContainer" containerID="2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02"
Oct 30 21:13:06.584238 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.584224    4522 scope.go:122] "RemoveContainer" containerID="93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0"
Oct 30 21:13:06.589972 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.589956    4522 scope.go:122] "RemoveContainer" containerID="b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9"
Oct 30 21:13:06.590224 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:13:06.590203    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9\": container with ID starting with b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9 not found: ID does not exist" containerID="b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9"
Oct 30 21:13:06.590284 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.590236    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9"} err="failed to get container status \"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9\": rpc error: code = NotFound desc = could not find container \"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9\": container with ID starting with b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9 not found: ID does not exist"
Oct 30 21:13:06.590284 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.590262    4522 scope.go:122] "RemoveContainer" containerID="304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba"
Oct 30 21:13:06.590527 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:13:06.590508    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba\": container with ID starting with 304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba not found: ID does not exist" containerID="304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba"
Oct 30 21:13:06.590576 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.590538    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba"} err="failed to get container status \"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba\": rpc error: code = NotFound desc = could not find container \"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba\": container with ID starting with 304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba not found: ID does not exist"
Oct 30 21:13:06.590576 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.590554    4522 scope.go:122] "RemoveContainer" containerID="cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479"
Oct 30 21:13:06.590775 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:13:06.590758    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479\": container with ID starting with cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479 not found: ID does not exist" containerID="cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479"
Oct 30 21:13:06.590830 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.590783    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479"} err="failed to get container status \"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479\": rpc error: code = NotFound desc = could not find container \"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479\": container with ID starting with cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479 not found: ID does not exist"
Oct 30 21:13:06.590830 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.590802    4522 scope.go:122] "RemoveContainer" containerID="dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4"
Oct 30 21:13:06.591029 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:13:06.591013    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4\": container with ID starting with dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4 not found: ID does not exist" containerID="dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4"
Oct 30 21:13:06.591065 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.591037    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4"} err="failed to get container status \"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4\": rpc error: code = NotFound desc = could not find container \"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4\": container with ID starting with dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4 not found: ID does not exist"
Oct 30 21:13:06.591065 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.591051    4522 scope.go:122] "RemoveContainer" containerID="1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487"
Oct 30 21:13:06.591254 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:13:06.591237    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487\": container with ID starting with 1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487 not found: ID does not exist" containerID="1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487"
Oct 30 21:13:06.591324 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.591262    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487"} err="failed to get container status \"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487\": rpc error: code = NotFound desc = could not find container \"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487\": container with ID starting with 1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487 not found: ID does not exist"
Oct 30 21:13:06.591324 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.591279    4522 scope.go:122] "RemoveContainer" containerID="2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02"
Oct 30 21:13:06.591519 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:13:06.591501    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02\": container with ID starting with 2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02 not found: ID does not exist" containerID="2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02"
Oct 30 21:13:06.591584 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.591525    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02"} err="failed to get container status \"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02\": rpc error: code = NotFound desc = could not find container \"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02\": container with ID starting with 2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02 not found: ID does not exist"
Oct 30 21:13:06.591584 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.591542    4522 scope.go:122] "RemoveContainer" containerID="93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0"
Oct 30 21:13:06.591763 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:13:06.591745    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0\": container with ID starting with 93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0 not found: ID does not exist" containerID="93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0"
Oct 30 21:13:06.591808 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.591769    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0"} err="failed to get container status \"93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0\": rpc error: code = NotFound desc = could not find container \"93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0\": container with ID starting with 93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0 not found: ID does not exist"
Oct 30 21:13:06.591808 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.591785    4522 scope.go:122] "RemoveContainer" containerID="b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9"
Oct 30 21:13:06.592009 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.591992    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9"} err="failed to get container status \"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9\": rpc error: code = NotFound desc = could not find container \"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9\": container with ID starting with b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9 not found: ID does not exist"
Oct 30 21:13:06.592073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.592019    4522 scope.go:122] "RemoveContainer" containerID="304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba"
Oct 30 21:13:06.592231 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.592216    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba"} err="failed to get container status \"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba\": rpc error: code = NotFound desc = could not find container \"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba\": container with ID starting with 304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba not found: ID does not exist"
Oct 30 21:13:06.592276 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.592232    4522 scope.go:122] "RemoveContainer" containerID="cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479"
Oct 30 21:13:06.592453 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.592438    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479"} err="failed to get container status \"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479\": rpc error: code = NotFound desc = could not find container \"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479\": container with ID starting with cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479 not found: ID does not exist"
Oct 30 21:13:06.592534 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.592454    4522 scope.go:122] "RemoveContainer" containerID="dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4"
Oct 30 21:13:06.592687 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.592669    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4"} err="failed to get container status \"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4\": rpc error: code = NotFound desc = could not find container \"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4\": container with ID starting with dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4 not found: ID does not exist"
Oct 30 21:13:06.592729 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.592687    4522 scope.go:122] "RemoveContainer" containerID="1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487"
Oct 30 21:13:06.592891 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.592874    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487"} err="failed to get container status \"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487\": rpc error: code = NotFound desc = could not find container \"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487\": container with ID starting with 1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487 not found: ID does not exist"
Oct 30 21:13:06.592958 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.592892    4522 scope.go:122] "RemoveContainer" containerID="2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02"
Oct 30 21:13:06.593119 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.593100    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02"} err="failed to get container status \"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02\": rpc error: code = NotFound desc = could not find container \"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02\": container with ID starting with 2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02 not found: ID does not exist"
Oct 30 21:13:06.593162 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.593120    4522 scope.go:122] "RemoveContainer" containerID="93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0"
Oct 30 21:13:06.593313 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.593297    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0"} err="failed to get container status \"93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0\": rpc error: code = NotFound desc = could not find container \"93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0\": container with ID starting with 93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0 not found: ID does not exist"
Oct 30 21:13:06.593387 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.593313    4522 scope.go:122] "RemoveContainer" containerID="b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9"
Oct 30 21:13:06.593551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.593534    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9"} err="failed to get container status \"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9\": rpc error: code = NotFound desc = could not find container \"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9\": container with ID starting with b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9 not found: ID does not exist"
Oct 30 21:13:06.593601 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.593552    4522 scope.go:122] "RemoveContainer" containerID="304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba"
Oct 30 21:13:06.593747 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.593729    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba"} err="failed to get container status \"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba\": rpc error: code = NotFound desc = could not find container \"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba\": container with ID starting with 304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba not found: ID does not exist"
Oct 30 21:13:06.593814 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.593747    4522 scope.go:122] "RemoveContainer" containerID="cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479"
Oct 30 21:13:06.593967 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.593948    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479"} err="failed to get container status \"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479\": rpc error: code = NotFound desc = could not find container \"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479\": container with ID starting with cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479 not found: ID does not exist"
Oct 30 21:13:06.594037 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.593969    4522 scope.go:122] "RemoveContainer" containerID="dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4"
Oct 30 21:13:06.594173 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.594158    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4"} err="failed to get container status \"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4\": rpc error: code = NotFound desc = could not find container \"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4\": container with ID starting with dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4 not found: ID does not exist"
Oct 30 21:13:06.594235 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.594173    4522 scope.go:122] "RemoveContainer" containerID="1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487"
Oct 30 21:13:06.594396 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.594378    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487"} err="failed to get container status \"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487\": rpc error: code = NotFound desc = could not find container \"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487\": container with ID starting with 1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487 not found: ID does not exist"
Oct 30 21:13:06.594440 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.594398    4522 scope.go:122] "RemoveContainer" containerID="2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02"
Oct 30 21:13:06.594623 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.594606    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02"} err="failed to get container status \"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02\": rpc error: code = NotFound desc = could not find container \"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02\": container with ID starting with 2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02 not found: ID does not exist"
Oct 30 21:13:06.594700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.594624    4522 scope.go:122] "RemoveContainer" containerID="93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0"
Oct 30 21:13:06.594857 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.594840    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0"} err="failed to get container status \"93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0\": rpc error: code = NotFound desc = could not find container \"93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0\": container with ID starting with 93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0 not found: ID does not exist"
Oct 30 21:13:06.594916 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.594859    4522 scope.go:122] "RemoveContainer" containerID="b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9"
Oct 30 21:13:06.595053 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.595037    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9"} err="failed to get container status \"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9\": rpc error: code = NotFound desc = could not find container \"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9\": container with ID starting with b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9 not found: ID does not exist"
Oct 30 21:13:06.595100 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.595053    4522 scope.go:122] "RemoveContainer" containerID="304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba"
Oct 30 21:13:06.595261 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.595243    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba"} err="failed to get container status \"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba\": rpc error: code = NotFound desc = could not find container \"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba\": container with ID starting with 304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba not found: ID does not exist"
Oct 30 21:13:06.595302 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.595263    4522 scope.go:122] "RemoveContainer" containerID="cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479"
Oct 30 21:13:06.595501 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.595453    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479"} err="failed to get container status \"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479\": rpc error: code = NotFound desc = could not find container \"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479\": container with ID starting with cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479 not found: ID does not exist"
Oct 30 21:13:06.595574 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.595503    4522 scope.go:122] "RemoveContainer" containerID="dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4"
Oct 30 21:13:06.595737 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.595720    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4"} err="failed to get container status \"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4\": rpc error: code = NotFound desc = could not find container \"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4\": container with ID starting with dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4 not found: ID does not exist"
Oct 30 21:13:06.595783 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.595738    4522 scope.go:122] "RemoveContainer" containerID="1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487"
Oct 30 21:13:06.595951 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.595934    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487"} err="failed to get container status \"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487\": rpc error: code = NotFound desc = could not find container \"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487\": container with ID starting with 1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487 not found: ID does not exist"
Oct 30 21:13:06.595992 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.595952    4522 scope.go:122] "RemoveContainer" containerID="2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02"
Oct 30 21:13:06.596150 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.596133    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02"} err="failed to get container status \"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02\": rpc error: code = NotFound desc = could not find container \"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02\": container with ID starting with 2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02 not found: ID does not exist"
Oct 30 21:13:06.596187 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.596152    4522 scope.go:122] "RemoveContainer" containerID="93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0"
Oct 30 21:13:06.596380 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.596344    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0"} err="failed to get container status \"93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0\": rpc error: code = NotFound desc = could not find container \"93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0\": container with ID starting with 93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0 not found: ID does not exist"
Oct 30 21:13:06.596422 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.596381    4522 scope.go:122] "RemoveContainer" containerID="b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9"
Oct 30 21:13:06.596610 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.596593    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9"} err="failed to get container status \"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9\": rpc error: code = NotFound desc = could not find container \"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9\": container with ID starting with b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9 not found: ID does not exist"
Oct 30 21:13:06.596650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.596611    4522 scope.go:122] "RemoveContainer" containerID="304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba"
Oct 30 21:13:06.596799 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.596785    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba"} err="failed to get container status \"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba\": rpc error: code = NotFound desc = could not find container \"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba\": container with ID starting with 304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba not found: ID does not exist"
Oct 30 21:13:06.596836 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.596800    4522 scope.go:122] "RemoveContainer" containerID="cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479"
Oct 30 21:13:06.596977 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.596961    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479"} err="failed to get container status \"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479\": rpc error: code = NotFound desc = could not find container \"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479\": container with ID starting with cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479 not found: ID does not exist"
Oct 30 21:13:06.597024 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.596977    4522 scope.go:122] "RemoveContainer" containerID="dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4"
Oct 30 21:13:06.597153 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.597139    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4"} err="failed to get container status \"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4\": rpc error: code = NotFound desc = could not find container \"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4\": container with ID starting with dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4 not found: ID does not exist"
Oct 30 21:13:06.597196 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.597153    4522 scope.go:122] "RemoveContainer" containerID="1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487"
Oct 30 21:13:06.597337 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.597315    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487"} err="failed to get container status \"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487\": rpc error: code = NotFound desc = could not find container \"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487\": container with ID starting with 1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487 not found: ID does not exist"
Oct 30 21:13:06.597370 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.597337    4522 scope.go:122] "RemoveContainer" containerID="2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02"
Oct 30 21:13:06.597532 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.597517    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02"} err="failed to get container status \"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02\": rpc error: code = NotFound desc = could not find container \"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02\": container with ID starting with 2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02 not found: ID does not exist"
Oct 30 21:13:06.597582 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.597532    4522 scope.go:122] "RemoveContainer" containerID="93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0"
Oct 30 21:13:06.597732 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.597716    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0"} err="failed to get container status \"93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0\": rpc error: code = NotFound desc = could not find container \"93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0\": container with ID starting with 93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0 not found: ID does not exist"
Oct 30 21:13:06.597775 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.597732    4522 scope.go:122] "RemoveContainer" containerID="b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9"
Oct 30 21:13:06.597916 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.597900    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9"} err="failed to get container status \"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9\": rpc error: code = NotFound desc = could not find container \"b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9\": container with ID starting with b5bfa7ff0eeeb9784fa4b764be94ab8f5ea090dbc5d6d54eba6426fc0bee71d9 not found: ID does not exist"
Oct 30 21:13:06.597952 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.597915    4522 scope.go:122] "RemoveContainer" containerID="304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba"
Oct 30 21:13:06.598093 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.598077    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba"} err="failed to get container status \"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba\": rpc error: code = NotFound desc = could not find container \"304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba\": container with ID starting with 304995a719df3b1e8f3063b8ea2f4ec4ab1866fa1778a5d44cf8ba9c76f824ba not found: ID does not exist"
Oct 30 21:13:06.598166 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.598093    4522 scope.go:122] "RemoveContainer" containerID="cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479"
Oct 30 21:13:06.598271 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.598257    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479"} err="failed to get container status \"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479\": rpc error: code = NotFound desc = could not find container \"cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479\": container with ID starting with cb7ab4ca8f713fb1b9ee56ade0cd55d868f3c84664b8b67e3aa5290cad4f6479 not found: ID does not exist"
Oct 30 21:13:06.598314 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.598271    4522 scope.go:122] "RemoveContainer" containerID="dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4"
Oct 30 21:13:06.598507 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.598488    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4"} err="failed to get container status \"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4\": rpc error: code = NotFound desc = could not find container \"dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4\": container with ID starting with dbaf70750065402dc3a8c6ccb633ac240a7c33cb745274b094d30d6222e6c7f4 not found: ID does not exist"
Oct 30 21:13:06.598584 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.598508    4522 scope.go:122] "RemoveContainer" containerID="1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487"
Oct 30 21:13:06.598872 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.598846    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487"} err="failed to get container status \"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487\": rpc error: code = NotFound desc = could not find container \"1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487\": container with ID starting with 1150ccda4343ada1c7727c93b2211e9c1ad1dae621edad4d2791804193d7e487 not found: ID does not exist"
Oct 30 21:13:06.598918 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.598873    4522 scope.go:122] "RemoveContainer" containerID="2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02"
Oct 30 21:13:06.599102 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.599081    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02"} err="failed to get container status \"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02\": rpc error: code = NotFound desc = could not find container \"2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02\": container with ID starting with 2dd782b7b6f3f1833148fab72845da09d57a4d2d8d6be0774aa8fbeadfc22d02 not found: ID does not exist"
Oct 30 21:13:06.599144 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.599102    4522 scope.go:122] "RemoveContainer" containerID="93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0"
Oct 30 21:13:06.599319 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.599302    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0"} err="failed to get container status \"93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0\": rpc error: code = NotFound desc = could not find container \"93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0\": container with ID starting with 93f8e7866c6f41cd6863a341374f8d48a40dece1935390b7d774563dbf6b23e0 not found: ID does not exist"
Oct 30 21:13:06.711694 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.711663    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:13:06.714920 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.714878    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:13:06.743843 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.743821    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:13:06.744034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744023    4522 cpu_manager.go:414] "containerMap: removing container" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="prometheus"
Oct 30 21:13:06.744080 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744036    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="prometheus"
Oct 30 21:13:06.744080 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744046    4522 cpu_manager.go:414] "containerMap: removing container" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="kube-rbac-proxy-thanos"
Oct 30 21:13:06.744080 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744051    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="kube-rbac-proxy-thanos"
Oct 30 21:13:06.744080 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744063    4522 cpu_manager.go:414] "containerMap: removing container" podUID="3f3d6657-b9dd-4d70-889a-e480fa537ed9" containerName="insights-gathering"
Oct 30 21:13:06.744080 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744068    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3f3d6657-b9dd-4d70-889a-e480fa537ed9" containerName="insights-gathering"
Oct 30 21:13:06.744247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744086    4522 cpu_manager.go:414] "containerMap: removing container" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="init-config-reloader"
Oct 30 21:13:06.744247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744090    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="init-config-reloader"
Oct 30 21:13:06.744247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744096    4522 cpu_manager.go:414] "containerMap: removing container" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="thanos-sidecar"
Oct 30 21:13:06.744247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744101    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="thanos-sidecar"
Oct 30 21:13:06.744247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744107    4522 cpu_manager.go:414] "containerMap: removing container" podUID="7e64de4b-10d4-4bd0-94bb-d6fb6585146b" containerName="registry"
Oct 30 21:13:06.744247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744112    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e64de4b-10d4-4bd0-94bb-d6fb6585146b" containerName="registry"
Oct 30 21:13:06.744247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744119    4522 cpu_manager.go:414] "containerMap: removing container" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="config-reloader"
Oct 30 21:13:06.744247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744123    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="config-reloader"
Oct 30 21:13:06.744247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744128    4522 cpu_manager.go:414] "containerMap: removing container" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="kube-rbac-proxy-web"
Oct 30 21:13:06.744247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744132    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="kube-rbac-proxy-web"
Oct 30 21:13:06.744247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744138    4522 cpu_manager.go:414] "containerMap: removing container" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="kube-rbac-proxy"
Oct 30 21:13:06.744247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744142    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="kube-rbac-proxy"
Oct 30 21:13:06.744247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744177    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="config-reloader"
Oct 30 21:13:06.744247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744184    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="kube-rbac-proxy-web"
Oct 30 21:13:06.744247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744188    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="kube-rbac-proxy"
Oct 30 21:13:06.744247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744194    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="prometheus"
Oct 30 21:13:06.744247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744198    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="kube-rbac-proxy-thanos"
Oct 30 21:13:06.744247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744204    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="3f3d6657-b9dd-4d70-889a-e480fa537ed9" containerName="insights-gathering"
Oct 30 21:13:06.744247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744211    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" containerName="thanos-sidecar"
Oct 30 21:13:06.744247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.744215    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="7e64de4b-10d4-4bd0-94bb-d6fb6585146b" containerName="registry"
Oct 30 21:13:06.748613 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.748597    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.800594 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.800572    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 21:13:06.800734 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.800712    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 21:13:06.800796 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.800740    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 21:13:06.800796 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.800775    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 21:13:06.800869 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.800826    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 21:13:06.800869 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.800839    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1qcj4gm7c3o7k\""
Oct 30 21:13:06.800977 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.800895    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 21:13:06.800977 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.800951    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 21:13:06.800977 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.800961    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fbr78\""
Oct 30 21:13:06.800977 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.800952    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 21:13:06.801130 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.801009    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 21:13:06.801234 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.801218    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 21:13:06.801409 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.801386    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 21:13:06.801409 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.801404    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 21:13:06.801506 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.801416    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 21:13:06.815638 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.815591    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/83d86e94-68f3-407a-9ad8-c2291703c3c5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.815638 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.815619    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83d86e94-68f3-407a-9ad8-c2291703c3c5-config-out\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.815732 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.815637    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.815732 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.815663    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.815732 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.815708    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-web-config\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.815835 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.815733    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.815835 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.815748    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwgpd\" (UniqueName: \"kubernetes.io/projected/83d86e94-68f3-407a-9ad8-c2291703c3c5-kube-api-access-lwgpd\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.815901 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.815842    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.815901 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.815862    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.815901 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.815878    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.815901 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.815893    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.816019 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.815914    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83d86e94-68f3-407a-9ad8-c2291703c3c5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.816019 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.815976    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.816019 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.815998    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.816112 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.816024    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-config\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.816112 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.816039    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.816112 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.816057    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.816202 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.816132    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.816202 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.816172    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.816202 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.816197    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.850716 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.850698    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 21:13:06.850918 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.850901    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 21:13:06.916593 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.916568    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.916700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.916598    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/83d86e94-68f3-407a-9ad8-c2291703c3c5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.916700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.916617    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83d86e94-68f3-407a-9ad8-c2291703c3c5-config-out\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.916700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.916632    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.916700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.916648    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.916700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.916662    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-web-config\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.916929 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.916765    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.916929 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.916792    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwgpd\" (UniqueName: \"kubernetes.io/projected/83d86e94-68f3-407a-9ad8-c2291703c3c5-kube-api-access-lwgpd\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.916929 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.916825    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.916929 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.916856    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.916929 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.916881    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.916929 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.916913    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.917213 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.916943    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83d86e94-68f3-407a-9ad8-c2291703c3c5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.917213 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.916969    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.917213 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.916995    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.917213 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.917021    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-config\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.917213 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.917045    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.917213 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.917073    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.917213 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.917110    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/83d86e94-68f3-407a-9ad8-c2291703c3c5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.917213 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.917119    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.917213 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.917206    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.917662 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.917454    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.919157 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.918866    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.919157 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.918885    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.919157 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.919045    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.919775 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.919373    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.919775 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.919677    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.920028 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.920005    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.920100 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.920041    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-web-config\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.920269 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.920242    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.920892 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.920852    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.921138 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.921118    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83d86e94-68f3-407a-9ad8-c2291703c3c5-config-out\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.921646 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.921624    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/83d86e94-68f3-407a-9ad8-c2291703c3c5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.921999 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.921972    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.922109 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.922087    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.922168 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.922120    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.922227 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.922215    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.922335 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.922316    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83d86e94-68f3-407a-9ad8-c2291703c3c5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.923071 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.923052    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/83d86e94-68f3-407a-9ad8-c2291703c3c5-config\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:06.970294 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.970272    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:13:06.973584 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.973534    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:13:06.974041 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:06.974015    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwgpd\" (UniqueName: \"kubernetes.io/projected/83d86e94-68f3-407a-9ad8-c2291703c3c5-kube-api-access-lwgpd\") pod \"prometheus-k8s-0\" (UID: \"83d86e94-68f3-407a-9ad8-c2291703c3c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:07.072452 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:07.072411    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:07.165231 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:07.165191    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:13:07.188958 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:07.188933    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d01bf041-68dd-4d42-b13c-1a83211f909a" path="/var/lib/kubelet/pods/d01bf041-68dd-4d42-b13c-1a83211f909a/volumes"
Oct 30 21:13:07.496922 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:07.496896    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 21:13:07.500166 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:13:07.500137    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83d86e94_68f3_407a_9ad8_c2291703c3c5.slice/crio-81ee5051cce3777740cddab1578756edf918b565800de3b6d187eddbea9ea42f WatchSource:0}: Error finding container 81ee5051cce3777740cddab1578756edf918b565800de3b6d187eddbea9ea42f: Status 404 returned error can't find the container with id 81ee5051cce3777740cddab1578756edf918b565800de3b6d187eddbea9ea42f
Oct 30 21:13:07.551954 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:07.551926    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83d86e94-68f3-407a-9ad8-c2291703c3c5","Type":"ContainerStarted","Data":"81ee5051cce3777740cddab1578756edf918b565800de3b6d187eddbea9ea42f"}
Oct 30 21:13:07.986979 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:13:07.986947    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:13:08.560290 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:08.560257    4522 generic.go:356] "Generic (PLEG): container finished" podID="83d86e94-68f3-407a-9ad8-c2291703c3c5" containerID="57f3aaaac9c6259ffdb9667f269d26842b920f7a217abb9fb120c172c275ca41" exitCode=0
Oct 30 21:13:08.560680 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:08.560323    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83d86e94-68f3-407a-9ad8-c2291703c3c5","Type":"ContainerDied","Data":"57f3aaaac9c6259ffdb9667f269d26842b920f7a217abb9fb120c172c275ca41"}
Oct 30 21:13:09.566234 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:09.566198    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83d86e94-68f3-407a-9ad8-c2291703c3c5","Type":"ContainerStarted","Data":"ef93c70d4a76bde7af040211e0f5977db5ff04b188bcb55d7ee609bd48894eae"}
Oct 30 21:13:09.566650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:09.566260    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83d86e94-68f3-407a-9ad8-c2291703c3c5","Type":"ContainerStarted","Data":"6d245277abb8264b6b4a914d768e236dbc3ed2dffc13305ffe96acc2bb3a3ef9"}
Oct 30 21:13:09.566650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:09.566286    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83d86e94-68f3-407a-9ad8-c2291703c3c5","Type":"ContainerStarted","Data":"6c825eeb61b440e9ee79b03b32bd9278605538f0222e1b0186dadaff9a0bf01e"}
Oct 30 21:13:09.566650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:09.566309    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83d86e94-68f3-407a-9ad8-c2291703c3c5","Type":"ContainerStarted","Data":"4f9ab88b84ac35e08f33920c294c28c455da79ef9bb911ac80e3ef9546bc3afa"}
Oct 30 21:13:09.566650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:09.566332    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83d86e94-68f3-407a-9ad8-c2291703c3c5","Type":"ContainerStarted","Data":"90415d66ac1a5312cadec64bc6fa32d7259eae0b8845228973894dd980655768"}
Oct 30 21:13:09.566650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:09.566355    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83d86e94-68f3-407a-9ad8-c2291703c3c5","Type":"ContainerStarted","Data":"48fed8172acb2c69f801ee61c46bb8e16f61cb03dd2991c989e42f2ad8be203e"}
Oct 30 21:13:09.693280 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:09.693225    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.678874942 podStartE2EDuration="3.693207384s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.332442ms" isStatefulPod=false podCreationTimestamp="2026-10-30 21:13:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:13:09.692528497 +0000 UTC m=+98.637473858" watchObservedRunningTime="2026-10-30 21:13:09.693207384 +0000 UTC m=+98.638152744"
Oct 30 21:13:12.073498 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:12.073448    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:13:16.574092 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:16.574054    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:13:17.178687 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:17.178654    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:13:17.372394 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:13:17.372358    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:13:37.986039 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:13:37.986005    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:14:07.072864 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:14:07.072785    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:14:07.087494 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:14:07.087452    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:14:07.763588 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:14:07.763565    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 21:14:07.985175 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:14:07.985135    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:14:16.920906 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:14:16.920873    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:37.985567 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:14:37.985533    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:15:01.354391 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:15:01.354358    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:01.539729 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:15:01.539701    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:07.987665 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:15:07.987627    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:15:17.268809 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:15:17.268739    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:18.598581 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:15:18.598548    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:37.986089 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:15:37.986056    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:15:57.215585 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:15:57.215547    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:07.987006 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:16:07.986970    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:16:17.594966 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:16:17.594925    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:21.975093 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:16:21.975057    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:22.173283 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:16:22.173215    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:23.557612 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:16:23.557577    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:23.800221 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:16:23.800174    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:24.890154 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:16:24.890101    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:29.706828 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:16:29.706797    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:29.899043 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:16:29.899012    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:30.651979 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:16:30.651933    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:30.914105 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:16:30.914080    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:31.134304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:16:31.134260    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:31.196118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:16:31.196095    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:16:31.196765 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:16:31.196737    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:16:34.655979 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:16:34.655920    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:37.986609 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:16:37.986569    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:16:50.111737 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:16:50.111656    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:50.306567 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:16:50.306533    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:53.045774 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:16:53.045736    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:53.228900 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:16:53.228872    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:07.987626 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:17:07.987582    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:17:17.944690 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:17.944656    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:22.466928 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:22.466890    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:22.653670 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:22.653637    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:24.217993 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:24.217958    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-c5rhc"]
Oct 30 21:17:24.220888 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:24.220872    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c5rhc"
Oct 30 21:17:24.264265 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:24.264244    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kv7r\" (UniqueName: \"kubernetes.io/projected/f1b2dc54-7e37-4408-877f-ca01b896b4d8-kube-api-access-8kv7r\") pod \"jobset-operator-674cd59dc5-c5rhc\" (UID: \"f1b2dc54-7e37-4408-877f-ca01b896b4d8\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c5rhc"
Oct 30 21:17:24.264384 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:24.264294    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1b2dc54-7e37-4408-877f-ca01b896b4d8-tmp\") pod \"jobset-operator-674cd59dc5-c5rhc\" (UID: \"f1b2dc54-7e37-4408-877f-ca01b896b4d8\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c5rhc"
Oct 30 21:17:24.273086 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:24.273065    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:17:24.322403 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:24.322376    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Oct 30 21:17:24.322587 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:24.322569    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-jdmhf\""
Oct 30 21:17:24.323315 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:24.323294    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-c5rhc"]
Oct 30 21:17:24.364635 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:24.364614    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kv7r\" (UniqueName: \"kubernetes.io/projected/f1b2dc54-7e37-4408-877f-ca01b896b4d8-kube-api-access-8kv7r\") pod \"jobset-operator-674cd59dc5-c5rhc\" (UID: \"f1b2dc54-7e37-4408-877f-ca01b896b4d8\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c5rhc"
Oct 30 21:17:24.364727 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:24.364657    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1b2dc54-7e37-4408-877f-ca01b896b4d8-tmp\") pod \"jobset-operator-674cd59dc5-c5rhc\" (UID: \"f1b2dc54-7e37-4408-877f-ca01b896b4d8\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c5rhc"
Oct 30 21:17:24.364927 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:24.364911    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1b2dc54-7e37-4408-877f-ca01b896b4d8-tmp\") pod \"jobset-operator-674cd59dc5-c5rhc\" (UID: \"f1b2dc54-7e37-4408-877f-ca01b896b4d8\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c5rhc"
Oct 30 21:17:24.420355 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:24.420336    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kv7r\" (UniqueName: \"kubernetes.io/projected/f1b2dc54-7e37-4408-877f-ca01b896b4d8-kube-api-access-8kv7r\") pod \"jobset-operator-674cd59dc5-c5rhc\" (UID: \"f1b2dc54-7e37-4408-877f-ca01b896b4d8\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c5rhc"
Oct 30 21:17:24.544069 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:24.544020    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c5rhc"
Oct 30 21:17:24.910131 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:24.910021    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-c5rhc"]
Oct 30 21:17:24.914423 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:17:24.914397    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1b2dc54_7e37_4408_877f_ca01b896b4d8.slice/crio-bbf61deba60eaa7006689d28c54853f956245148cda5fcc9b23ab27380df14ca WatchSource:0}: Error finding container bbf61deba60eaa7006689d28c54853f956245148cda5fcc9b23ab27380df14ca: Status 404 returned error can't find the container with id bbf61deba60eaa7006689d28c54853f956245148cda5fcc9b23ab27380df14ca
Oct 30 21:17:24.916333 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:24.916315    4522 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:17:25.339800 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:25.339768    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c5rhc" event={"ID":"f1b2dc54-7e37-4408-877f-ca01b896b4d8","Type":"ContainerStarted","Data":"bbf61deba60eaa7006689d28c54853f956245148cda5fcc9b23ab27380df14ca"}
Oct 30 21:17:29.354967 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:29.354935    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c5rhc" event={"ID":"f1b2dc54-7e37-4408-877f-ca01b896b4d8","Type":"ContainerStarted","Data":"4f66ae9759f54aa73d82f51d4d383068ca3a7c8c7fb9fdf25784f2c435b7f3ee"}
Oct 30 21:17:29.472664 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:29.472613    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-c5rhc" podStartSLOduration=1.846075964 podStartE2EDuration="5.472599073s" totalImagesPullingTime="3.626523109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:17:29.471829475 +0000 UTC m=+358.416774835" watchObservedRunningTime="2026-10-30 21:17:29.472599073 +0000 UTC m=+358.417544670"
Oct 30 21:17:29.821615 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:29.821577    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:30.035760 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:30.035723    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:30.951002 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:30.950969    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:31.179397 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.179360    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"]
Oct 30 21:17:31.182659 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.182642    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:31.211999 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.211941    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd-tmp\") pod \"opendatahub-operator-controller-manager-6c776cd74c-wpzsh\" (UID: \"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:31.211999 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.211983    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd-manifests\") pod \"opendatahub-operator-controller-manager-6c776cd74c-wpzsh\" (UID: \"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:31.212166 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.212003    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c776cd74c-wpzsh\" (UID: \"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:31.212166 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.212081    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v78b4\" (UniqueName: \"kubernetes.io/projected/5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd-kube-api-access-v78b4\") pod \"opendatahub-operator-controller-manager-6c776cd74c-wpzsh\" (UID: \"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:31.212166 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.212130    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c776cd74c-wpzsh\" (UID: \"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:31.212316 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.212244    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd-metrics-cert\") pod \"opendatahub-operator-controller-manager-6c776cd74c-wpzsh\" (UID: \"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:31.264892 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.264862    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:31.279694 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.279677    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 30 21:17:31.279787 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.279710    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 30 21:17:31.279967 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.279953    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 30 21:17:31.286208 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.286192    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 30 21:17:31.286208 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.286200    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 30 21:17:31.286318 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.286193    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-d5dq4\""
Oct 30 21:17:31.300496 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.300472    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"]
Oct 30 21:17:31.313521 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.313499    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c776cd74c-wpzsh\" (UID: \"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:31.313626 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.313547    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd-metrics-cert\") pod \"opendatahub-operator-controller-manager-6c776cd74c-wpzsh\" (UID: \"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:31.313626 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.313579    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd-tmp\") pod \"opendatahub-operator-controller-manager-6c776cd74c-wpzsh\" (UID: \"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:31.313626 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.313608    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd-manifests\") pod \"opendatahub-operator-controller-manager-6c776cd74c-wpzsh\" (UID: \"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:31.313783 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.313638    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c776cd74c-wpzsh\" (UID: \"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:31.313783 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.313665    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v78b4\" (UniqueName: \"kubernetes.io/projected/5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd-kube-api-access-v78b4\") pod \"opendatahub-operator-controller-manager-6c776cd74c-wpzsh\" (UID: \"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:31.314161 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.314134    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd-manifests\") pod \"opendatahub-operator-controller-manager-6c776cd74c-wpzsh\" (UID: \"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:31.315995 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.315970    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd-tmp\") pod \"opendatahub-operator-controller-manager-6c776cd74c-wpzsh\" (UID: \"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:31.316168 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.316146    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c776cd74c-wpzsh\" (UID: \"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:31.316322 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.316303    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd-metrics-cert\") pod \"opendatahub-operator-controller-manager-6c776cd74c-wpzsh\" (UID: \"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:31.316401 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.316387    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c776cd74c-wpzsh\" (UID: \"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:31.370114 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.370094    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v78b4\" (UniqueName: \"kubernetes.io/projected/5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd-kube-api-access-v78b4\") pod \"opendatahub-operator-controller-manager-6c776cd74c-wpzsh\" (UID: \"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:31.453749 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.453722    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:31.497064 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.497016    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:31.644311 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:31.644277    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:32.000039 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:32.000012    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"]
Oct 30 21:17:32.004245 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:17:32.004216    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f32d2b7_d5c3_4b13_8a80_fe8cc978a7cd.slice/crio-4217462150aff0661724ed21a26575fa81b0eb65054f51af96c8cd2006069ecd WatchSource:0}: Error finding container 4217462150aff0661724ed21a26575fa81b0eb65054f51af96c8cd2006069ecd: Status 404 returned error can't find the container with id 4217462150aff0661724ed21a26575fa81b0eb65054f51af96c8cd2006069ecd
Oct 30 21:17:32.365443 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:32.365379    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh" event={"ID":"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd","Type":"ContainerStarted","Data":"4217462150aff0661724ed21a26575fa81b0eb65054f51af96c8cd2006069ecd"}
Oct 30 21:17:33.225257 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:33.225216    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:34.456792 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:34.456755    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:36.381917 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:36.381885    4522 generic.go:356] "Generic (PLEG): container finished" podID="5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd" containerID="a50f67e9aeddbeca4e94bea16368430ee6a435a716048443dab78fc51006ad4b" exitCode=0
Oct 30 21:17:36.382258 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:36.381924    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh" event={"ID":"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd","Type":"ContainerDied","Data":"a50f67e9aeddbeca4e94bea16368430ee6a435a716048443dab78fc51006ad4b"}
Oct 30 21:17:37.109302 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:37.109275    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:37.386750 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:37.386687    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh" event={"ID":"5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd","Type":"ContainerStarted","Data":"40f36524d73a816884784deec2666db80236e1f5adf13ba7f55a234aa78eab3c"}
Oct 30 21:17:37.387047 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:37.386814    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:37.621082 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:37.621033    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh" podStartSLOduration=2.701643659 podStartE2EDuration="7.621019068s" totalImagesPullingTime="4.466308009s" totalInitContainerRuntime="453.0674ms" isStatefulPod=false podCreationTimestamp="2026-10-30 21:17:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:17:37.571721355 +0000 UTC m=+366.516666714" watchObservedRunningTime="2026-10-30 21:17:37.621019068 +0000 UTC m=+366.565964423"
Oct 30 21:17:37.985773 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:17:37.985735    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:17:38.389370 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:38.389294    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:39.594959 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:39.594927    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:40.035039 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:40.035005    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:40.287922 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:40.287831    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:42.878106 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:42.878080    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:43.122979 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:43.122952    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:43.965569 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:43.965534    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-9g42s"]
Oct 30 21:17:43.971836 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:43.971815    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-9g42s"
Oct 30 21:17:44.032215 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:44.032182    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-9g42s"]
Oct 30 21:17:44.077140 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:44.077083    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Oct 30 21:17:44.077315 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:44.077176    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Oct 30 21:17:44.077315 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:44.077264    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ntvzk\""
Oct 30 21:17:44.113907 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:44.113869    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7f278ca-5480-4bcf-a935-89b7a23f16dc-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-9g42s\" (UID: \"e7f278ca-5480-4bcf-a935-89b7a23f16dc\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-9g42s"
Oct 30 21:17:44.114037 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:44.113911    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpv6n\" (UniqueName: \"kubernetes.io/projected/e7f278ca-5480-4bcf-a935-89b7a23f16dc-kube-api-access-dpv6n\") pod \"cert-manager-webhook-5dbbbf75cc-9g42s\" (UID: \"e7f278ca-5480-4bcf-a935-89b7a23f16dc\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-9g42s"
Oct 30 21:17:44.214851 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:44.214810    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7f278ca-5480-4bcf-a935-89b7a23f16dc-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-9g42s\" (UID: \"e7f278ca-5480-4bcf-a935-89b7a23f16dc\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-9g42s"
Oct 30 21:17:44.214851 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:44.214854    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpv6n\" (UniqueName: \"kubernetes.io/projected/e7f278ca-5480-4bcf-a935-89b7a23f16dc-kube-api-access-dpv6n\") pod \"cert-manager-webhook-5dbbbf75cc-9g42s\" (UID: \"e7f278ca-5480-4bcf-a935-89b7a23f16dc\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-9g42s"
Oct 30 21:17:44.276753 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:44.276690    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7f278ca-5480-4bcf-a935-89b7a23f16dc-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-9g42s\" (UID: \"e7f278ca-5480-4bcf-a935-89b7a23f16dc\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-9g42s"
Oct 30 21:17:44.276869 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:44.276792    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpv6n\" (UniqueName: \"kubernetes.io/projected/e7f278ca-5480-4bcf-a935-89b7a23f16dc-kube-api-access-dpv6n\") pod \"cert-manager-webhook-5dbbbf75cc-9g42s\" (UID: \"e7f278ca-5480-4bcf-a935-89b7a23f16dc\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-9g42s"
Oct 30 21:17:44.282475 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:44.282431    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-9g42s"
Oct 30 21:17:44.512614 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:44.512584    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:44.654874 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:44.654799    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-9g42s"]
Oct 30 21:17:44.658440 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:17:44.658414    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7f278ca_5480_4bcf_a935_89b7a23f16dc.slice/crio-6ae82688e930510e0bffbafb887bb327893661655bc37186a193b9ea192900b8 WatchSource:0}: Error finding container 6ae82688e930510e0bffbafb887bb327893661655bc37186a193b9ea192900b8: Status 404 returned error can't find the container with id 6ae82688e930510e0bffbafb887bb327893661655bc37186a193b9ea192900b8
Oct 30 21:17:44.711914 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:44.711878    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:44.904615 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:44.904575    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:45.412833 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:45.412798    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-9g42s" event={"ID":"e7f278ca-5480-4bcf-a935-89b7a23f16dc","Type":"ContainerStarted","Data":"6ae82688e930510e0bffbafb887bb327893661655bc37186a193b9ea192900b8"}
Oct 30 21:17:45.788793 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:45.788756    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:47.989403 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:47.989366    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:48.391915 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:48.391850    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6c776cd74c-wpzsh"
Oct 30 21:17:49.003152 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:49.003115    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:49.161546 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:49.161513    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-s66sl"]
Oct 30 21:17:49.164917 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:49.164896    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-s66sl"
Oct 30 21:17:49.199437 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:49.199390    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:49.216662 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:49.216627    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nxr8n\""
Oct 30 21:17:49.223133 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:49.223108    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-s66sl"]
Oct 30 21:17:49.254183 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:49.254113    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbzt9\" (UniqueName: \"kubernetes.io/projected/05398728-d558-4464-8d0a-c606922f0c52-kube-api-access-fbzt9\") pod \"cert-manager-cainjector-5c57bbd4fc-s66sl\" (UID: \"05398728-d558-4464-8d0a-c606922f0c52\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-s66sl"
Oct 30 21:17:49.254339 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:49.254239    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05398728-d558-4464-8d0a-c606922f0c52-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-s66sl\" (UID: \"05398728-d558-4464-8d0a-c606922f0c52\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-s66sl"
Oct 30 21:17:49.354931 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:49.354895    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05398728-d558-4464-8d0a-c606922f0c52-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-s66sl\" (UID: \"05398728-d558-4464-8d0a-c606922f0c52\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-s66sl"
Oct 30 21:17:49.355096 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:49.355073    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbzt9\" (UniqueName: \"kubernetes.io/projected/05398728-d558-4464-8d0a-c606922f0c52-kube-api-access-fbzt9\") pod \"cert-manager-cainjector-5c57bbd4fc-s66sl\" (UID: \"05398728-d558-4464-8d0a-c606922f0c52\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-s66sl"
Oct 30 21:17:49.390374 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:49.390349    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:49.411834 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:49.411808    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05398728-d558-4464-8d0a-c606922f0c52-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-s66sl\" (UID: \"05398728-d558-4464-8d0a-c606922f0c52\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-s66sl"
Oct 30 21:17:49.411951 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:49.411866    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbzt9\" (UniqueName: \"kubernetes.io/projected/05398728-d558-4464-8d0a-c606922f0c52-kube-api-access-fbzt9\") pod \"cert-manager-cainjector-5c57bbd4fc-s66sl\" (UID: \"05398728-d558-4464-8d0a-c606922f0c52\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-s66sl"
Oct 30 21:17:49.479731 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:49.479537    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-s66sl"
Oct 30 21:17:49.786921 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:49.786848    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:49.872336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:49.872300    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-s66sl"]
Oct 30 21:17:49.876811 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:17:49.876785    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05398728_d558_4464_8d0a_c606922f0c52.slice/crio-bbe742b2be7e060d63cd01d5bb7c0d1c1371e5249530c34a0db29d56f4033c30 WatchSource:0}: Error finding container bbe742b2be7e060d63cd01d5bb7c0d1c1371e5249530c34a0db29d56f4033c30: Status 404 returned error can't find the container with id bbe742b2be7e060d63cd01d5bb7c0d1c1371e5249530c34a0db29d56f4033c30
Oct 30 21:17:50.433383 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:50.433346    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-s66sl" event={"ID":"05398728-d558-4464-8d0a-c606922f0c52","Type":"ContainerStarted","Data":"bbe742b2be7e060d63cd01d5bb7c0d1c1371e5249530c34a0db29d56f4033c30"}
Oct 30 21:17:51.438028 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:51.437994    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-9g42s" event={"ID":"e7f278ca-5480-4bcf-a935-89b7a23f16dc","Type":"ContainerStarted","Data":"e5b2d4f09f6c53eba5f96065bd492a5107dfe613756ffe9ec9ef503255988ca3"}
Oct 30 21:17:51.438364 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:51.438094    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-9g42s"
Oct 30 21:17:51.559411 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:51.559353    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-9g42s" podStartSLOduration=1.885478771 podStartE2EDuration="8.5593411s" totalImagesPullingTime="6.673862329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:17:51.55821802 +0000 UTC m=+380.503163380" watchObservedRunningTime="2026-10-30 21:17:51.5593411 +0000 UTC m=+380.504286459"
Oct 30 21:17:52.443007 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:52.442964    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-s66sl" event={"ID":"05398728-d558-4464-8d0a-c606922f0c52","Type":"ContainerStarted","Data":"c7fedac25e0d3aa9447d113bde2b75afc461466ce5681b063c1eb3cebe8afb0e"}
Oct 30 21:17:52.556727 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:52.556677    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-s66sl" podStartSLOduration=1.904910936 podStartE2EDuration="3.556663039s" totalImagesPullingTime="1.651752103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:17:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:17:52.556298565 +0000 UTC m=+381.501243927" watchObservedRunningTime="2026-10-30 21:17:52.556663039 +0000 UTC m=+381.501608398"
Oct 30 21:17:53.127093 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:53.127064    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:53.315394 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:53.315363    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:54.331217 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:54.331179    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:55.024051 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:55.024020    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:55.420703 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:55.420663    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:56.859993 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:56.859957    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:57.057444 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:57.057411    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:57.444889 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:57.444865    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-9g42s"
Oct 30 21:17:59.635589 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:59.635561    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:59.828930 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:17:59.828876    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:00.043526 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:00.043493    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:00.606021 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:00.605991    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:00.796105 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:00.796072    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:03.400150 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:03.400120    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:03.537867 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:03.537833    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-597b95cb84-b6l4v"]
Oct 30 21:18:03.539925 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:03.539910    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-b6l4v"
Oct 30 21:18:03.586292 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:03.586268    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:03.640626 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:03.640591    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5l9r4\""
Oct 30 21:18:03.641578 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:03.641557    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-b6l4v"]
Oct 30 21:18:03.661445 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:03.661371    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e3b7f0a-bd55-43d3-ad22-4ebb831fcf4b-bound-sa-token\") pod \"cert-manager-597b95cb84-b6l4v\" (UID: \"2e3b7f0a-bd55-43d3-ad22-4ebb831fcf4b\") " pod="cert-manager/cert-manager-597b95cb84-b6l4v"
Oct 30 21:18:03.661445 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:03.661417    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlchm\" (UniqueName: \"kubernetes.io/projected/2e3b7f0a-bd55-43d3-ad22-4ebb831fcf4b-kube-api-access-mlchm\") pod \"cert-manager-597b95cb84-b6l4v\" (UID: \"2e3b7f0a-bd55-43d3-ad22-4ebb831fcf4b\") " pod="cert-manager/cert-manager-597b95cb84-b6l4v"
Oct 30 21:18:03.762683 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:03.762642    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e3b7f0a-bd55-43d3-ad22-4ebb831fcf4b-bound-sa-token\") pod \"cert-manager-597b95cb84-b6l4v\" (UID: \"2e3b7f0a-bd55-43d3-ad22-4ebb831fcf4b\") " pod="cert-manager/cert-manager-597b95cb84-b6l4v"
Oct 30 21:18:03.762683 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:03.762692    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlchm\" (UniqueName: \"kubernetes.io/projected/2e3b7f0a-bd55-43d3-ad22-4ebb831fcf4b-kube-api-access-mlchm\") pod \"cert-manager-597b95cb84-b6l4v\" (UID: \"2e3b7f0a-bd55-43d3-ad22-4ebb831fcf4b\") " pod="cert-manager/cert-manager-597b95cb84-b6l4v"
Oct 30 21:18:03.818931 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:03.818898    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e3b7f0a-bd55-43d3-ad22-4ebb831fcf4b-bound-sa-token\") pod \"cert-manager-597b95cb84-b6l4v\" (UID: \"2e3b7f0a-bd55-43d3-ad22-4ebb831fcf4b\") " pod="cert-manager/cert-manager-597b95cb84-b6l4v"
Oct 30 21:18:03.819187 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:03.819165    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlchm\" (UniqueName: \"kubernetes.io/projected/2e3b7f0a-bd55-43d3-ad22-4ebb831fcf4b-kube-api-access-mlchm\") pod \"cert-manager-597b95cb84-b6l4v\" (UID: \"2e3b7f0a-bd55-43d3-ad22-4ebb831fcf4b\") " pod="cert-manager/cert-manager-597b95cb84-b6l4v"
Oct 30 21:18:03.849401 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:03.849379    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-b6l4v"
Oct 30 21:18:04.213011 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:04.212983    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-b6l4v"]
Oct 30 21:18:04.216035 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:18:04.216007    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e3b7f0a_bd55_43d3_ad22_4ebb831fcf4b.slice/crio-3811055641ccf2c12f7f811f214aeecea8cc510b98260537b4f11d7b3367216d WatchSource:0}: Error finding container 3811055641ccf2c12f7f811f214aeecea8cc510b98260537b4f11d7b3367216d: Status 404 returned error can't find the container with id 3811055641ccf2c12f7f811f214aeecea8cc510b98260537b4f11d7b3367216d
Oct 30 21:18:04.483021 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:04.482949    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-b6l4v" event={"ID":"2e3b7f0a-bd55-43d3-ad22-4ebb831fcf4b","Type":"ContainerStarted","Data":"c1a3533cb6e06e116f3908950b810fa2374132ddcc1af1da7d8914aa2ca3a9cd"}
Oct 30 21:18:04.483021 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:04.482989    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-b6l4v" event={"ID":"2e3b7f0a-bd55-43d3-ad22-4ebb831fcf4b","Type":"ContainerStarted","Data":"3811055641ccf2c12f7f811f214aeecea8cc510b98260537b4f11d7b3367216d"}
Oct 30 21:18:04.595468 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:04.595424    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-597b95cb84-b6l4v" podStartSLOduration=1.595412695 podStartE2EDuration="1.595412695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:18:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:18:04.595291722 +0000 UTC m=+393.540237076" watchObservedRunningTime="2026-10-30 21:18:04.595412695 +0000 UTC m=+393.540358055"
Oct 30 21:18:05.190450 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.190423    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-jbzwc"]
Oct 30 21:18:05.192497 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.192481    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jbzwc"
Oct 30 21:18:05.207734 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.207711    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:05.247051 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.247028    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 21:18:05.248775 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.248751    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-jbzwc"]
Oct 30 21:18:05.273465 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.273443    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bd9a54f-808e-4306-804a-fb1d899bf32f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-jbzwc\" (UID: \"3bd9a54f-808e-4306-804a-fb1d899bf32f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jbzwc"
Oct 30 21:18:05.273554 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.273486    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3bd9a54f-808e-4306-804a-fb1d899bf32f-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-jbzwc\" (UID: \"3bd9a54f-808e-4306-804a-fb1d899bf32f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jbzwc"
Oct 30 21:18:05.273681 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.273661    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhrcs\" (UniqueName: \"kubernetes.io/projected/3bd9a54f-808e-4306-804a-fb1d899bf32f-kube-api-access-qhrcs\") pod \"kuadrant-console-plugin-66c4fb575d-jbzwc\" (UID: \"3bd9a54f-808e-4306-804a-fb1d899bf32f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jbzwc"
Oct 30 21:18:05.296007 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.295986    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Oct 30 21:18:05.296007 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.295986    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Oct 30 21:18:05.296114 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.296012    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 21:18:05.296114 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.296015    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bxt97\""
Oct 30 21:18:05.374300 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.374280    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bd9a54f-808e-4306-804a-fb1d899bf32f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-jbzwc\" (UID: \"3bd9a54f-808e-4306-804a-fb1d899bf32f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jbzwc"
Oct 30 21:18:05.374401 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.374307    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3bd9a54f-808e-4306-804a-fb1d899bf32f-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-jbzwc\" (UID: \"3bd9a54f-808e-4306-804a-fb1d899bf32f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jbzwc"
Oct 30 21:18:05.374401 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.374340    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhrcs\" (UniqueName: \"kubernetes.io/projected/3bd9a54f-808e-4306-804a-fb1d899bf32f-kube-api-access-qhrcs\") pod \"kuadrant-console-plugin-66c4fb575d-jbzwc\" (UID: \"3bd9a54f-808e-4306-804a-fb1d899bf32f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jbzwc"
Oct 30 21:18:05.374924 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.374905    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3bd9a54f-808e-4306-804a-fb1d899bf32f-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-jbzwc\" (UID: \"3bd9a54f-808e-4306-804a-fb1d899bf32f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jbzwc"
Oct 30 21:18:05.376610 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.376589    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bd9a54f-808e-4306-804a-fb1d899bf32f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-jbzwc\" (UID: \"3bd9a54f-808e-4306-804a-fb1d899bf32f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jbzwc"
Oct 30 21:18:05.429890 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.429863    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhrcs\" (UniqueName: \"kubernetes.io/projected/3bd9a54f-808e-4306-804a-fb1d899bf32f-kube-api-access-qhrcs\") pod \"kuadrant-console-plugin-66c4fb575d-jbzwc\" (UID: \"3bd9a54f-808e-4306-804a-fb1d899bf32f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jbzwc"
Oct 30 21:18:05.447824 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.447776    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:05.502150 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.502132    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jbzwc"
Oct 30 21:18:05.870539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:05.870443    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-jbzwc"]
Oct 30 21:18:05.874155 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:18:05.874125    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3bd9a54f_808e_4306_804a_fb1d899bf32f.slice/crio-0cfb1e74f04b8ed617b335e670cca1a0acee511a3b57027becbbd8b684ec67af WatchSource:0}: Error finding container 0cfb1e74f04b8ed617b335e670cca1a0acee511a3b57027becbbd8b684ec67af: Status 404 returned error can't find the container with id 0cfb1e74f04b8ed617b335e670cca1a0acee511a3b57027becbbd8b684ec67af
Oct 30 21:18:06.490988 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:06.490949    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jbzwc" event={"ID":"3bd9a54f-808e-4306-804a-fb1d899bf32f","Type":"ContainerStarted","Data":"0cfb1e74f04b8ed617b335e670cca1a0acee511a3b57027becbbd8b684ec67af"}
Oct 30 21:18:07.989415 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:18:07.989375    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:18:08.793790 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:08.793748    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:08.979621 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:08.979580    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:09.170402 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:09.170373    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:09.378740 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:09.378697    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:12.516505 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:12.516450    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jbzwc" event={"ID":"3bd9a54f-808e-4306-804a-fb1d899bf32f","Type":"ContainerStarted","Data":"4e8698f807e36396493597e32205c1c035f0fad261a423188200e86a5b53aae6"}
Oct 30 21:18:12.629854 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:12.629795    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jbzwc" podStartSLOduration=1.9114049899999999 podStartE2EDuration="7.62977936s" totalImagesPullingTime="5.71837437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:18:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:18:12.628830492 +0000 UTC m=+401.573775851" watchObservedRunningTime="2026-10-30 21:18:12.62977936 +0000 UTC m=+401.574724719"
Oct 30 21:18:14.434567 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:14.434491    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:14.620811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:14.620772    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:18.275958 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:18.275926    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:19.027901 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:19.027865    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:19.221556 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:19.221530    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:19.472022 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:19.471994    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:20.180913 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:20.180884    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:20.366291 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:20.366254    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:20.581178 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:20.581103    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:20.770982 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:20.770952    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:21.011590 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.011554    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:21.033827 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.033799    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-55c8944d49-zpwlv"]
Oct 30 21:18:21.037049 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.037025    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55c8944d49-zpwlv"
Oct 30 21:18:21.088638 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.088612    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 21:18:21.096969 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.096948    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v96n\" (UniqueName: \"kubernetes.io/projected/b7566874-33cb-47cf-a623-93e32673e869-kube-api-access-6v96n\") pod \"kube-auth-proxy-55c8944d49-zpwlv\" (UID: \"b7566874-33cb-47cf-a623-93e32673e869\") " pod="openshift-ingress/kube-auth-proxy-55c8944d49-zpwlv"
Oct 30 21:18:21.097073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.096981    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7566874-33cb-47cf-a623-93e32673e869-tls-certs\") pod \"kube-auth-proxy-55c8944d49-zpwlv\" (UID: \"b7566874-33cb-47cf-a623-93e32673e869\") " pod="openshift-ingress/kube-auth-proxy-55c8944d49-zpwlv"
Oct 30 21:18:21.097073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.096997    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7566874-33cb-47cf-a623-93e32673e869-tmp\") pod \"kube-auth-proxy-55c8944d49-zpwlv\" (UID: \"b7566874-33cb-47cf-a623-93e32673e869\") " pod="openshift-ingress/kube-auth-proxy-55c8944d49-zpwlv"
Oct 30 21:18:21.137716 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.137694    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 21:18:21.138882 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.138864    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55c8944d49-zpwlv"]
Oct 30 21:18:21.149403 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.149383    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Oct 30 21:18:21.187370 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.187335    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fhwt5\""
Oct 30 21:18:21.187370 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.187341    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Oct 30 21:18:21.198143 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.198115    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v96n\" (UniqueName: \"kubernetes.io/projected/b7566874-33cb-47cf-a623-93e32673e869-kube-api-access-6v96n\") pod \"kube-auth-proxy-55c8944d49-zpwlv\" (UID: \"b7566874-33cb-47cf-a623-93e32673e869\") " pod="openshift-ingress/kube-auth-proxy-55c8944d49-zpwlv"
Oct 30 21:18:21.198383 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.198362    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7566874-33cb-47cf-a623-93e32673e869-tls-certs\") pod \"kube-auth-proxy-55c8944d49-zpwlv\" (UID: \"b7566874-33cb-47cf-a623-93e32673e869\") " pod="openshift-ingress/kube-auth-proxy-55c8944d49-zpwlv"
Oct 30 21:18:21.198511 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.198397    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7566874-33cb-47cf-a623-93e32673e869-tmp\") pod \"kube-auth-proxy-55c8944d49-zpwlv\" (UID: \"b7566874-33cb-47cf-a623-93e32673e869\") " pod="openshift-ingress/kube-auth-proxy-55c8944d49-zpwlv"
Oct 30 21:18:21.200554 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.200533    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7566874-33cb-47cf-a623-93e32673e869-tmp\") pod \"kube-auth-proxy-55c8944d49-zpwlv\" (UID: \"b7566874-33cb-47cf-a623-93e32673e869\") " pod="openshift-ingress/kube-auth-proxy-55c8944d49-zpwlv"
Oct 30 21:18:21.200862 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.200841    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7566874-33cb-47cf-a623-93e32673e869-tls-certs\") pod \"kube-auth-proxy-55c8944d49-zpwlv\" (UID: \"b7566874-33cb-47cf-a623-93e32673e869\") " pod="openshift-ingress/kube-auth-proxy-55c8944d49-zpwlv"
Oct 30 21:18:21.253655 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.253628    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v96n\" (UniqueName: \"kubernetes.io/projected/b7566874-33cb-47cf-a623-93e32673e869-kube-api-access-6v96n\") pod \"kube-auth-proxy-55c8944d49-zpwlv\" (UID: \"b7566874-33cb-47cf-a623-93e32673e869\") " pod="openshift-ingress/kube-auth-proxy-55c8944d49-zpwlv"
Oct 30 21:18:21.331866 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.331782    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:21.349167 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.349143    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55c8944d49-zpwlv"
Oct 30 21:18:21.523027 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.523001    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:21.717011 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.716978    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55c8944d49-zpwlv"]
Oct 30 21:18:21.717483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.717391    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:21.720558 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:18:21.720535    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7566874_33cb_47cf_a623_93e32673e869.slice/crio-1066d977d3fd118a411efbeb6eb4e876bfdd8994e3b30e0ac089eb16e5f37cfd WatchSource:0}: Error finding container 1066d977d3fd118a411efbeb6eb4e876bfdd8994e3b30e0ac089eb16e5f37cfd: Status 404 returned error can't find the container with id 1066d977d3fd118a411efbeb6eb4e876bfdd8994e3b30e0ac089eb16e5f37cfd
Oct 30 21:18:21.904808 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:21.904756    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:22.243551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:22.243500    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:22.431475 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:22.431406    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:22.557007 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:22.556939    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55c8944d49-zpwlv" event={"ID":"b7566874-33cb-47cf-a623-93e32673e869","Type":"ContainerStarted","Data":"1066d977d3fd118a411efbeb6eb4e876bfdd8994e3b30e0ac089eb16e5f37cfd"}
Oct 30 21:18:23.619820 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:23.619785    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:23.653681 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:23.653644    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-m77c4"]
Oct 30 21:18:23.658047 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:23.658026    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-m77c4"
Oct 30 21:18:23.709526 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:23.709494    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Oct 30 21:18:23.714742 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:23.714713    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-m77c4"]
Oct 30 21:18:23.715228 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:23.715198    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pth4k\" (UniqueName: \"kubernetes.io/projected/d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7-kube-api-access-pth4k\") pod \"limitador-limitador-74dfcfb894-m77c4\" (UID: \"d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-m77c4"
Oct 30 21:18:23.715383 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:23.715247    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7-config-file\") pod \"limitador-limitador-74dfcfb894-m77c4\" (UID: \"d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-m77c4"
Oct 30 21:18:23.816419 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:23.816386    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pth4k\" (UniqueName: \"kubernetes.io/projected/d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7-kube-api-access-pth4k\") pod \"limitador-limitador-74dfcfb894-m77c4\" (UID: \"d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-m77c4"
Oct 30 21:18:23.816606 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:23.816433    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7-config-file\") pod \"limitador-limitador-74dfcfb894-m77c4\" (UID: \"d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-m77c4"
Oct 30 21:18:23.817108 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:23.817085    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7-config-file\") pod \"limitador-limitador-74dfcfb894-m77c4\" (UID: \"d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-m77c4"
Oct 30 21:18:23.874293 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:23.874215    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pth4k\" (UniqueName: \"kubernetes.io/projected/d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7-kube-api-access-pth4k\") pod \"limitador-limitador-74dfcfb894-m77c4\" (UID: \"d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-m77c4"
Oct 30 21:18:23.905508 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:23.905479    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-m77c4"]
Oct 30 21:18:23.974417 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:23.974385    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-m77c4"
Oct 30 21:18:23.990811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:23.990781    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:24.187572 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:24.187542    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:24.382843 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:24.382817    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-m77c4"]
Oct 30 21:18:24.386655 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:18:24.386622    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8f4e5a9_ad9e_4c58_baf6_32fe814c0fc7.slice/crio-7e1f272eb471792c9a73d90aef5a70bb5268af753af65bf5772aef4d6ed89737 WatchSource:0}: Error finding container 7e1f272eb471792c9a73d90aef5a70bb5268af753af65bf5772aef4d6ed89737: Status 404 returned error can't find the container with id 7e1f272eb471792c9a73d90aef5a70bb5268af753af65bf5772aef4d6ed89737
Oct 30 21:18:24.567033 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:24.566956    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-m77c4" event={"ID":"d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7","Type":"ContainerStarted","Data":"7e1f272eb471792c9a73d90aef5a70bb5268af753af65bf5772aef4d6ed89737"}
Oct 30 21:18:25.410522 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:25.410427    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:25.573741 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:25.573708    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55c8944d49-zpwlv" event={"ID":"b7566874-33cb-47cf-a623-93e32673e869","Type":"ContainerStarted","Data":"bd5ea96ff0b16090d15692a17c45b1d0ab314c75e450472c57dcc74f0a7e8fc2"}
Oct 30 21:18:25.617697 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:25.617665    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:25.691750 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:25.691697    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-55c8944d49-zpwlv" podStartSLOduration=2.355033733 podStartE2EDuration="5.69168051s" totalImagesPullingTime="3.336646777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:18:25.69140227 +0000 UTC m=+414.636347630" watchObservedRunningTime="2026-10-30 21:18:25.69168051 +0000 UTC m=+414.636625871"
Oct 30 21:18:26.290282 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:26.290253    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:26.480242 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:26.480212    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:26.663711 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:26.663636    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:26.944954 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:26.944911    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:27.148062 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:27.148033    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:28.587402 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:28.587368    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-m77c4" event={"ID":"d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7","Type":"ContainerStarted","Data":"49923c8c7f8fd75c752e5634584aa3a1a1a4a29ef7b0f93ad65036cdbe444f66"}
Oct 30 21:18:28.587791 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:28.587501    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-m77c4"
Oct 30 21:18:28.702509 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:28.701318    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-m77c4" podStartSLOduration=2.206078532 podStartE2EDuration="5.701300865s" totalImagesPullingTime="3.495222333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:18:28.700415627 +0000 UTC m=+417.645360986" watchObservedRunningTime="2026-10-30 21:18:28.701300865 +0000 UTC m=+417.646246224"
Oct 30 21:18:28.847427 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:28.847364    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:33.416151 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:33.416120    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:33.605256 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:33.605215    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:37.986663 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:18:37.986629    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:18:38.986581 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:38.986548    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:39.196943 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:39.196911    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:39.591623 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:39.591587    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-m77c4"
Oct 30 21:18:39.592924 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:39.592899    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:39.790399 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:39.790345    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:42.979662 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:42.979612    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:43.202775 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:43.202744    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:43.596199 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:43.596170    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:46.507650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:46.507619    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:18:46.510448 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:46.510432    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"
Oct 30 21:18:46.591107 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:46.591077    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aeb594b9-93a8-4065-9295-68e278f7e83f-config-file\") pod \"limitador-limitador-7c9b87d574-vpk6s\" (UID: \"aeb594b9-93a8-4065-9295-68e278f7e83f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"
Oct 30 21:18:46.591225 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:46.591125    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcnzg\" (UniqueName: \"kubernetes.io/projected/aeb594b9-93a8-4065-9295-68e278f7e83f-kube-api-access-fcnzg\") pod \"limitador-limitador-7c9b87d574-vpk6s\" (UID: \"aeb594b9-93a8-4065-9295-68e278f7e83f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"
Oct 30 21:18:46.610300 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:46.610227    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:18:46.691666 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:46.691638    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aeb594b9-93a8-4065-9295-68e278f7e83f-config-file\") pod \"limitador-limitador-7c9b87d574-vpk6s\" (UID: \"aeb594b9-93a8-4065-9295-68e278f7e83f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"
Oct 30 21:18:46.691802 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:46.691679    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcnzg\" (UniqueName: \"kubernetes.io/projected/aeb594b9-93a8-4065-9295-68e278f7e83f-kube-api-access-fcnzg\") pod \"limitador-limitador-7c9b87d574-vpk6s\" (UID: \"aeb594b9-93a8-4065-9295-68e278f7e83f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"
Oct 30 21:18:46.692229 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:46.692209    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aeb594b9-93a8-4065-9295-68e278f7e83f-config-file\") pod \"limitador-limitador-7c9b87d574-vpk6s\" (UID: \"aeb594b9-93a8-4065-9295-68e278f7e83f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"
Oct 30 21:18:46.751584 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:46.751562    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcnzg\" (UniqueName: \"kubernetes.io/projected/aeb594b9-93a8-4065-9295-68e278f7e83f-kube-api-access-fcnzg\") pod \"limitador-limitador-7c9b87d574-vpk6s\" (UID: \"aeb594b9-93a8-4065-9295-68e278f7e83f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"
Oct 30 21:18:46.812365 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:46.812305    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:18:46.822294 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:46.822274    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"
Oct 30 21:18:47.192624 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:47.192524    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:18:47.195130 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:18:47.195105    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb594b9_93a8_4065_9295_68e278f7e83f.slice/crio-8c5072cc12ea07bebfb2a26637df7b9d3acd5c9759674ae48b645cc2f5701d6d WatchSource:0}: Error finding container 8c5072cc12ea07bebfb2a26637df7b9d3acd5c9759674ae48b645cc2f5701d6d: Status 404 returned error can't find the container with id 8c5072cc12ea07bebfb2a26637df7b9d3acd5c9759674ae48b645cc2f5701d6d
Oct 30 21:18:47.231680 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:47.231654    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:47.419789 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:47.419757    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:47.611838 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:47.611765    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:47.662571 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:47.662546    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-vpk6s" event={"ID":"aeb594b9-93a8-4065-9295-68e278f7e83f","Type":"ContainerStarted","Data":"9e244e54ae4997630647c09a300997c5256eb80a0f3a24e64bfcf1bf44fdcc51"}
Oct 30 21:18:47.662715 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:47.662592    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-vpk6s" event={"ID":"aeb594b9-93a8-4065-9295-68e278f7e83f","Type":"ContainerStarted","Data":"8c5072cc12ea07bebfb2a26637df7b9d3acd5c9759674ae48b645cc2f5701d6d"}
Oct 30 21:18:47.662715 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:47.662649    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"
Oct 30 21:18:47.776911 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:47.776871    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7c9b87d574-vpk6s" podStartSLOduration=1.776859776 podStartE2EDuration="1.776859776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:18:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:18:47.776194268 +0000 UTC m=+436.721139627" watchObservedRunningTime="2026-10-30 21:18:47.776859776 +0000 UTC m=+436.721805135"
Oct 30 21:18:48.423793 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:48.423764    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:53.434978 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:53.434943    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:53.629583 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:53.629549    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:58.667171 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:58.667144    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"
Oct 30 21:18:58.831116 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:58.831075    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-m77c4"]
Oct 30 21:18:58.831349 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:58.831311    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-m77c4" podUID="d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7" containerName="limitador" containerID="cri-o://49923c8c7f8fd75c752e5634584aa3a1a1a4a29ef7b0f93ad65036cdbe444f66" gracePeriod=30
Oct 30 21:18:59.347656 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:59.347632    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-m77c4"
Oct 30 21:18:59.391277 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:59.391225    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7-kube-api-access-pth4k\" (UniqueName: \"kubernetes.io/projected/d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7-kube-api-access-pth4k\") pod \"d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7\" (UID: \"d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7\") "
Oct 30 21:18:59.391277 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:59.391262    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7-config-file\" (UniqueName: \"kubernetes.io/configmap/d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7-config-file\") pod \"d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7\" (UID: \"d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7\") "
Oct 30 21:18:59.391648 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:59.391619    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7-config-file" pod "d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7" (UID: "d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:18:59.393176 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:59.393156    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7-kube-api-access-pth4k" pod "d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7" (UID: "d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7"). InnerVolumeSpecName "kube-api-access-pth4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:18:59.492182 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:59.492153    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pth4k\" (UniqueName: \"kubernetes.io/projected/d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7-kube-api-access-pth4k\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:59.492182 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:59.492181    4522 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7-config-file\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:59.710032 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:59.710005    4522 generic.go:356] "Generic (PLEG): container finished" podID="d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7" containerID="49923c8c7f8fd75c752e5634584aa3a1a1a4a29ef7b0f93ad65036cdbe444f66" exitCode=0
Oct 30 21:18:59.710429 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:59.710050    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-m77c4"
Oct 30 21:18:59.710429 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:59.710088    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-m77c4" event={"ID":"d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7","Type":"ContainerDied","Data":"49923c8c7f8fd75c752e5634584aa3a1a1a4a29ef7b0f93ad65036cdbe444f66"}
Oct 30 21:18:59.710429 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:59.710146    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-m77c4" event={"ID":"d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7","Type":"ContainerDied","Data":"7e1f272eb471792c9a73d90aef5a70bb5268af753af65bf5772aef4d6ed89737"}
Oct 30 21:18:59.710429 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:59.710169    4522 scope.go:122] "RemoveContainer" containerID="49923c8c7f8fd75c752e5634584aa3a1a1a4a29ef7b0f93ad65036cdbe444f66"
Oct 30 21:18:59.718488 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:59.718471    4522 scope.go:122] "RemoveContainer" containerID="49923c8c7f8fd75c752e5634584aa3a1a1a4a29ef7b0f93ad65036cdbe444f66"
Oct 30 21:18:59.718726 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:18:59.718709    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49923c8c7f8fd75c752e5634584aa3a1a1a4a29ef7b0f93ad65036cdbe444f66\": container with ID starting with 49923c8c7f8fd75c752e5634584aa3a1a1a4a29ef7b0f93ad65036cdbe444f66 not found: ID does not exist" containerID="49923c8c7f8fd75c752e5634584aa3a1a1a4a29ef7b0f93ad65036cdbe444f66"
Oct 30 21:18:59.718769 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:59.718734    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49923c8c7f8fd75c752e5634584aa3a1a1a4a29ef7b0f93ad65036cdbe444f66"} err="failed to get container status \"49923c8c7f8fd75c752e5634584aa3a1a1a4a29ef7b0f93ad65036cdbe444f66\": rpc error: code = NotFound desc = could not find container \"49923c8c7f8fd75c752e5634584aa3a1a1a4a29ef7b0f93ad65036cdbe444f66\": container with ID starting with 49923c8c7f8fd75c752e5634584aa3a1a1a4a29ef7b0f93ad65036cdbe444f66 not found: ID does not exist"
Oct 30 21:18:59.869772 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:59.869742    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-m77c4"]
Oct 30 21:18:59.918817 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:18:59.918789    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-m77c4"]
Oct 30 21:19:01.189795 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:01.189766    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7" path="/var/lib/kubelet/pods/d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7/volumes"
Oct 30 21:19:01.981538 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:01.981507    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:02.184162 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:02.184131    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:02.833052 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:02.833023    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:03.888242 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:03.888211    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:04.078512 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:04.078484    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:07.986961 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:19:07.986930    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:19:18.624601 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:18.624567    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:24.211029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.210995    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:24.236189 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.236160    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-579cf7c6d-r5pm8"]
Oct 30 21:19:24.236504 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.236484    4522 cpu_manager.go:414] "containerMap: removing container" podUID="d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7" containerName="limitador"
Oct 30 21:19:24.236504 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.236502    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7" containerName="limitador"
Oct 30 21:19:24.236696 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.236596    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="d8f4e5a9-ad9e-4c58-baf6-32fe814c0fc7" containerName="limitador"
Oct 30 21:19:24.239601 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.239580    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-r5pm8"
Oct 30 21:19:24.340972 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.340950    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 30 21:19:24.341139 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.340973    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 30 21:19:24.341139 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.340981    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 30 21:19:24.341139 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.340990    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vl72m\""
Oct 30 21:19:24.341371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.341021    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 30 21:19:24.341371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.341210    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 30 21:19:24.342196 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.342177    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-r5pm8"]
Oct 30 21:19:24.384824 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.384802    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mddz\" (UniqueName: \"kubernetes.io/projected/3d19378f-c820-4c47-a006-34fa2a080abb-kube-api-access-4mddz\") pod \"maas-controller-579cf7c6d-r5pm8\" (UID: \"3d19378f-c820-4c47-a006-34fa2a080abb\") " pod="opendatahub/maas-controller-579cf7c6d-r5pm8"
Oct 30 21:19:24.384926 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.384832    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d19378f-c820-4c47-a006-34fa2a080abb-webhook-cert\") pod \"maas-controller-579cf7c6d-r5pm8\" (UID: \"3d19378f-c820-4c47-a006-34fa2a080abb\") " pod="opendatahub/maas-controller-579cf7c6d-r5pm8"
Oct 30 21:19:24.384926 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.384854    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d19378f-c820-4c47-a006-34fa2a080abb-metrics-certs\") pod \"maas-controller-579cf7c6d-r5pm8\" (UID: \"3d19378f-c820-4c47-a006-34fa2a080abb\") " pod="opendatahub/maas-controller-579cf7c6d-r5pm8"
Oct 30 21:19:24.409085 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.409057    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:24.485770 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.485710    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mddz\" (UniqueName: \"kubernetes.io/projected/3d19378f-c820-4c47-a006-34fa2a080abb-kube-api-access-4mddz\") pod \"maas-controller-579cf7c6d-r5pm8\" (UID: \"3d19378f-c820-4c47-a006-34fa2a080abb\") " pod="opendatahub/maas-controller-579cf7c6d-r5pm8"
Oct 30 21:19:24.485770 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.485754    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d19378f-c820-4c47-a006-34fa2a080abb-webhook-cert\") pod \"maas-controller-579cf7c6d-r5pm8\" (UID: \"3d19378f-c820-4c47-a006-34fa2a080abb\") " pod="opendatahub/maas-controller-579cf7c6d-r5pm8"
Oct 30 21:19:24.485949 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.485790    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d19378f-c820-4c47-a006-34fa2a080abb-metrics-certs\") pod \"maas-controller-579cf7c6d-r5pm8\" (UID: \"3d19378f-c820-4c47-a006-34fa2a080abb\") " pod="opendatahub/maas-controller-579cf7c6d-r5pm8"
Oct 30 21:19:24.488376 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.488350    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d19378f-c820-4c47-a006-34fa2a080abb-webhook-cert\") pod \"maas-controller-579cf7c6d-r5pm8\" (UID: \"3d19378f-c820-4c47-a006-34fa2a080abb\") " pod="opendatahub/maas-controller-579cf7c6d-r5pm8"
Oct 30 21:19:24.488494 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.488397    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d19378f-c820-4c47-a006-34fa2a080abb-metrics-certs\") pod \"maas-controller-579cf7c6d-r5pm8\" (UID: \"3d19378f-c820-4c47-a006-34fa2a080abb\") " pod="opendatahub/maas-controller-579cf7c6d-r5pm8"
Oct 30 21:19:24.545890 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.545851    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mddz\" (UniqueName: \"kubernetes.io/projected/3d19378f-c820-4c47-a006-34fa2a080abb-kube-api-access-4mddz\") pod \"maas-controller-579cf7c6d-r5pm8\" (UID: \"3d19378f-c820-4c47-a006-34fa2a080abb\") " pod="opendatahub/maas-controller-579cf7c6d-r5pm8"
Oct 30 21:19:24.551528 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.551501    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-r5pm8"
Oct 30 21:19:24.627675 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.627645    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:24.686359 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.686328    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bf6cbd4cd-dl7gw"]
Oct 30 21:19:24.689766 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.689740    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw"
Oct 30 21:19:24.750301 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.750241    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bf6cbd4cd-dl7gw"]
Oct 30 21:19:24.788944 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.788702    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e03c184a-e3e5-4902-b0c7-e7e16c042713-metrics-certs\") pod \"maas-controller-6bf6cbd4cd-dl7gw\" (UID: \"e03c184a-e3e5-4902-b0c7-e7e16c042713\") " pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw"
Oct 30 21:19:24.788944 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.788752    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dd88\" (UniqueName: \"kubernetes.io/projected/e03c184a-e3e5-4902-b0c7-e7e16c042713-kube-api-access-9dd88\") pod \"maas-controller-6bf6cbd4cd-dl7gw\" (UID: \"e03c184a-e3e5-4902-b0c7-e7e16c042713\") " pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw"
Oct 30 21:19:24.788944 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.788799    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e03c184a-e3e5-4902-b0c7-e7e16c042713-webhook-cert\") pod \"maas-controller-6bf6cbd4cd-dl7gw\" (UID: \"e03c184a-e3e5-4902-b0c7-e7e16c042713\") " pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw"
Oct 30 21:19:24.827188 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.827138    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:24.890088 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.890056    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e03c184a-e3e5-4902-b0c7-e7e16c042713-metrics-certs\") pod \"maas-controller-6bf6cbd4cd-dl7gw\" (UID: \"e03c184a-e3e5-4902-b0c7-e7e16c042713\") " pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw"
Oct 30 21:19:24.890088 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.890095    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dd88\" (UniqueName: \"kubernetes.io/projected/e03c184a-e3e5-4902-b0c7-e7e16c042713-kube-api-access-9dd88\") pod \"maas-controller-6bf6cbd4cd-dl7gw\" (UID: \"e03c184a-e3e5-4902-b0c7-e7e16c042713\") " pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw"
Oct 30 21:19:24.890350 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.890126    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e03c184a-e3e5-4902-b0c7-e7e16c042713-webhook-cert\") pod \"maas-controller-6bf6cbd4cd-dl7gw\" (UID: \"e03c184a-e3e5-4902-b0c7-e7e16c042713\") " pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw"
Oct 30 21:19:24.892525 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.892497    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e03c184a-e3e5-4902-b0c7-e7e16c042713-webhook-cert\") pod \"maas-controller-6bf6cbd4cd-dl7gw\" (UID: \"e03c184a-e3e5-4902-b0c7-e7e16c042713\") " pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw"
Oct 30 21:19:24.892632 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.892532    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e03c184a-e3e5-4902-b0c7-e7e16c042713-metrics-certs\") pod \"maas-controller-6bf6cbd4cd-dl7gw\" (UID: \"e03c184a-e3e5-4902-b0c7-e7e16c042713\") " pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw"
Oct 30 21:19:24.921383 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.921357    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-r5pm8"]
Oct 30 21:19:24.924129 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:19:24.924108    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d19378f_c820_4c47_a006_34fa2a080abb.slice/crio-982d5aa58f9831e63581fd4948c36385401b04a6fd785ccb40401d4c7d20b708 WatchSource:0}: Error finding container 982d5aa58f9831e63581fd4948c36385401b04a6fd785ccb40401d4c7d20b708: Status 404 returned error can't find the container with id 982d5aa58f9831e63581fd4948c36385401b04a6fd785ccb40401d4c7d20b708
Oct 30 21:19:24.946229 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:24.946206    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dd88\" (UniqueName: \"kubernetes.io/projected/e03c184a-e3e5-4902-b0c7-e7e16c042713-kube-api-access-9dd88\") pod \"maas-controller-6bf6cbd4cd-dl7gw\" (UID: \"e03c184a-e3e5-4902-b0c7-e7e16c042713\") " pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw"
Oct 30 21:19:25.002203 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:25.002153    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw"
Oct 30 21:19:25.373118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:25.373044    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bf6cbd4cd-dl7gw"]
Oct 30 21:19:25.376044 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:19:25.376021    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode03c184a_e3e5_4902_b0c7_e7e16c042713.slice/crio-d5f609513340fadaaa43225b94a087e8a2556ffcce6e109b679c3489ad7eaf32 WatchSource:0}: Error finding container d5f609513340fadaaa43225b94a087e8a2556ffcce6e109b679c3489ad7eaf32: Status 404 returned error can't find the container with id d5f609513340fadaaa43225b94a087e8a2556ffcce6e109b679c3489ad7eaf32
Oct 30 21:19:25.808881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:25.808846    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw" event={"ID":"e03c184a-e3e5-4902-b0c7-e7e16c042713","Type":"ContainerStarted","Data":"d5f609513340fadaaa43225b94a087e8a2556ffcce6e109b679c3489ad7eaf32"}
Oct 30 21:19:25.809965 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:25.809943    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-r5pm8" event={"ID":"3d19378f-c820-4c47-a006-34fa2a080abb","Type":"ContainerStarted","Data":"982d5aa58f9831e63581fd4948c36385401b04a6fd785ccb40401d4c7d20b708"}
Oct 30 21:19:26.140057 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:26.139980    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:28.735970 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:28.735942    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:28.825389 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:28.825359    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-r5pm8" event={"ID":"3d19378f-c820-4c47-a006-34fa2a080abb","Type":"ContainerStarted","Data":"ca4d5362c84113d9bcee932746e585d8415fc4f74715f02c3e3d30dea465eea0"}
Oct 30 21:19:28.825563 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:28.825469    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-579cf7c6d-r5pm8"
Oct 30 21:19:28.826896 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:28.826875    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw" event={"ID":"e03c184a-e3e5-4902-b0c7-e7e16c042713","Type":"ContainerStarted","Data":"757b6f67304936c51f197ca57e3dff7ef8c35214dacd96ca8dc4d8c2a6c9a71e"}
Oct 30 21:19:28.827027 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:28.827012    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw"
Oct 30 21:19:28.941484 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:28.932168    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:29.064633 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:29.064542    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-579cf7c6d-r5pm8" podStartSLOduration=1.708498054 podStartE2EDuration="5.064528059s" totalImagesPullingTime="3.356030005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:19:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:19:28.946775404 +0000 UTC m=+477.891720774" watchObservedRunningTime="2026-10-30 21:19:29.064528059 +0000 UTC m=+478.009473416"
Oct 30 21:19:34.523063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.523012    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw" podStartSLOduration=7.609530144 podStartE2EDuration="10.522999007s" totalImagesPullingTime="2.913468863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:19:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:19:29.065748844 +0000 UTC m=+478.010694203" watchObservedRunningTime="2026-10-30 21:19:34.522999007 +0000 UTC m=+483.467944373"
Oct 30 21:19:34.523484 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.523160    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t"]
Oct 30 21:19:34.527619 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.527599    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t"
Oct 30 21:19:34.579048 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.579024    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\""
Oct 30 21:19:34.579360 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.579343    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\""
Oct 30 21:19:34.628666 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.628642    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-qlp92\""
Oct 30 21:19:34.628790 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.628682    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\""
Oct 30 21:19:34.629795 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.629767    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t"]
Oct 30 21:19:34.661744 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.661715    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32a19305-ede1-481d-a456-4bee53be8a3e-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r7n5t\" (UID: \"32a19305-ede1-481d-a456-4bee53be8a3e\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t"
Oct 30 21:19:34.661849 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.661770    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/32a19305-ede1-481d-a456-4bee53be8a3e-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r7n5t\" (UID: \"32a19305-ede1-481d-a456-4bee53be8a3e\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t"
Oct 30 21:19:34.661849 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.661799    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/32a19305-ede1-481d-a456-4bee53be8a3e-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r7n5t\" (UID: \"32a19305-ede1-481d-a456-4bee53be8a3e\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t"
Oct 30 21:19:34.661933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.661913    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bdvr\" (UniqueName: \"kubernetes.io/projected/32a19305-ede1-481d-a456-4bee53be8a3e-kube-api-access-4bdvr\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r7n5t\" (UID: \"32a19305-ede1-481d-a456-4bee53be8a3e\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t"
Oct 30 21:19:34.721080 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.721058    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:34.762408 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.762384    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32a19305-ede1-481d-a456-4bee53be8a3e-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r7n5t\" (UID: \"32a19305-ede1-481d-a456-4bee53be8a3e\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t"
Oct 30 21:19:34.762523 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.762436    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/32a19305-ede1-481d-a456-4bee53be8a3e-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r7n5t\" (UID: \"32a19305-ede1-481d-a456-4bee53be8a3e\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t"
Oct 30 21:19:34.762523 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.762485    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/32a19305-ede1-481d-a456-4bee53be8a3e-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r7n5t\" (UID: \"32a19305-ede1-481d-a456-4bee53be8a3e\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t"
Oct 30 21:19:34.762523 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.762503    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bdvr\" (UniqueName: \"kubernetes.io/projected/32a19305-ede1-481d-a456-4bee53be8a3e-kube-api-access-4bdvr\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r7n5t\" (UID: \"32a19305-ede1-481d-a456-4bee53be8a3e\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t"
Oct 30 21:19:34.762686 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:19:34.762609    4522 configmap.go:193] Couldn't get configMap opendatahub/usage-tenancy-proxy-source: configmap "usage-tenancy-proxy-source" not found
Oct 30 21:19:34.762745 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:19:34.762696    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32a19305-ede1-481d-a456-4bee53be8a3e-proxy-source podName:32a19305-ede1-481d-a456-4bee53be8a3e nodeName:}" failed. No retries permitted until 2026-10-30 21:19:35.262674225 +0000 UTC m=+484.207619577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-source" (UniqueName: "kubernetes.io/configmap/32a19305-ede1-481d-a456-4bee53be8a3e-proxy-source") pod "usage-logs-tenancy-proxy-9c5d49bcd-r7n5t" (UID: "32a19305-ede1-481d-a456-4bee53be8a3e") : configmap "usage-tenancy-proxy-source" not found
Oct 30 21:19:34.763020 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.763003    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32a19305-ede1-481d-a456-4bee53be8a3e-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r7n5t\" (UID: \"32a19305-ede1-481d-a456-4bee53be8a3e\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t"
Oct 30 21:19:34.764719 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.764704    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/32a19305-ede1-481d-a456-4bee53be8a3e-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r7n5t\" (UID: \"32a19305-ede1-481d-a456-4bee53be8a3e\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t"
Oct 30 21:19:34.833470 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.833406    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bdvr\" (UniqueName: \"kubernetes.io/projected/32a19305-ede1-481d-a456-4bee53be8a3e-kube-api-access-4bdvr\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r7n5t\" (UID: \"32a19305-ede1-481d-a456-4bee53be8a3e\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t"
Oct 30 21:19:34.912655 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:34.912623    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:35.266368 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:35.266331    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/32a19305-ede1-481d-a456-4bee53be8a3e-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r7n5t\" (UID: \"32a19305-ede1-481d-a456-4bee53be8a3e\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t"
Oct 30 21:19:35.267112 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:35.267087    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/32a19305-ede1-481d-a456-4bee53be8a3e-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-r7n5t\" (UID: \"32a19305-ede1-481d-a456-4bee53be8a3e\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t"
Oct 30 21:19:35.439499 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:35.439468    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t"
Oct 30 21:19:35.810142 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:35.810110    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t"]
Oct 30 21:19:35.813370 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:19:35.813337    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32a19305_ede1_481d_a456_4bee53be8a3e.slice/crio-ec6c2ebc955b9ccb9e914a8f810b095e3c4b68416114b7dc8b6382f73a5d314a WatchSource:0}: Error finding container ec6c2ebc955b9ccb9e914a8f810b095e3c4b68416114b7dc8b6382f73a5d314a: Status 404 returned error can't find the container with id ec6c2ebc955b9ccb9e914a8f810b095e3c4b68416114b7dc8b6382f73a5d314a
Oct 30 21:19:35.853932 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:35.853900    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t" event={"ID":"32a19305-ede1-481d-a456-4bee53be8a3e","Type":"ContainerStarted","Data":"ec6c2ebc955b9ccb9e914a8f810b095e3c4b68416114b7dc8b6382f73a5d314a"}
Oct 30 21:19:37.983126 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:37.983095    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:37.987497 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:19:37.987442    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:19:38.175430 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:38.175408    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:38.406454 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:38.406433    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:38.600435 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:38.600408    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:38.802387 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:38.802358    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:38.868526 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:38.868496    4522 generic.go:356] "Generic (PLEG): container finished" podID="3d19378f-c820-4c47-a006-34fa2a080abb" containerID="ca4d5362c84113d9bcee932746e585d8415fc4f74715f02c3e3d30dea465eea0" exitCode=1
Oct 30 21:19:38.868676 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:38.868566    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-r5pm8" event={"ID":"3d19378f-c820-4c47-a006-34fa2a080abb","Type":"ContainerDied","Data":"ca4d5362c84113d9bcee932746e585d8415fc4f74715f02c3e3d30dea465eea0"}
Oct 30 21:19:38.868924 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:38.868909    4522 scope.go:122] "RemoveContainer" containerID="ca4d5362c84113d9bcee932746e585d8415fc4f74715f02c3e3d30dea465eea0"
Oct 30 21:19:38.915495 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:38.915471    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx"]
Oct 30 21:19:38.918507 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:38.918493    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx"
Oct 30 21:19:38.970199 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:38.970173    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-4t4gp\""
Oct 30 21:19:38.970199 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:38.970193    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Oct 30 21:19:38.976495 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:38.976473    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx"]
Oct 30 21:19:38.993034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:38.993011    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:39.095805 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:39.095733    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24ac8dda-0f4c-4946-b268-fae04a43d31d-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-ncnwx\" (UID: \"24ac8dda-0f4c-4946-b268-fae04a43d31d\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx"
Oct 30 21:19:39.095805 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:39.095787    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znzd5\" (UniqueName: \"kubernetes.io/projected/24ac8dda-0f4c-4946-b268-fae04a43d31d-kube-api-access-znzd5\") pod \"llmisvc-controller-manager-869d5dcc5d-ncnwx\" (UID: \"24ac8dda-0f4c-4946-b268-fae04a43d31d\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx"
Oct 30 21:19:39.196421 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:39.196394    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znzd5\" (UniqueName: \"kubernetes.io/projected/24ac8dda-0f4c-4946-b268-fae04a43d31d-kube-api-access-znzd5\") pod \"llmisvc-controller-manager-869d5dcc5d-ncnwx\" (UID: \"24ac8dda-0f4c-4946-b268-fae04a43d31d\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx"
Oct 30 21:19:39.196562 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:39.196443    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24ac8dda-0f4c-4946-b268-fae04a43d31d-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-ncnwx\" (UID: \"24ac8dda-0f4c-4946-b268-fae04a43d31d\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx"
Oct 30 21:19:39.198701 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:39.198684    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24ac8dda-0f4c-4946-b268-fae04a43d31d-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-ncnwx\" (UID: \"24ac8dda-0f4c-4946-b268-fae04a43d31d\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx"
Oct 30 21:19:39.252640 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:39.252614    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znzd5\" (UniqueName: \"kubernetes.io/projected/24ac8dda-0f4c-4946-b268-fae04a43d31d-kube-api-access-znzd5\") pod \"llmisvc-controller-manager-869d5dcc5d-ncnwx\" (UID: \"24ac8dda-0f4c-4946-b268-fae04a43d31d\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx"
Oct 30 21:19:39.530121 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:39.529778    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx"
Oct 30 21:19:39.834248 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:39.833574    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw"
Oct 30 21:19:39.879981 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:39.879947    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-r5pm8" event={"ID":"3d19378f-c820-4c47-a006-34fa2a080abb","Type":"ContainerStarted","Data":"18a7ffa082c44746e99eef1c0fca9664611118d93a791b469df9c5db32bd89ed"}
Oct 30 21:19:39.880569 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:39.880542    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-579cf7c6d-r5pm8"
Oct 30 21:19:39.934184 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:39.934156    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx"]
Oct 30 21:19:39.980005 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:39.979978    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-r5pm8"]
Oct 30 21:19:40.205872 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:40.205840    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:40.886826 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:40.886791    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx" event={"ID":"24ac8dda-0f4c-4946-b268-fae04a43d31d","Type":"ContainerStarted","Data":"2734534b3b715e1ad5e66d6eb054d59e1d920ac86be179ba039ab8d72a66754e"}
Oct 30 21:19:41.891035 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:41.890796    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-579cf7c6d-r5pm8" podUID="3d19378f-c820-4c47-a006-34fa2a080abb" containerName="manager" containerID="cri-o://18a7ffa082c44746e99eef1c0fca9664611118d93a791b469df9c5db32bd89ed" gracePeriod=30
Oct 30 21:19:42.156850 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:42.156761    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-r5pm8"
Oct 30 21:19:42.324270 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:42.324241    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3d19378f-c820-4c47-a006-34fa2a080abb-webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d19378f-c820-4c47-a006-34fa2a080abb-webhook-cert\") pod \"3d19378f-c820-4c47-a006-34fa2a080abb\" (UID: \"3d19378f-c820-4c47-a006-34fa2a080abb\") "
Oct 30 21:19:42.324414 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:42.324301    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3d19378f-c820-4c47-a006-34fa2a080abb-kube-api-access-4mddz\" (UniqueName: \"kubernetes.io/projected/3d19378f-c820-4c47-a006-34fa2a080abb-kube-api-access-4mddz\") pod \"3d19378f-c820-4c47-a006-34fa2a080abb\" (UID: \"3d19378f-c820-4c47-a006-34fa2a080abb\") "
Oct 30 21:19:42.324414 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:42.324326    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3d19378f-c820-4c47-a006-34fa2a080abb-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d19378f-c820-4c47-a006-34fa2a080abb-metrics-certs\") pod \"3d19378f-c820-4c47-a006-34fa2a080abb\" (UID: \"3d19378f-c820-4c47-a006-34fa2a080abb\") "
Oct 30 21:19:42.327355 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:42.327303    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d19378f-c820-4c47-a006-34fa2a080abb-kube-api-access-4mddz" pod "3d19378f-c820-4c47-a006-34fa2a080abb" (UID: "3d19378f-c820-4c47-a006-34fa2a080abb"). InnerVolumeSpecName "kube-api-access-4mddz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:19:42.327609 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:42.327583    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d19378f-c820-4c47-a006-34fa2a080abb-metrics-certs" pod "3d19378f-c820-4c47-a006-34fa2a080abb" (UID: "3d19378f-c820-4c47-a006-34fa2a080abb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:19:42.328967 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:42.328930    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d19378f-c820-4c47-a006-34fa2a080abb-webhook-cert" pod "3d19378f-c820-4c47-a006-34fa2a080abb" (UID: "3d19378f-c820-4c47-a006-34fa2a080abb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:19:42.425417 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:42.425390    4522 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d19378f-c820-4c47-a006-34fa2a080abb-webhook-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:42.425575 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:42.425424    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mddz\" (UniqueName: \"kubernetes.io/projected/3d19378f-c820-4c47-a006-34fa2a080abb-kube-api-access-4mddz\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:42.425575 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:42.425436    4522 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d19378f-c820-4c47-a006-34fa2a080abb-metrics-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:42.898191 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:42.898158    4522 generic.go:356] "Generic (PLEG): container finished" podID="3d19378f-c820-4c47-a006-34fa2a080abb" containerID="18a7ffa082c44746e99eef1c0fca9664611118d93a791b469df9c5db32bd89ed" exitCode=2
Oct 30 21:19:42.898665 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:42.898205    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-r5pm8" event={"ID":"3d19378f-c820-4c47-a006-34fa2a080abb","Type":"ContainerDied","Data":"18a7ffa082c44746e99eef1c0fca9664611118d93a791b469df9c5db32bd89ed"}
Oct 30 21:19:42.898665 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:42.898256    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-r5pm8" event={"ID":"3d19378f-c820-4c47-a006-34fa2a080abb","Type":"ContainerDied","Data":"982d5aa58f9831e63581fd4948c36385401b04a6fd785ccb40401d4c7d20b708"}
Oct 30 21:19:42.898665 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:42.898286    4522 scope.go:122] "RemoveContainer" containerID="18a7ffa082c44746e99eef1c0fca9664611118d93a791b469df9c5db32bd89ed"
Oct 30 21:19:42.898665 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:42.898442    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-r5pm8"
Oct 30 21:19:42.916441 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:42.916419    4522 scope.go:122] "RemoveContainer" containerID="ca4d5362c84113d9bcee932746e585d8415fc4f74715f02c3e3d30dea465eea0"
Oct 30 21:19:42.924711 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:42.924690    4522 scope.go:122] "RemoveContainer" containerID="18a7ffa082c44746e99eef1c0fca9664611118d93a791b469df9c5db32bd89ed"
Oct 30 21:19:42.924977 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:19:42.924951    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18a7ffa082c44746e99eef1c0fca9664611118d93a791b469df9c5db32bd89ed\": container with ID starting with 18a7ffa082c44746e99eef1c0fca9664611118d93a791b469df9c5db32bd89ed not found: ID does not exist" containerID="18a7ffa082c44746e99eef1c0fca9664611118d93a791b469df9c5db32bd89ed"
Oct 30 21:19:42.925059 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:42.924984    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18a7ffa082c44746e99eef1c0fca9664611118d93a791b469df9c5db32bd89ed"} err="failed to get container status \"18a7ffa082c44746e99eef1c0fca9664611118d93a791b469df9c5db32bd89ed\": rpc error: code = NotFound desc = could not find container \"18a7ffa082c44746e99eef1c0fca9664611118d93a791b469df9c5db32bd89ed\": container with ID starting with 18a7ffa082c44746e99eef1c0fca9664611118d93a791b469df9c5db32bd89ed not found: ID does not exist"
Oct 30 21:19:42.925059 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:42.925007    4522 scope.go:122] "RemoveContainer" containerID="ca4d5362c84113d9bcee932746e585d8415fc4f74715f02c3e3d30dea465eea0"
Oct 30 21:19:42.925368 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:19:42.925335    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca4d5362c84113d9bcee932746e585d8415fc4f74715f02c3e3d30dea465eea0\": container with ID starting with ca4d5362c84113d9bcee932746e585d8415fc4f74715f02c3e3d30dea465eea0 not found: ID does not exist" containerID="ca4d5362c84113d9bcee932746e585d8415fc4f74715f02c3e3d30dea465eea0"
Oct 30 21:19:42.925448 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:42.925366    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca4d5362c84113d9bcee932746e585d8415fc4f74715f02c3e3d30dea465eea0"} err="failed to get container status \"ca4d5362c84113d9bcee932746e585d8415fc4f74715f02c3e3d30dea465eea0\": rpc error: code = NotFound desc = could not find container \"ca4d5362c84113d9bcee932746e585d8415fc4f74715f02c3e3d30dea465eea0\": container with ID starting with ca4d5362c84113d9bcee932746e585d8415fc4f74715f02c3e3d30dea465eea0 not found: ID does not exist"
Oct 30 21:19:43.065506 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:43.065427    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-r5pm8"]
Oct 30 21:19:43.115570 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:43.115534    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-r5pm8"]
Oct 30 21:19:43.192352 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:43.192315    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3d19378f-c820-4c47-a006-34fa2a080abb" path="/var/lib/kubelet/pods/3d19378f-c820-4c47-a006-34fa2a080abb/volumes"
Oct 30 21:19:43.905085 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:43.905005    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx" event={"ID":"24ac8dda-0f4c-4946-b268-fae04a43d31d","Type":"ContainerStarted","Data":"336e5e51555fa5981ff6402c92236ef12658135539abc057448bf88fb40eb590"}
Oct 30 21:19:43.905085 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:43.905077    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx"
Oct 30 21:19:44.019012 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:44.018951    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx" podStartSLOduration=3.179578469 podStartE2EDuration="6.018930643s" totalImagesPullingTime="2.839352174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:19:44.017642107 +0000 UTC m=+492.962587468" watchObservedRunningTime="2026-10-30 21:19:44.018930643 +0000 UTC m=+492.963876004"
Oct 30 21:19:45.392454 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:45.392420    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:45.578998 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:45.578958    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:45.771843 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:45.771803    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:45.964888 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:45.964853    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:46.189695 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:46.189658    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:46.391615 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:46.391585    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:46.597744 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:46.597638    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:48.928912 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:48.928881    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t" event={"ID":"32a19305-ede1-481d-a456-4bee53be8a3e","Type":"ContainerStarted","Data":"8b14fc9fb4f2e9d096390b45d4c8c9a8187fca31a5d75588872c39202f119454"}
Oct 30 21:19:48.929239 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:48.929058    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t"
Oct 30 21:19:49.044995 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:49.044949    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t" podStartSLOduration=2.237629676 podStartE2EDuration="15.044935589s" totalImagesPullingTime="12.807305913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:19:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:19:49.043589528 +0000 UTC m=+497.988534897" watchObservedRunningTime="2026-10-30 21:19:49.044935589 +0000 UTC m=+497.989880962"
Oct 30 21:19:59.938830 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:19:59.938796    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-r7n5t"
Oct 30 21:20:02.340480 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:02.340422    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:02.535351 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:02.535319    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:04.391158 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:04.391127    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:04.590419 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:04.590383    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:04.805551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:04.805521    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:05.401233 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.401205    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"]
Oct 30 21:20:05.401621 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.401518    4522 cpu_manager.go:414] "containerMap: removing container" podUID="3d19378f-c820-4c47-a006-34fa2a080abb" containerName="manager"
Oct 30 21:20:05.401621 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.401529    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d19378f-c820-4c47-a006-34fa2a080abb" containerName="manager"
Oct 30 21:20:05.401621 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.401559    4522 cpu_manager.go:414] "containerMap: removing container" podUID="3d19378f-c820-4c47-a006-34fa2a080abb" containerName="manager"
Oct 30 21:20:05.401621 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.401564    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d19378f-c820-4c47-a006-34fa2a080abb" containerName="manager"
Oct 30 21:20:05.401621 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.401612    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="3d19378f-c820-4c47-a006-34fa2a080abb" containerName="manager"
Oct 30 21:20:05.401621 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.401622    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="3d19378f-c820-4c47-a006-34fa2a080abb" containerName="manager"
Oct 30 21:20:05.674376 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.674352    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"]
Oct 30 21:20:05.674544 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.674443    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"
Oct 30 21:20:05.712287 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.712260    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-openshift-service-ca\") pod \"maas-api-6d669c7fcd-ljr9q\" (UID: \"a478cd05-3354-4af0-a2aa-afa7dae1f0fc\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"
Oct 30 21:20:05.712432 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.712294    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-maas-api-tls\") pod \"maas-api-6d669c7fcd-ljr9q\" (UID: \"a478cd05-3354-4af0-a2aa-afa7dae1f0fc\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"
Oct 30 21:20:05.712515 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.712432    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-metrics-certs\") pod \"maas-api-6d669c7fcd-ljr9q\" (UID: \"a478cd05-3354-4af0-a2aa-afa7dae1f0fc\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"
Oct 30 21:20:05.712515 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.712475    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j94c\" (UniqueName: \"kubernetes.io/projected/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-kube-api-access-8j94c\") pod \"maas-api-6d669c7fcd-ljr9q\" (UID: \"a478cd05-3354-4af0-a2aa-afa7dae1f0fc\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"
Oct 30 21:20:05.726523 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.726492    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:20:05.775880 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.775860    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:20:05.776154 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.776138    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 30 21:20:05.776202 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.776170    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wqlw4\""
Oct 30 21:20:05.776237 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.776199    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 21:20:05.813786 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.813763    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-metrics-certs\") pod \"maas-api-6d669c7fcd-ljr9q\" (UID: \"a478cd05-3354-4af0-a2aa-afa7dae1f0fc\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"
Oct 30 21:20:05.813858 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.813790    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j94c\" (UniqueName: \"kubernetes.io/projected/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-kube-api-access-8j94c\") pod \"maas-api-6d669c7fcd-ljr9q\" (UID: \"a478cd05-3354-4af0-a2aa-afa7dae1f0fc\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"
Oct 30 21:20:05.813858 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.813827    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-openshift-service-ca\") pod \"maas-api-6d669c7fcd-ljr9q\" (UID: \"a478cd05-3354-4af0-a2aa-afa7dae1f0fc\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"
Oct 30 21:20:05.813939 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.813857    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-maas-api-tls\") pod \"maas-api-6d669c7fcd-ljr9q\" (UID: \"a478cd05-3354-4af0-a2aa-afa7dae1f0fc\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"
Oct 30 21:20:05.814556 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.814532    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-openshift-service-ca\") pod \"maas-api-6d669c7fcd-ljr9q\" (UID: \"a478cd05-3354-4af0-a2aa-afa7dae1f0fc\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"
Oct 30 21:20:05.821665 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.816187    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-maas-api-tls\") pod \"maas-api-6d669c7fcd-ljr9q\" (UID: \"a478cd05-3354-4af0-a2aa-afa7dae1f0fc\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"
Oct 30 21:20:05.821665 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.816220    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-metrics-certs\") pod \"maas-api-6d669c7fcd-ljr9q\" (UID: \"a478cd05-3354-4af0-a2aa-afa7dae1f0fc\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"
Oct 30 21:20:05.869539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.869515    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j94c\" (UniqueName: \"kubernetes.io/projected/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-kube-api-access-8j94c\") pod \"maas-api-6d669c7fcd-ljr9q\" (UID: \"a478cd05-3354-4af0-a2aa-afa7dae1f0fc\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"
Oct 30 21:20:05.985012 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:05.984963    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"
Oct 30 21:20:06.354135 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:06.353963    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"]
Oct 30 21:20:06.356663 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:20:06.356637    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda478cd05_3354_4af0_a2aa_afa7dae1f0fc.slice/crio-632e1253bf094292ed51f9f8ec87ec79be961d3b637d9fa8b41395a5a9d339fc WatchSource:0}: Error finding container 632e1253bf094292ed51f9f8ec87ec79be961d3b637d9fa8b41395a5a9d339fc: Status 404 returned error can't find the container with id 632e1253bf094292ed51f9f8ec87ec79be961d3b637d9fa8b41395a5a9d339fc
Oct 30 21:20:06.999138 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:06.999098    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q" event={"ID":"a478cd05-3354-4af0-a2aa-afa7dae1f0fc","Type":"ContainerStarted","Data":"632e1253bf094292ed51f9f8ec87ec79be961d3b637d9fa8b41395a5a9d339fc"}
Oct 30 21:20:07.990021 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:20:07.989985    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:20:09.008536 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:09.008498    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q" event={"ID":"a478cd05-3354-4af0-a2aa-afa7dae1f0fc","Type":"ContainerStarted","Data":"a29bdcf06da3179f0b6a26a43263d370c69b1ad27184650459a1713eb0d63560"}
Oct 30 21:20:09.008927 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:09.008739    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"
Oct 30 21:20:09.123993 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:09.123931    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q" podStartSLOduration=2.3252714660000002 podStartE2EDuration="4.123916383s" totalImagesPullingTime="1.798644917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:20:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:20:09.122653111 +0000 UTC m=+518.067598470" watchObservedRunningTime="2026-10-30 21:20:09.123916383 +0000 UTC m=+518.068861756"
Oct 30 21:20:10.859509 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:10.859473    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:20:14.913962 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:14.913929    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx"
Oct 30 21:20:15.018078 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:15.018051    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"
Oct 30 21:20:19.000864 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:19.000826    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:35.562405 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:35.562361    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:35.769862 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:35.769833    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:36.052964 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:36.052933    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"]
Oct 30 21:20:36.055811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:36.055791    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"
Oct 30 21:20:36.150519 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:36.150491    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-maas-api-tls\") pod \"maas-api-5f994fb758-4gct6\" (UID: \"7b53a976-2bc6-4cfb-8549-4a45213ed9f1\") " pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"
Oct 30 21:20:36.150624 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:36.150526    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq727\" (UniqueName: \"kubernetes.io/projected/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-kube-api-access-lq727\") pod \"maas-api-5f994fb758-4gct6\" (UID: \"7b53a976-2bc6-4cfb-8549-4a45213ed9f1\") " pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"
Oct 30 21:20:36.150624 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:36.150553    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-metrics-certs\") pod \"maas-api-5f994fb758-4gct6\" (UID: \"7b53a976-2bc6-4cfb-8549-4a45213ed9f1\") " pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"
Oct 30 21:20:36.150697 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:36.150652    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-openshift-service-ca\") pod \"maas-api-5f994fb758-4gct6\" (UID: \"7b53a976-2bc6-4cfb-8549-4a45213ed9f1\") " pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"
Oct 30 21:20:36.157773 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:36.157752    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"]
Oct 30 21:20:36.251373 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:36.251351    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-maas-api-tls\") pod \"maas-api-5f994fb758-4gct6\" (UID: \"7b53a976-2bc6-4cfb-8549-4a45213ed9f1\") " pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"
Oct 30 21:20:36.251494 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:36.251379    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq727\" (UniqueName: \"kubernetes.io/projected/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-kube-api-access-lq727\") pod \"maas-api-5f994fb758-4gct6\" (UID: \"7b53a976-2bc6-4cfb-8549-4a45213ed9f1\") " pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"
Oct 30 21:20:36.251494 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:36.251403    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-metrics-certs\") pod \"maas-api-5f994fb758-4gct6\" (UID: \"7b53a976-2bc6-4cfb-8549-4a45213ed9f1\") " pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"
Oct 30 21:20:36.251494 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:36.251425    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-openshift-service-ca\") pod \"maas-api-5f994fb758-4gct6\" (UID: \"7b53a976-2bc6-4cfb-8549-4a45213ed9f1\") " pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"
Oct 30 21:20:36.252109 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:36.252088    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-openshift-service-ca\") pod \"maas-api-5f994fb758-4gct6\" (UID: \"7b53a976-2bc6-4cfb-8549-4a45213ed9f1\") " pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"
Oct 30 21:20:36.253698 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:36.253679    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-metrics-certs\") pod \"maas-api-5f994fb758-4gct6\" (UID: \"7b53a976-2bc6-4cfb-8549-4a45213ed9f1\") " pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"
Oct 30 21:20:36.253797 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:36.253742    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-maas-api-tls\") pod \"maas-api-5f994fb758-4gct6\" (UID: \"7b53a976-2bc6-4cfb-8549-4a45213ed9f1\") " pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"
Oct 30 21:20:36.307786 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:36.307716    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq727\" (UniqueName: \"kubernetes.io/projected/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-kube-api-access-lq727\") pod \"maas-api-5f994fb758-4gct6\" (UID: \"7b53a976-2bc6-4cfb-8549-4a45213ed9f1\") " pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"
Oct 30 21:20:36.366264 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:36.366235    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"
Oct 30 21:20:36.735721 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:36.735691    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"]
Oct 30 21:20:36.738973 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:20:36.738946    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b53a976_2bc6_4cfb_8549_4a45213ed9f1.slice/crio-25af1d3275522f63ffe5ed8c1f43d42cf856e20d6f9b4edf9f702806bae79d53 WatchSource:0}: Error finding container 25af1d3275522f63ffe5ed8c1f43d42cf856e20d6f9b4edf9f702806bae79d53: Status 404 returned error can't find the container with id 25af1d3275522f63ffe5ed8c1f43d42cf856e20d6f9b4edf9f702806bae79d53
Oct 30 21:20:37.117311 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:37.117223    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6" event={"ID":"7b53a976-2bc6-4cfb-8549-4a45213ed9f1","Type":"ContainerStarted","Data":"25af1d3275522f63ffe5ed8c1f43d42cf856e20d6f9b4edf9f702806bae79d53"}
Oct 30 21:20:37.987161 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:20:37.987129    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:20:38.121941 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:38.121911    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6" event={"ID":"7b53a976-2bc6-4cfb-8549-4a45213ed9f1","Type":"ContainerStarted","Data":"f3d29c6982db748d6907406a25f8890639cbe6e522b31f20b1fc27b4fb4aead6"}
Oct 30 21:20:38.122091 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:38.121981    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"
Oct 30 21:20:38.236914 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:38.236868    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6" podStartSLOduration=1.4525832410000001 podStartE2EDuration="2.236854965s" totalImagesPullingTime="784.271724ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:20:38.235433145 +0000 UTC m=+547.180378487" watchObservedRunningTime="2026-10-30 21:20:38.236854965 +0000 UTC m=+547.181800347"
Oct 30 21:20:44.130834 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:44.130795    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"
Oct 30 21:20:44.297366 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:44.297299    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"]
Oct 30 21:20:44.297665 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:44.297636    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q" podUID="a478cd05-3354-4af0-a2aa-afa7dae1f0fc" containerName="maas-api" containerID="cri-o://a29bdcf06da3179f0b6a26a43263d370c69b1ad27184650459a1713eb0d63560" gracePeriod=30
Oct 30 21:20:44.541531 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:44.541508    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"
Oct 30 21:20:44.720119 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:44.720093    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-metrics-certs\") pod \"a478cd05-3354-4af0-a2aa-afa7dae1f0fc\" (UID: \"a478cd05-3354-4af0-a2aa-afa7dae1f0fc\") "
Oct 30 21:20:44.720279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:44.720138    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-openshift-service-ca\") pod \"a478cd05-3354-4af0-a2aa-afa7dae1f0fc\" (UID: \"a478cd05-3354-4af0-a2aa-afa7dae1f0fc\") "
Oct 30 21:20:44.720279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:44.720170    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-kube-api-access-8j94c\" (UniqueName: \"kubernetes.io/projected/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-kube-api-access-8j94c\") pod \"a478cd05-3354-4af0-a2aa-afa7dae1f0fc\" (UID: \"a478cd05-3354-4af0-a2aa-afa7dae1f0fc\") "
Oct 30 21:20:44.720279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:44.720189    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-maas-api-tls\") pod \"a478cd05-3354-4af0-a2aa-afa7dae1f0fc\" (UID: \"a478cd05-3354-4af0-a2aa-afa7dae1f0fc\") "
Oct 30 21:20:44.720613 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:44.720585    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-openshift-service-ca" pod "a478cd05-3354-4af0-a2aa-afa7dae1f0fc" (UID: "a478cd05-3354-4af0-a2aa-afa7dae1f0fc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:20:44.722425 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:44.722402    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-kube-api-access-8j94c" pod "a478cd05-3354-4af0-a2aa-afa7dae1f0fc" (UID: "a478cd05-3354-4af0-a2aa-afa7dae1f0fc"). InnerVolumeSpecName "kube-api-access-8j94c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:20:44.722521 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:44.722432    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-maas-api-tls" pod "a478cd05-3354-4af0-a2aa-afa7dae1f0fc" (UID: "a478cd05-3354-4af0-a2aa-afa7dae1f0fc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:20:44.722521 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:44.722449    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-metrics-certs" pod "a478cd05-3354-4af0-a2aa-afa7dae1f0fc" (UID: "a478cd05-3354-4af0-a2aa-afa7dae1f0fc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:20:44.821076 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:44.821053    4522 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-metrics-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:44.821076 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:44.821074    4522 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-openshift-service-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:44.821191 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:44.821085    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8j94c\" (UniqueName: \"kubernetes.io/projected/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-kube-api-access-8j94c\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:44.821191 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:44.821096    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a478cd05-3354-4af0-a2aa-afa7dae1f0fc-maas-api-tls\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:45.149890 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:45.149809    4522 generic.go:356] "Generic (PLEG): container finished" podID="a478cd05-3354-4af0-a2aa-afa7dae1f0fc" containerID="a29bdcf06da3179f0b6a26a43263d370c69b1ad27184650459a1713eb0d63560" exitCode=0
Oct 30 21:20:45.149890 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:45.149857    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"
Oct 30 21:20:45.150409 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:45.149894    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q" event={"ID":"a478cd05-3354-4af0-a2aa-afa7dae1f0fc","Type":"ContainerDied","Data":"a29bdcf06da3179f0b6a26a43263d370c69b1ad27184650459a1713eb0d63560"}
Oct 30 21:20:45.150409 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:45.149949    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q" event={"ID":"a478cd05-3354-4af0-a2aa-afa7dae1f0fc","Type":"ContainerDied","Data":"632e1253bf094292ed51f9f8ec87ec79be961d3b637d9fa8b41395a5a9d339fc"}
Oct 30 21:20:45.150409 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:45.149970    4522 scope.go:122] "RemoveContainer" containerID="a29bdcf06da3179f0b6a26a43263d370c69b1ad27184650459a1713eb0d63560"
Oct 30 21:20:45.158183 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:45.158169    4522 scope.go:122] "RemoveContainer" containerID="a29bdcf06da3179f0b6a26a43263d370c69b1ad27184650459a1713eb0d63560"
Oct 30 21:20:45.158425 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:20:45.158407    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a29bdcf06da3179f0b6a26a43263d370c69b1ad27184650459a1713eb0d63560\": container with ID starting with a29bdcf06da3179f0b6a26a43263d370c69b1ad27184650459a1713eb0d63560 not found: ID does not exist" containerID="a29bdcf06da3179f0b6a26a43263d370c69b1ad27184650459a1713eb0d63560"
Oct 30 21:20:45.158486 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:45.158434    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a29bdcf06da3179f0b6a26a43263d370c69b1ad27184650459a1713eb0d63560"} err="failed to get container status \"a29bdcf06da3179f0b6a26a43263d370c69b1ad27184650459a1713eb0d63560\": rpc error: code = NotFound desc = could not find container \"a29bdcf06da3179f0b6a26a43263d370c69b1ad27184650459a1713eb0d63560\": container with ID starting with a29bdcf06da3179f0b6a26a43263d370c69b1ad27184650459a1713eb0d63560 not found: ID does not exist"
Oct 30 21:20:45.310049 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:45.310015    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"]
Oct 30 21:20:45.359382 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:45.359351    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-ljr9q"]
Oct 30 21:20:47.190142 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:20:47.190114    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a478cd05-3354-4af0-a2aa-afa7dae1f0fc" path="/var/lib/kubelet/pods/a478cd05-3354-4af0-a2aa-afa7dae1f0fc/volumes"
Oct 30 21:21:00.957557 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:00.957518    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-85kvs"]
Oct 30 21:21:00.959986 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:00.957860    4522 cpu_manager.go:414] "containerMap: removing container" podUID="a478cd05-3354-4af0-a2aa-afa7dae1f0fc" containerName="maas-api"
Oct 30 21:21:00.959986 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:00.957873    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a478cd05-3354-4af0-a2aa-afa7dae1f0fc" containerName="maas-api"
Oct 30 21:21:00.959986 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:00.957938    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="a478cd05-3354-4af0-a2aa-afa7dae1f0fc" containerName="maas-api"
Oct 30 21:21:00.960871 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:00.960854    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-85kvs"
Oct 30 21:21:01.018029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:01.018002    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-85kvs"]
Oct 30 21:21:01.038010 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:01.037980    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lszq\" (UniqueName: \"kubernetes.io/projected/eedac110-0230-4206-a0da-baef13d54fbe-kube-api-access-5lszq\") pod \"llmisvc-controller-manager-6466c554d8-85kvs\" (UID: \"eedac110-0230-4206-a0da-baef13d54fbe\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-85kvs"
Oct 30 21:21:01.038135 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:01.038018    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eedac110-0230-4206-a0da-baef13d54fbe-cert\") pod \"llmisvc-controller-manager-6466c554d8-85kvs\" (UID: \"eedac110-0230-4206-a0da-baef13d54fbe\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-85kvs"
Oct 30 21:21:01.139131 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:01.139105    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lszq\" (UniqueName: \"kubernetes.io/projected/eedac110-0230-4206-a0da-baef13d54fbe-kube-api-access-5lszq\") pod \"llmisvc-controller-manager-6466c554d8-85kvs\" (UID: \"eedac110-0230-4206-a0da-baef13d54fbe\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-85kvs"
Oct 30 21:21:01.139254 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:01.139144    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eedac110-0230-4206-a0da-baef13d54fbe-cert\") pod \"llmisvc-controller-manager-6466c554d8-85kvs\" (UID: \"eedac110-0230-4206-a0da-baef13d54fbe\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-85kvs"
Oct 30 21:21:01.141473 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:01.141445    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eedac110-0230-4206-a0da-baef13d54fbe-cert\") pod \"llmisvc-controller-manager-6466c554d8-85kvs\" (UID: \"eedac110-0230-4206-a0da-baef13d54fbe\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-85kvs"
Oct 30 21:21:01.194969 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:01.194946    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lszq\" (UniqueName: \"kubernetes.io/projected/eedac110-0230-4206-a0da-baef13d54fbe-kube-api-access-5lszq\") pod \"llmisvc-controller-manager-6466c554d8-85kvs\" (UID: \"eedac110-0230-4206-a0da-baef13d54fbe\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-85kvs"
Oct 30 21:21:01.273388 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:01.273335    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-85kvs"
Oct 30 21:21:01.639161 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:01.639079    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-85kvs"]
Oct 30 21:21:01.642317 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:21:01.642293    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeedac110_0230_4206_a0da_baef13d54fbe.slice/crio-ee38ba6963b4c13efae9f26a3571aff4cb799387d5429c666d8188cb2933204f WatchSource:0}: Error finding container ee38ba6963b4c13efae9f26a3571aff4cb799387d5429c666d8188cb2933204f: Status 404 returned error can't find the container with id ee38ba6963b4c13efae9f26a3571aff4cb799387d5429c666d8188cb2933204f
Oct 30 21:21:02.220086 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:02.220052    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-85kvs" event={"ID":"eedac110-0230-4206-a0da-baef13d54fbe","Type":"ContainerStarted","Data":"ee38ba6963b4c13efae9f26a3571aff4cb799387d5429c666d8188cb2933204f"}
Oct 30 21:21:03.225752 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:03.225713    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-85kvs" event={"ID":"eedac110-0230-4206-a0da-baef13d54fbe","Type":"ContainerStarted","Data":"7f013335daf81d9b1653674bc82c3ecdf9ba0feba99c8d1b4dab74687a2a5828"}
Oct 30 21:21:03.226185 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:03.225786    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-85kvs"
Oct 30 21:21:07.986601 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:21:07.986564    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:21:13.076776 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:13.076743    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:19.294664 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:19.294581    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:31.220473 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:31.220439    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:21:31.222136 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:31.222114    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:21:34.231521 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:34.231493    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-85kvs"
Oct 30 21:21:34.347310 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:34.347268    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-85kvs" podStartSLOduration=33.542544849 podStartE2EDuration="34.347254011s" totalImagesPullingTime="804.709162ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:03.340110136 +0000 UTC m=+572.285055495" watchObservedRunningTime="2026-10-30 21:21:34.347254011 +0000 UTC m=+603.292199364"
Oct 30 21:21:34.396303 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:34.396278    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx"]
Oct 30 21:21:34.396485 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:34.396449    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx" podUID="24ac8dda-0f4c-4946-b268-fae04a43d31d" containerName="manager" containerID="cri-o://336e5e51555fa5981ff6402c92236ef12658135539abc057448bf88fb40eb590" gracePeriod=30
Oct 30 21:21:34.637113 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:34.637088    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx"
Oct 30 21:21:34.699849 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:34.699816    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/24ac8dda-0f4c-4946-b268-fae04a43d31d-cert\" (UniqueName: \"kubernetes.io/secret/24ac8dda-0f4c-4946-b268-fae04a43d31d-cert\") pod \"24ac8dda-0f4c-4946-b268-fae04a43d31d\" (UID: \"24ac8dda-0f4c-4946-b268-fae04a43d31d\") "
Oct 30 21:21:34.700037 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:34.699874    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/24ac8dda-0f4c-4946-b268-fae04a43d31d-kube-api-access-znzd5\" (UniqueName: \"kubernetes.io/projected/24ac8dda-0f4c-4946-b268-fae04a43d31d-kube-api-access-znzd5\") pod \"24ac8dda-0f4c-4946-b268-fae04a43d31d\" (UID: \"24ac8dda-0f4c-4946-b268-fae04a43d31d\") "
Oct 30 21:21:34.701950 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:34.701922    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24ac8dda-0f4c-4946-b268-fae04a43d31d-cert" pod "24ac8dda-0f4c-4946-b268-fae04a43d31d" (UID: "24ac8dda-0f4c-4946-b268-fae04a43d31d"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:21:34.702060 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:34.701985    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24ac8dda-0f4c-4946-b268-fae04a43d31d-kube-api-access-znzd5" pod "24ac8dda-0f4c-4946-b268-fae04a43d31d" (UID: "24ac8dda-0f4c-4946-b268-fae04a43d31d"). InnerVolumeSpecName "kube-api-access-znzd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:34.801287 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:34.801206    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znzd5\" (UniqueName: \"kubernetes.io/projected/24ac8dda-0f4c-4946-b268-fae04a43d31d-kube-api-access-znzd5\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:34.801287 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:34.801235    4522 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24ac8dda-0f4c-4946-b268-fae04a43d31d-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:35.277945 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:35.277912    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:35.348334 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:35.348307    4522 generic.go:356] "Generic (PLEG): container finished" podID="24ac8dda-0f4c-4946-b268-fae04a43d31d" containerID="336e5e51555fa5981ff6402c92236ef12658135539abc057448bf88fb40eb590" exitCode=0
Oct 30 21:21:35.348455 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:35.348376    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx"
Oct 30 21:21:35.348455 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:35.348413    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx" event={"ID":"24ac8dda-0f4c-4946-b268-fae04a43d31d","Type":"ContainerDied","Data":"336e5e51555fa5981ff6402c92236ef12658135539abc057448bf88fb40eb590"}
Oct 30 21:21:35.348545 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:35.348472    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx" event={"ID":"24ac8dda-0f4c-4946-b268-fae04a43d31d","Type":"ContainerDied","Data":"2734534b3b715e1ad5e66d6eb054d59e1d920ac86be179ba039ab8d72a66754e"}
Oct 30 21:21:35.348545 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:35.348499    4522 scope.go:122] "RemoveContainer" containerID="336e5e51555fa5981ff6402c92236ef12658135539abc057448bf88fb40eb590"
Oct 30 21:21:35.356312 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:35.356285    4522 scope.go:122] "RemoveContainer" containerID="336e5e51555fa5981ff6402c92236ef12658135539abc057448bf88fb40eb590"
Oct 30 21:21:35.356589 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:21:35.356572    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"336e5e51555fa5981ff6402c92236ef12658135539abc057448bf88fb40eb590\": container with ID starting with 336e5e51555fa5981ff6402c92236ef12658135539abc057448bf88fb40eb590 not found: ID does not exist" containerID="336e5e51555fa5981ff6402c92236ef12658135539abc057448bf88fb40eb590"
Oct 30 21:21:35.356665 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:35.356603    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"336e5e51555fa5981ff6402c92236ef12658135539abc057448bf88fb40eb590"} err="failed to get container status \"336e5e51555fa5981ff6402c92236ef12658135539abc057448bf88fb40eb590\": rpc error: code = NotFound desc = could not find container \"336e5e51555fa5981ff6402c92236ef12658135539abc057448bf88fb40eb590\": container with ID starting with 336e5e51555fa5981ff6402c92236ef12658135539abc057448bf88fb40eb590 not found: ID does not exist"
Oct 30 21:21:35.497382 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:35.497334    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:35.509473 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:35.509437    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx"]
Oct 30 21:21:35.558627 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:35.558594    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-ncnwx"]
Oct 30 21:21:37.189711 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:37.189679    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="24ac8dda-0f4c-4946-b268-fae04a43d31d" path="/var/lib/kubelet/pods/24ac8dda-0f4c-4946-b268-fae04a43d31d/volumes"
Oct 30 21:21:37.987374 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:21:37.987333    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:21:56.857099 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:21:56.857044    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:00.342273 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:00.342235    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:22:01.184967 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:01.184932    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:04.327416 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:04.327382    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:07.496692 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:07.496660    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:07.987159 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:22:07.987126    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:22:10.048317 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:10.048277    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:22:11.115734 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:11.115699    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:11.308725 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:11.308688    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:14.882799 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:14.882743    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:16.401990 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:16.401957    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:16.591296 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:16.591263    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:17.928149 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:17.928097    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:19.636891 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:19.636856    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:20.998843 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:20.998804    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:24.255114 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:24.255083    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:24.843046 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:24.843011    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:22:33.519453 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.519421    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"]
Oct 30 21:22:33.519928 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.519886    4522 cpu_manager.go:414] "containerMap: removing container" podUID="24ac8dda-0f4c-4946-b268-fae04a43d31d" containerName="manager"
Oct 30 21:22:33.519928 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.519906    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="24ac8dda-0f4c-4946-b268-fae04a43d31d" containerName="manager"
Oct 30 21:22:33.520036 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.520007    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="24ac8dda-0f4c-4946-b268-fae04a43d31d" containerName="manager"
Oct 30 21:22:33.524211 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.524190    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.582412 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.582384    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 21:22:33.631534 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.631504    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6bm8h\""
Oct 30 21:22:33.633522 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.633497    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"]
Oct 30 21:22:33.713923 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.713884    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/594ab7ad-be34-44fd-a637-154a4b44f177-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.714095 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.713936    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/594ab7ad-be34-44fd-a637-154a4b44f177-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.714095 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.714039    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/594ab7ad-be34-44fd-a637-154a4b44f177-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.714095 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.714071    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.714196 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.714101    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.714273 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.714215    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.714306 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.714278    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.714306 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.714295    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.714365 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.714319    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rthxk\" (UniqueName: \"kubernetes.io/projected/594ab7ad-be34-44fd-a637-154a4b44f177-kube-api-access-rthxk\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.815243 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.815154    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/594ab7ad-be34-44fd-a637-154a4b44f177-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.815243 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.815238    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.815430 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.815282    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.815430 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.815321    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.815430 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.815397    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.815430 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.815420    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.815657 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.815483    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rthxk\" (UniqueName: \"kubernetes.io/projected/594ab7ad-be34-44fd-a637-154a4b44f177-kube-api-access-rthxk\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.815657 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.815512    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/594ab7ad-be34-44fd-a637-154a4b44f177-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.815657 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.815544    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/594ab7ad-be34-44fd-a637-154a4b44f177-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.815795 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.815712    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.815795 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.815742    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.815795 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.815758    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.816105 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.816078    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.816580 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.816553    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/594ab7ad-be34-44fd-a637-154a4b44f177-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.817822 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.817802    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/594ab7ad-be34-44fd-a637-154a4b44f177-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.817899 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.817850    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.873960 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.873919    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rthxk\" (UniqueName: \"kubernetes.io/projected/594ab7ad-be34-44fd-a637-154a4b44f177-kube-api-access-rthxk\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:33.874117 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:33.873923    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/594ab7ad-be34-44fd-a637-154a4b44f177-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-5w8gw\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:34.136553 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:34.136454    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:34.567505 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:34.567473    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"]
Oct 30 21:22:34.602020 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:22:34.601994    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod594ab7ad_be34_44fd_a637_154a4b44f177.slice/crio-8d985e14e8c490bed10b288f82ed813cf9d5d1126beafcc4db2dd33e1be80891 WatchSource:0}: Error finding container 8d985e14e8c490bed10b288f82ed813cf9d5d1126beafcc4db2dd33e1be80891: Status 404 returned error can't find the container with id 8d985e14e8c490bed10b288f82ed813cf9d5d1126beafcc4db2dd33e1be80891
Oct 30 21:22:34.603842 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:34.603825    4522 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:22:35.587633 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:35.587592    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw" event={"ID":"594ab7ad-be34-44fd-a637-154a4b44f177","Type":"ContainerStarted","Data":"8d985e14e8c490bed10b288f82ed813cf9d5d1126beafcc4db2dd33e1be80891"}
Oct 30 21:22:37.989476 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:22:37.989429    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:22:38.029709 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:38.029680    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:22:38.572686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:38.572657    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:22:38.572758 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:38.572732    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:22:38.572791 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:38.572762    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:22:39.615566 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:39.615532    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw" event={"ID":"594ab7ad-be34-44fd-a637-154a4b44f177","Type":"ContainerStarted","Data":"e848b63aadec74afb23c1f1a3bb607c098f0bf4e9fde47a51aeb08ce869893e3"}
Oct 30 21:22:39.830142 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:39.830082    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw" podStartSLOduration=2.862170723 podStartE2EDuration="6.830068498s" totalImagesPullingTime="3.967897775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:39.783222178 +0000 UTC m=+668.728167549" watchObservedRunningTime="2026-10-30 21:22:39.830068498 +0000 UTC m=+668.775013858"
Oct 30 21:22:40.136887 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:40.136851    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:40.138265 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:40.138242    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-5w8gw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Oct 30 21:22:40.138330 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:40.138292    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw" podUID="594ab7ad-be34-44fd-a637-154a4b44f177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Oct 30 21:22:41.137534 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:41.137496    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-5w8gw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Oct 30 21:22:41.137934 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:41.137551    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw" podUID="594ab7ad-be34-44fd-a637-154a4b44f177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Oct 30 21:22:42.137173 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:42.137133    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-5w8gw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Oct 30 21:22:42.137376 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:42.137219    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw" podUID="594ab7ad-be34-44fd-a637-154a4b44f177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Oct 30 21:22:43.137308 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:43.137275    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-5w8gw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Oct 30 21:22:43.137697 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:43.137330    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw" podUID="594ab7ad-be34-44fd-a637-154a4b44f177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Oct 30 21:22:44.137763 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:44.137677    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-5w8gw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Oct 30 21:22:44.137763 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:44.137742    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw" podUID="594ab7ad-be34-44fd-a637-154a4b44f177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Oct 30 21:22:45.137200 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:45.137161    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-5w8gw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Oct 30 21:22:45.137397 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:45.137224    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw" podUID="594ab7ad-be34-44fd-a637-154a4b44f177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Oct 30 21:22:46.564531 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:46.564496    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:46.564993 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:46.564868    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:46.565663 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:46.565643    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:22:48.635378 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.635342    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"]
Oct 30 21:22:48.638368 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.638339    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.661193 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.661163    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.661351 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.661205    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.661401 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.661338    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.661401 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.661380    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.661523 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.661411    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.661566 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.661524    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.661566 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.661550    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqzp2\" (UniqueName: \"kubernetes.io/projected/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-kube-api-access-sqzp2\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.661650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.661571    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.661702 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.661686    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.762841 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.762805    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.763034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.762858    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.763034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.762981    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.763034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.763019    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.763208 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.763047    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.763208 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.763178    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqzp2\" (UniqueName: \"kubernetes.io/projected/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-kube-api-access-sqzp2\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.763311 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.763230    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.763311 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.763300    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.763417 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.763319    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.763417 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.763378    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.763417 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.763385    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.763591 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.763511    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.763698 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.763675    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.764109 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.764048    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.765792 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.765773    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.765941 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.765920    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.820301 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.820268    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.820514 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.820491    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqzp2\" (UniqueName: \"kubernetes.io/projected/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-kube-api-access-sqzp2\") pod \"maas-default-gateway-openshift-default-6cc458d887-dbsgr\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:48.850545 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.850514    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"]
Oct 30 21:22:48.950014 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:48.949978    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:49.376951 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:49.376872    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"]
Oct 30 21:22:49.380045 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:22:49.380020    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc38af0_5f7f_45af_b8f7_7331b4d5068a.slice/crio-dbacef74693da6abf6676af5d93c18ddfd917ce030f9bef3bca4045854252d93 WatchSource:0}: Error finding container dbacef74693da6abf6676af5d93c18ddfd917ce030f9bef3bca4045854252d93: Status 404 returned error can't find the container with id dbacef74693da6abf6676af5d93c18ddfd917ce030f9bef3bca4045854252d93
Oct 30 21:22:49.382818 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:49.382780    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:22:49.382926 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:49.382863    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:22:49.382926 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:49.382912    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:22:49.657885 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:49.657802    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr" event={"ID":"ddc38af0-5f7f-45af-b8f7-7331b4d5068a","Type":"ContainerStarted","Data":"7386a60ec2a489174dc9c1d463ded462bc6c68010d5540eeaedacfd58a5574f4"}
Oct 30 21:22:49.657885 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:49.657872    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr" event={"ID":"ddc38af0-5f7f-45af-b8f7-7331b4d5068a","Type":"ContainerStarted","Data":"dbacef74693da6abf6676af5d93c18ddfd917ce030f9bef3bca4045854252d93"}
Oct 30 21:22:49.782256 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:49.778070    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr" podStartSLOduration=1.778050117 podStartE2EDuration="1.778050117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:49.775554722 +0000 UTC m=+678.720500080" watchObservedRunningTime="2026-10-30 21:22:49.778050117 +0000 UTC m=+678.722995478"
Oct 30 21:22:49.950705 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:49.950669    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:50.952254 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:50.952219    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dbsgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Oct 30 21:22:50.952665 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:50.952271    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr" podUID="ddc38af0-5f7f-45af-b8f7-7331b4d5068a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Oct 30 21:22:51.951338 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:51.951301    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dbsgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Oct 30 21:22:51.951513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:51.951354    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr" podUID="ddc38af0-5f7f-45af-b8f7-7331b4d5068a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Oct 30 21:22:52.818087 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:52.818056    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:52.951077 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:52.951043    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dbsgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Oct 30 21:22:52.951234 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:52.951102    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr" podUID="ddc38af0-5f7f-45af-b8f7-7331b4d5068a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Oct 30 21:22:53.067563 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:53.067535    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:53.951348 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:53.951316    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dbsgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Oct 30 21:22:53.951748 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:53.951370    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr" podUID="ddc38af0-5f7f-45af-b8f7-7331b4d5068a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Oct 30 21:22:54.950962 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:54.950926    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dbsgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Oct 30 21:22:54.951140 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:54.950993    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr" podUID="ddc38af0-5f7f-45af-b8f7-7331b4d5068a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Oct 30 21:22:55.093883 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:55.093853    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:55.594681 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:55.594645    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:55.950753 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:55.950719    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dbsgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Oct 30 21:22:55.950919 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:55.950780    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr" podUID="ddc38af0-5f7f-45af-b8f7-7331b4d5068a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Oct 30 21:22:57.302447 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:57.302414    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:57.302893 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:57.302757    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:57.303565 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:57.303542    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:22:59.648613 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:22:59.648564    4522 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal" podUID="f52de7228915512f349d24482d38315b" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:23:03.654764 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:03.654734    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:03.844000 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:03.843968    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:07.986533 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:23:07.986499    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:23:19.982766 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:19.982734    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:28.157660 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:28.157585    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:28.704062 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:28.704018    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:30.339237 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:30.339197    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:30.533592 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:30.533561    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:32.038741 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:32.038708    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:32.273947 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:32.273916    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:34.015221 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.015187    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"]
Oct 30 21:23:34.018866 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.018848    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.089057 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.089021    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.089057 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.089054    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.089283 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.089076    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.089283 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.089143    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5cce060-d1b6-48b1-8ede-5414e089961e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.089353 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.089280    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.089353 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.089310    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whvtz\" (UniqueName: \"kubernetes.io/projected/f5cce060-d1b6-48b1-8ede-5414e089961e-kube-api-access-whvtz\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.089353 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.089329    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.089488 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.089435    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.089488 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.089476    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.190406 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.190371    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.190406 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.190407    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvtz\" (UniqueName: \"kubernetes.io/projected/f5cce060-d1b6-48b1-8ede-5414e089961e-kube-api-access-whvtz\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.190668 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.190431    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.190668 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.190506    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.190668 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.190522    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.190668 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.190557    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.190668 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.190581    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.190973 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.190730    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.190973 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.190761    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5cce060-d1b6-48b1-8ede-5414e089961e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.190973 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.190893    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.190973 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.190940    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.191133 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.191099    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.191449 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.191430    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5cce060-d1b6-48b1-8ede-5414e089961e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.191706 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.191690    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.193664 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.193635    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.193778 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.193699    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.235590 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.235556    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"]
Oct 30 21:23:34.249753 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.249721    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.249903 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.249861    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whvtz\" (UniqueName: \"kubernetes.io/projected/f5cce060-d1b6-48b1-8ede-5414e089961e-kube-api-access-whvtz\") pod \"maas-default-gateway-openshift-default-6cc458d887-g7k4k\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.330825 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.330736    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:34.759713 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.759679    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"]
Oct 30 21:23:34.762580 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:23:34.762545    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5cce060_d1b6_48b1_8ede_5414e089961e.slice/crio-bfe858e7b87d6cdb84668f808ffc5f4ab4bd42bad443f50447e4ade967f1028b WatchSource:0}: Error finding container bfe858e7b87d6cdb84668f808ffc5f4ab4bd42bad443f50447e4ade967f1028b: Status 404 returned error can't find the container with id bfe858e7b87d6cdb84668f808ffc5f4ab4bd42bad443f50447e4ade967f1028b
Oct 30 21:23:34.764696 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.764665    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:23:34.764776 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.764727    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:23:34.764776 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.764757    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:23:34.851740 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.851704    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k" event={"ID":"f5cce060-d1b6-48b1-8ede-5414e089961e","Type":"ContainerStarted","Data":"790687fa85cc97ad2ccb55a65d09b2cb957cbe56ebca6181552b9de4ce05772d"}
Oct 30 21:23:34.851740 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.851765    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k" event={"ID":"f5cce060-d1b6-48b1-8ede-5414e089961e","Type":"ContainerStarted","Data":"bfe858e7b87d6cdb84668f808ffc5f4ab4bd42bad443f50447e4ade967f1028b"}
Oct 30 21:23:34.974506 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:34.974421    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k" podStartSLOduration=1.974401632 podStartE2EDuration="1.974401632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:23:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:34.97257655 +0000 UTC m=+723.917521906" watchObservedRunningTime="2026-10-30 21:23:34.974401632 +0000 UTC m=+723.919346993"
Oct 30 21:23:35.281176 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:35.281137    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:35.331277 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:35.331238    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:35.332803 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:35.332781    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-g7k4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Oct 30 21:23:35.332902 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:35.332828    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k" podUID="f5cce060-d1b6-48b1-8ede-5414e089961e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Oct 30 21:23:36.331526 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:36.331494    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-g7k4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Oct 30 21:23:36.331912 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:36.331542    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k" podUID="f5cce060-d1b6-48b1-8ede-5414e089961e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Oct 30 21:23:37.331107 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:37.331070    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-g7k4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Oct 30 21:23:37.331289 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:37.331132    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k" podUID="f5cce060-d1b6-48b1-8ede-5414e089961e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Oct 30 21:23:38.014691 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:23:38.014650    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:23:38.331982 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:38.331901    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-g7k4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Oct 30 21:23:38.331982 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:38.331957    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k" podUID="f5cce060-d1b6-48b1-8ede-5414e089961e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Oct 30 21:23:39.331817 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:39.331780    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-g7k4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Oct 30 21:23:39.332216 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:39.331835    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k" podUID="f5cce060-d1b6-48b1-8ede-5414e089961e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Oct 30 21:23:40.331776 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:40.331739    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-g7k4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Oct 30 21:23:40.331962 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:40.331804    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k" podUID="f5cce060-d1b6-48b1-8ede-5414e089961e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Oct 30 21:23:41.331208 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:41.331173    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-g7k4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Oct 30 21:23:41.331388 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:41.331223    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k" podUID="f5cce060-d1b6-48b1-8ede-5414e089961e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Oct 30 21:23:42.763539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:42.763504    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:42.764620 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:42.764596    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:23:42.765038 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:23:42.765018    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:24:03.315554 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:03.315517    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:03.516153 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:03.516123    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:03.959377 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:03.959347    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:04.152391 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:04.152361    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:04.350969 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:04.350855    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:04.596863 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:04.596791    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:04.841047 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:04.841014    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:05.062504 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:05.062452    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:05.258989 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:05.258954    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:05.484911 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:05.484876    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:05.673291 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:05.673221    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:05.864593 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:05.864546    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:07.988974 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:24:07.988936    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:24:08.780806 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:08.780765    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:08.966169 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:08.966126    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:09.401480 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:09.401439    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:09.586684 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:09.586640    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:10.018140 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:10.018110    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:10.234435 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:10.234401    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:10.417132 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:10.417104    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:10.685133 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:10.685047    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:10.869684 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:10.869650    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:11.280661 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:11.280611    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:11.473227 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:11.473177    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:13.307302 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:13.307272    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:13.500031 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:13.499948    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:13.692264 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:13.692216    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:13.919730 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:13.919701    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:14.216691 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:14.216662    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:14.947272 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:14.947239    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"]
Oct 30 21:24:14.950660 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:14.950642    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"
Oct 30 21:24:15.002074 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:15.002051    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-0a4eab-serving-cert\""
Oct 30 21:24:15.052627 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:15.052601    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"]
Oct 30 21:24:15.068014 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:15.067988    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p7g5\" (UniqueName: \"kubernetes.io/projected/9334df98-484a-4998-a61b-f6f442983131-kube-api-access-5p7g5\") pod \"maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb\" (UID: \"9334df98-484a-4998-a61b-f6f442983131\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"
Oct 30 21:24:15.068112 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:15.068027    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9334df98-484a-4998-a61b-f6f442983131-maas-api-tls\") pod \"maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb\" (UID: \"9334df98-484a-4998-a61b-f6f442983131\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"
Oct 30 21:24:15.068112 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:15.068046    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9334df98-484a-4998-a61b-f6f442983131-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb\" (UID: \"9334df98-484a-4998-a61b-f6f442983131\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"
Oct 30 21:24:15.068218 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:15.068205    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9334df98-484a-4998-a61b-f6f442983131-metrics-certs\") pod \"maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb\" (UID: \"9334df98-484a-4998-a61b-f6f442983131\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"
Oct 30 21:24:15.168972 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:15.168944    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9334df98-484a-4998-a61b-f6f442983131-metrics-certs\") pod \"maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb\" (UID: \"9334df98-484a-4998-a61b-f6f442983131\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"
Oct 30 21:24:15.169112 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:15.168990    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p7g5\" (UniqueName: \"kubernetes.io/projected/9334df98-484a-4998-a61b-f6f442983131-kube-api-access-5p7g5\") pod \"maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb\" (UID: \"9334df98-484a-4998-a61b-f6f442983131\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"
Oct 30 21:24:15.169112 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:15.169014    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9334df98-484a-4998-a61b-f6f442983131-maas-api-tls\") pod \"maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb\" (UID: \"9334df98-484a-4998-a61b-f6f442983131\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"
Oct 30 21:24:15.169112 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:15.169031    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9334df98-484a-4998-a61b-f6f442983131-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb\" (UID: \"9334df98-484a-4998-a61b-f6f442983131\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"
Oct 30 21:24:15.169273 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:24:15.169113    4522 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-serving-cert: secret "maas-api-e2e-worker-w5-0a4eab-serving-cert" not found
Oct 30 21:24:15.169273 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:24:15.169164    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9334df98-484a-4998-a61b-f6f442983131-maas-api-tls podName:9334df98-484a-4998-a61b-f6f442983131 nodeName:}" failed. No retries permitted until 2026-10-30 21:24:15.669150179 +0000 UTC m=+764.614095540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9334df98-484a-4998-a61b-f6f442983131-maas-api-tls") pod "maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb" (UID: "9334df98-484a-4998-a61b-f6f442983131") : secret "maas-api-e2e-worker-w5-0a4eab-serving-cert" not found
Oct 30 21:24:15.169743 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:15.169726    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9334df98-484a-4998-a61b-f6f442983131-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb\" (UID: \"9334df98-484a-4998-a61b-f6f442983131\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"
Oct 30 21:24:15.171377 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:15.171362    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9334df98-484a-4998-a61b-f6f442983131-metrics-certs\") pod \"maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb\" (UID: \"9334df98-484a-4998-a61b-f6f442983131\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"
Oct 30 21:24:15.184985 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:15.184965    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:15.227904 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:15.227832    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p7g5\" (UniqueName: \"kubernetes.io/projected/9334df98-484a-4998-a61b-f6f442983131-kube-api-access-5p7g5\") pod \"maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb\" (UID: \"9334df98-484a-4998-a61b-f6f442983131\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"
Oct 30 21:24:15.371653 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:15.371609    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:15.673692 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:15.673664    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9334df98-484a-4998-a61b-f6f442983131-maas-api-tls\") pod \"maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb\" (UID: \"9334df98-484a-4998-a61b-f6f442983131\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"
Oct 30 21:24:15.676051 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:15.676031    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9334df98-484a-4998-a61b-f6f442983131-maas-api-tls\") pod \"maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb\" (UID: \"9334df98-484a-4998-a61b-f6f442983131\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"
Oct 30 21:24:15.862648 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:15.862619    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"
Oct 30 21:24:16.233884 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:16.233853    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"]
Oct 30 21:24:16.237565 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:24:16.237538    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9334df98_484a_4998_a61b_f6f442983131.slice/crio-9d68d196597698fa9b07a699733eb7602d025713ff38244388b44b912d9da877 WatchSource:0}: Error finding container 9d68d196597698fa9b07a699733eb7602d025713ff38244388b44b912d9da877: Status 404 returned error can't find the container with id 9d68d196597698fa9b07a699733eb7602d025713ff38244388b44b912d9da877
Oct 30 21:24:17.030519 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:17.030482    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb" event={"ID":"9334df98-484a-4998-a61b-f6f442983131","Type":"ContainerStarted","Data":"9d68d196597698fa9b07a699733eb7602d025713ff38244388b44b912d9da877"}
Oct 30 21:24:18.036125 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:18.036089    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb" event={"ID":"9334df98-484a-4998-a61b-f6f442983131","Type":"ContainerStarted","Data":"4c3621be4677fdb1f9068738d8d10c913675ca7a96820d88815ae09dc790d6a4"}
Oct 30 21:24:18.036590 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:18.036226    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"
Oct 30 21:24:18.150712 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:18.150658    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb" podStartSLOduration=3.333292377 podStartE2EDuration="4.150641816s" totalImagesPullingTime="817.349439ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:24:18.149418772 +0000 UTC m=+767.094364146" watchObservedRunningTime="2026-10-30 21:24:18.150641816 +0000 UTC m=+767.095587176"
Oct 30 21:24:18.272658 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:18.272625    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:18.463536 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:18.463505    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:19.934631 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:19.934598    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"]
Oct 30 21:24:19.938087 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:19.938066    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"
Oct 30 21:24:19.989468 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:19.989443    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-be9451-serving-cert\""
Oct 30 21:24:20.012953 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:20.012923    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-maas-api-tls\") pod \"maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv\" (UID: \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"
Oct 30 21:24:20.013070 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:20.013054    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-metrics-certs\") pod \"maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv\" (UID: \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"
Oct 30 21:24:20.013134 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:20.013114    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv\" (UID: \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"
Oct 30 21:24:20.013171 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:20.013143    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqlr9\" (UniqueName: \"kubernetes.io/projected/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-kube-api-access-vqlr9\") pod \"maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv\" (UID: \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"
Oct 30 21:24:20.040240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:20.040211    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"]
Oct 30 21:24:20.114569 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:20.114535    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-metrics-certs\") pod \"maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv\" (UID: \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"
Oct 30 21:24:20.114744 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:20.114594    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv\" (UID: \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"
Oct 30 21:24:20.114744 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:20.114622    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqlr9\" (UniqueName: \"kubernetes.io/projected/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-kube-api-access-vqlr9\") pod \"maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv\" (UID: \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"
Oct 30 21:24:20.114744 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:20.114723    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-maas-api-tls\") pod \"maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv\" (UID: \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"
Oct 30 21:24:20.114903 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:24:20.114854    4522 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-serving-cert: secret "maas-api-e2e-worker-w0-be9451-serving-cert" not found
Oct 30 21:24:20.114949 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:24:20.114939    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-maas-api-tls podName:b0e0cd0b-3d80-4586-a456-1e04ebf7ce31 nodeName:}" failed. No retries permitted until 2026-10-30 21:24:20.61491785 +0000 UTC m=+769.559863190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-maas-api-tls") pod "maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv" (UID: "b0e0cd0b-3d80-4586-a456-1e04ebf7ce31") : secret "maas-api-e2e-worker-w0-be9451-serving-cert" not found
Oct 30 21:24:20.115623 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:20.115597    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv\" (UID: \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"
Oct 30 21:24:20.117106 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:20.117083    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-metrics-certs\") pod \"maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv\" (UID: \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"
Oct 30 21:24:20.174615 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:20.174586    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqlr9\" (UniqueName: \"kubernetes.io/projected/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-kube-api-access-vqlr9\") pod \"maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv\" (UID: \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"
Oct 30 21:24:20.213560 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:20.213487    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:20.402729 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:20.402669    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:20.619873 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:20.619777    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-maas-api-tls\") pod \"maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv\" (UID: \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"
Oct 30 21:24:20.622151 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:20.622126    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-maas-api-tls\") pod \"maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv\" (UID: \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"
Oct 30 21:24:20.772604 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:20.772571    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:20.850260 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:20.850228    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"
Oct 30 21:24:20.977057 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:20.977023    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:21.222509 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:21.222347    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"]
Oct 30 21:24:21.225069 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:24:21.225043    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0e0cd0b_3d80_4586_a456_1e04ebf7ce31.slice/crio-ec2fe691eb8d57dc7392ccf475931d80b35a8837e51402bf1645f9d2bed9430d WatchSource:0}: Error finding container ec2fe691eb8d57dc7392ccf475931d80b35a8837e51402bf1645f9d2bed9430d: Status 404 returned error can't find the container with id ec2fe691eb8d57dc7392ccf475931d80b35a8837e51402bf1645f9d2bed9430d
Oct 30 21:24:22.051594 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:22.051551    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:22.055486 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:22.055450    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv" event={"ID":"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31","Type":"ContainerStarted","Data":"ec2fe691eb8d57dc7392ccf475931d80b35a8837e51402bf1645f9d2bed9430d"}
Oct 30 21:24:22.281327 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:22.281292    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:23.061637 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:23.061602    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv" event={"ID":"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31","Type":"ContainerStarted","Data":"8d91dbff86b2d7820a3eb6568a65d174c2720047b3c14f3e1b83eb75ee3837ff"}
Oct 30 21:24:23.062031 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:23.061704    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"
Oct 30 21:24:23.177874 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:23.177818    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv" podStartSLOduration=3.33049207 podStartE2EDuration="4.177801113s" totalImagesPullingTime="847.309043ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:24:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:24:23.175294807 +0000 UTC m=+772.120240168" watchObservedRunningTime="2026-10-30 21:24:23.177801113 +0000 UTC m=+772.122746474"
Oct 30 21:24:23.269582 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:23.269544    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:23.454673 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:23.454646    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:24.046056 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:24.046024    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"
Oct 30 21:24:25.445451 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:25.445410    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:25.645416 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:25.645375    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:28.014085 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:28.014003    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:28.202011 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:28.201979    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:28.349742 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:28.349668    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:24:29.072212 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:29.072186    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"
Oct 30 21:24:29.605156 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:29.605112    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:29.792759 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:29.792727    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:30.376364 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:30.376331    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"]
Oct 30 21:24:30.379745 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:30.379729    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"
Oct 30 21:24:30.489924 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:30.489897    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-8ce31a-serving-cert\""
Oct 30 21:24:30.491384 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:30.491364    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"]
Oct 30 21:24:30.513509 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:30.513484    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53a26546-ac0e-47d2-b1da-c1d08799ce83-maas-api-tls\") pod \"maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq\" (UID: \"53a26546-ac0e-47d2-b1da-c1d08799ce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"
Oct 30 21:24:30.513509 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:30.513518    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpwkp\" (UniqueName: \"kubernetes.io/projected/53a26546-ac0e-47d2-b1da-c1d08799ce83-kube-api-access-dpwkp\") pod \"maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq\" (UID: \"53a26546-ac0e-47d2-b1da-c1d08799ce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"
Oct 30 21:24:30.513679 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:30.513618    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53a26546-ac0e-47d2-b1da-c1d08799ce83-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq\" (UID: \"53a26546-ac0e-47d2-b1da-c1d08799ce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"
Oct 30 21:24:30.513730 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:30.513715    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a26546-ac0e-47d2-b1da-c1d08799ce83-metrics-certs\") pod \"maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq\" (UID: \"53a26546-ac0e-47d2-b1da-c1d08799ce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"
Oct 30 21:24:30.614152 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:30.614122    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53a26546-ac0e-47d2-b1da-c1d08799ce83-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq\" (UID: \"53a26546-ac0e-47d2-b1da-c1d08799ce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"
Oct 30 21:24:30.614326 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:30.614191    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a26546-ac0e-47d2-b1da-c1d08799ce83-metrics-certs\") pod \"maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq\" (UID: \"53a26546-ac0e-47d2-b1da-c1d08799ce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"
Oct 30 21:24:30.614326 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:30.614213    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53a26546-ac0e-47d2-b1da-c1d08799ce83-maas-api-tls\") pod \"maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq\" (UID: \"53a26546-ac0e-47d2-b1da-c1d08799ce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"
Oct 30 21:24:30.614326 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:24:30.614300    4522 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-serving-cert: secret "maas-api-e2e-worker-w1-8ce31a-serving-cert" not found
Oct 30 21:24:30.614326 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:30.614304    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpwkp\" (UniqueName: \"kubernetes.io/projected/53a26546-ac0e-47d2-b1da-c1d08799ce83-kube-api-access-dpwkp\") pod \"maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq\" (UID: \"53a26546-ac0e-47d2-b1da-c1d08799ce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"
Oct 30 21:24:30.614562 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:24:30.614354    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a26546-ac0e-47d2-b1da-c1d08799ce83-maas-api-tls podName:53a26546-ac0e-47d2-b1da-c1d08799ce83 nodeName:}" failed. No retries permitted until 2026-10-30 21:24:31.114334409 +0000 UTC m=+780.059279754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/53a26546-ac0e-47d2-b1da-c1d08799ce83-maas-api-tls") pod "maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq" (UID: "53a26546-ac0e-47d2-b1da-c1d08799ce83") : secret "maas-api-e2e-worker-w1-8ce31a-serving-cert" not found
Oct 30 21:24:30.614812 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:30.614785    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53a26546-ac0e-47d2-b1da-c1d08799ce83-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq\" (UID: \"53a26546-ac0e-47d2-b1da-c1d08799ce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"
Oct 30 21:24:30.616624 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:30.616603    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a26546-ac0e-47d2-b1da-c1d08799ce83-metrics-certs\") pod \"maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq\" (UID: \"53a26546-ac0e-47d2-b1da-c1d08799ce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"
Oct 30 21:24:30.646307 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:30.646250    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:30.671430 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:30.671405    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpwkp\" (UniqueName: \"kubernetes.io/projected/53a26546-ac0e-47d2-b1da-c1d08799ce83-kube-api-access-dpwkp\") pod \"maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq\" (UID: \"53a26546-ac0e-47d2-b1da-c1d08799ce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"
Oct 30 21:24:30.840452 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:30.840388    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:31.044508 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:31.044476    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:31.119175 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:31.119139    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53a26546-ac0e-47d2-b1da-c1d08799ce83-maas-api-tls\") pod \"maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq\" (UID: \"53a26546-ac0e-47d2-b1da-c1d08799ce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"
Oct 30 21:24:31.121406 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:31.121377    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53a26546-ac0e-47d2-b1da-c1d08799ce83-maas-api-tls\") pod \"maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq\" (UID: \"53a26546-ac0e-47d2-b1da-c1d08799ce83\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"
Oct 30 21:24:31.291601 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:31.291570    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"
Oct 30 21:24:31.662706 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:31.662579    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"]
Oct 30 21:24:31.666830 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:24:31.666802    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53a26546_ac0e_47d2_b1da_c1d08799ce83.slice/crio-c757b5efb92bb4cbbb8fcd7a2aaf896a98f056d6e3fcefc44984c6b762ebab9d WatchSource:0}: Error finding container c757b5efb92bb4cbbb8fcd7a2aaf896a98f056d6e3fcefc44984c6b762ebab9d: Status 404 returned error can't find the container with id c757b5efb92bb4cbbb8fcd7a2aaf896a98f056d6e3fcefc44984c6b762ebab9d
Oct 30 21:24:32.105521 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:32.105489    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq" event={"ID":"53a26546-ac0e-47d2-b1da-c1d08799ce83","Type":"ContainerStarted","Data":"c757b5efb92bb4cbbb8fcd7a2aaf896a98f056d6e3fcefc44984c6b762ebab9d"}
Oct 30 21:24:32.858629 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:32.858555    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:33.048522 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:33.048446    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:33.111923 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:33.111849    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq" event={"ID":"53a26546-ac0e-47d2-b1da-c1d08799ce83","Type":"ContainerStarted","Data":"c4947de6f9bdfab93f31d052606f24fe7728d0a8d243a7cfb1a3b494881b63f5"}
Oct 30 21:24:33.112067 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:33.111991    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"
Oct 30 21:24:33.226654 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:33.226604    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq" podStartSLOduration=2.399103969 podStartE2EDuration="3.226589077s" totalImagesPullingTime="827.485108ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:24:33.225428561 +0000 UTC m=+782.170373923" watchObservedRunningTime="2026-10-30 21:24:33.226589077 +0000 UTC m=+782.171534437"
Oct 30 21:24:35.114589 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:35.114559    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:24:35.853551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:35.853518    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:37.987682 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:24:37.987646    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:24:39.122949 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:39.122922    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"
Oct 30 21:24:40.001612 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:40.001575    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:40.192400 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:40.192366    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:40.737730 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:40.737700    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"]
Oct 30 21:24:40.741272 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:40.741246    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"
Oct 30 21:24:40.794083 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:40.794051    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-847c62-serving-cert\""
Oct 30 21:24:40.844922 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:40.844897    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"]
Oct 30 21:24:40.905398 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:40.905369    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4tmg\" (UniqueName: \"kubernetes.io/projected/59d1c023-02be-4bfa-b3ac-ca4ac231062d-kube-api-access-j4tmg\") pod \"maas-api-e2e-worker-w4-847c62-7499845f67-sg65j\" (UID: \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"
Oct 30 21:24:40.905549 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:40.905418    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59d1c023-02be-4bfa-b3ac-ca4ac231062d-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-847c62-7499845f67-sg65j\" (UID: \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"
Oct 30 21:24:40.905549 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:40.905438    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59d1c023-02be-4bfa-b3ac-ca4ac231062d-metrics-certs\") pod \"maas-api-e2e-worker-w4-847c62-7499845f67-sg65j\" (UID: \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"
Oct 30 21:24:40.905627 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:40.905611    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59d1c023-02be-4bfa-b3ac-ca4ac231062d-maas-api-tls\") pod \"maas-api-e2e-worker-w4-847c62-7499845f67-sg65j\" (UID: \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"
Oct 30 21:24:41.006579 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:41.006502    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59d1c023-02be-4bfa-b3ac-ca4ac231062d-maas-api-tls\") pod \"maas-api-e2e-worker-w4-847c62-7499845f67-sg65j\" (UID: \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"
Oct 30 21:24:41.006579 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:41.006564    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4tmg\" (UniqueName: \"kubernetes.io/projected/59d1c023-02be-4bfa-b3ac-ca4ac231062d-kube-api-access-j4tmg\") pod \"maas-api-e2e-worker-w4-847c62-7499845f67-sg65j\" (UID: \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"
Oct 30 21:24:41.006788 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:41.006599    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59d1c023-02be-4bfa-b3ac-ca4ac231062d-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-847c62-7499845f67-sg65j\" (UID: \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"
Oct 30 21:24:41.006788 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:41.006613    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59d1c023-02be-4bfa-b3ac-ca4ac231062d-metrics-certs\") pod \"maas-api-e2e-worker-w4-847c62-7499845f67-sg65j\" (UID: \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"
Oct 30 21:24:41.006788 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:24:41.006654    4522 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-serving-cert: secret "maas-api-e2e-worker-w4-847c62-serving-cert" not found
Oct 30 21:24:41.006788 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:24:41.006728    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d1c023-02be-4bfa-b3ac-ca4ac231062d-maas-api-tls podName:59d1c023-02be-4bfa-b3ac-ca4ac231062d nodeName:}" failed. No retries permitted until 2026-10-30 21:24:41.50671039 +0000 UTC m=+790.451655748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/59d1c023-02be-4bfa-b3ac-ca4ac231062d-maas-api-tls") pod "maas-api-e2e-worker-w4-847c62-7499845f67-sg65j" (UID: "59d1c023-02be-4bfa-b3ac-ca4ac231062d") : secret "maas-api-e2e-worker-w4-847c62-serving-cert" not found
Oct 30 21:24:41.007217 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:41.007189    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59d1c023-02be-4bfa-b3ac-ca4ac231062d-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-847c62-7499845f67-sg65j\" (UID: \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"
Oct 30 21:24:41.008810 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:41.008794    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59d1c023-02be-4bfa-b3ac-ca4ac231062d-metrics-certs\") pod \"maas-api-e2e-worker-w4-847c62-7499845f67-sg65j\" (UID: \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"
Oct 30 21:24:41.029344 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:41.029318    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:41.065111 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:41.065078    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4tmg\" (UniqueName: \"kubernetes.io/projected/59d1c023-02be-4bfa-b3ac-ca4ac231062d-kube-api-access-j4tmg\") pod \"maas-api-e2e-worker-w4-847c62-7499845f67-sg65j\" (UID: \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"
Oct 30 21:24:41.331843 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:41.331759    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:41.512060 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:41.512025    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59d1c023-02be-4bfa-b3ac-ca4ac231062d-maas-api-tls\") pod \"maas-api-e2e-worker-w4-847c62-7499845f67-sg65j\" (UID: \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"
Oct 30 21:24:41.514417 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:41.514398    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59d1c023-02be-4bfa-b3ac-ca4ac231062d-maas-api-tls\") pod \"maas-api-e2e-worker-w4-847c62-7499845f67-sg65j\" (UID: \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"
Oct 30 21:24:41.653674 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:41.653602    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"
Oct 30 21:24:42.023626 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:42.023597    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"]
Oct 30 21:24:42.026621 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:24:42.026588    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d1c023_02be_4bfa_b3ac_ca4ac231062d.slice/crio-3760e7017af47471ca52db044bda78e97100cb9d192d9ea5e65ed653337d0578 WatchSource:0}: Error finding container 3760e7017af47471ca52db044bda78e97100cb9d192d9ea5e65ed653337d0578: Status 404 returned error can't find the container with id 3760e7017af47471ca52db044bda78e97100cb9d192d9ea5e65ed653337d0578
Oct 30 21:24:42.152524 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:42.152488    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j" event={"ID":"59d1c023-02be-4bfa-b3ac-ca4ac231062d","Type":"ContainerStarted","Data":"3760e7017af47471ca52db044bda78e97100cb9d192d9ea5e65ed653337d0578"}
Oct 30 21:24:43.157964 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:43.157930    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j" event={"ID":"59d1c023-02be-4bfa-b3ac-ca4ac231062d","Type":"ContainerStarted","Data":"4d1701a357eda3a04fa81c6e8713cf01b31cdca0ca52db35a2aa676fafae12ac"}
Oct 30 21:24:43.158332 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:43.158018    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"
Oct 30 21:24:43.273205 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:43.273101    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j" podStartSLOduration=2.367073568 podStartE2EDuration="3.27308439s" totalImagesPullingTime="906.010822ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:24:43.272074579 +0000 UTC m=+792.217019921" watchObservedRunningTime="2026-10-30 21:24:43.27308439 +0000 UTC m=+792.218029749"
Oct 30 21:24:46.306236 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:46.306204    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:49.167891 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:49.167862    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"
Oct 30 21:24:49.556210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:49.556132    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:24:51.328624 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:51.328589    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:51.520345 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:51.520319    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:51.713580 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:51.713553    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:54.225372 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:54.225336    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:54.818979 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:54.818945    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:55.001599 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:55.001571    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:56.629982 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:56.629936    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:58.018610 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:24:58.018576    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:00.248639 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:00.248607    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:25:01.691315 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:01.691280    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:02.738630 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:02.738603    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:04.589790 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:04.589754    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:05.203139 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:05.203106    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:05.395358 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:05.395328    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:06.729580 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:06.729549    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:06.925058 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:06.925026    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:07.240050 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:07.240011    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:25:07.987432 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:25:07.987398    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:25:10.513185 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:10.513146    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:11.100745 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:11.100718    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:11.293725 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:11.293694    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:12.077891 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:12.077862    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:17.153532 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:17.153501    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:20.694610 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:20.694575    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:21.944967 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:21.944934    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:22.069436 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.069401    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"]
Oct 30 21:25:22.073129 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.073101    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:22.124861 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.124834    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-be9451\"/\"openshift-service-ca.crt\""
Oct 30 21:25:22.165497 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.165447    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-model-cache\") pod \"simulator-w0-be9451-kserve-669466fb45-fbmb6\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") " pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:22.165611 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.165507    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-dshm\") pod \"simulator-w0-be9451-kserve-669466fb45-fbmb6\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") " pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:22.165611 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.165564    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de5762f3-98dd-4c97-a9f7-a65698c9f271-tls-certs\") pod \"simulator-w0-be9451-kserve-669466fb45-fbmb6\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") " pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:22.165692 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.165614    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-home\") pod \"simulator-w0-be9451-kserve-669466fb45-fbmb6\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") " pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:22.165765 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.165746    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-tmp-dir\") pod \"simulator-w0-be9451-kserve-669466fb45-fbmb6\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") " pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:22.165799 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.165776    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4nrn\" (UniqueName: \"kubernetes.io/projected/de5762f3-98dd-4c97-a9f7-a65698c9f271-kube-api-access-h4nrn\") pod \"simulator-w0-be9451-kserve-669466fb45-fbmb6\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") " pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:22.174153 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.174137    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-be9451\"/\"kube-root-ca.crt\""
Oct 30 21:25:22.174647 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.174631    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-be9451\"/\"default-dockercfg-xpqsf\""
Oct 30 21:25:22.174782 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.174763    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-be9451\"/\"simulator-w0-be9451-kserve-self-signed-certs\""
Oct 30 21:25:22.176327 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.176311    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"]
Oct 30 21:25:22.203240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.203184    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:22.266829 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.266797    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-tmp-dir\") pod \"simulator-w0-be9451-kserve-669466fb45-fbmb6\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") " pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:22.266829 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.266830    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4nrn\" (UniqueName: \"kubernetes.io/projected/de5762f3-98dd-4c97-a9f7-a65698c9f271-kube-api-access-h4nrn\") pod \"simulator-w0-be9451-kserve-669466fb45-fbmb6\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") " pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:22.267045 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.266863    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-model-cache\") pod \"simulator-w0-be9451-kserve-669466fb45-fbmb6\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") " pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:22.267045 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.266882    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-dshm\") pod \"simulator-w0-be9451-kserve-669466fb45-fbmb6\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") " pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:22.267045 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.267002    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de5762f3-98dd-4c97-a9f7-a65698c9f271-tls-certs\") pod \"simulator-w0-be9451-kserve-669466fb45-fbmb6\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") " pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:22.267045 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.267042    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-home\") pod \"simulator-w0-be9451-kserve-669466fb45-fbmb6\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") " pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:22.267234 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.267194    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-tmp-dir\") pod \"simulator-w0-be9451-kserve-669466fb45-fbmb6\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") " pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:22.267291 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.267235    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-model-cache\") pod \"simulator-w0-be9451-kserve-669466fb45-fbmb6\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") " pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:22.267414 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.267384    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-home\") pod \"simulator-w0-be9451-kserve-669466fb45-fbmb6\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") " pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:22.269329 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.269285    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-dshm\") pod \"simulator-w0-be9451-kserve-669466fb45-fbmb6\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") " pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:22.269680 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.269660    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de5762f3-98dd-4c97-a9f7-a65698c9f271-tls-certs\") pod \"simulator-w0-be9451-kserve-669466fb45-fbmb6\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") " pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:22.324561 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.324534    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4nrn\" (UniqueName: \"kubernetes.io/projected/de5762f3-98dd-4c97-a9f7-a65698c9f271-kube-api-access-h4nrn\") pod \"simulator-w0-be9451-kserve-669466fb45-fbmb6\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") " pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:22.384631 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.384602    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:22.601504 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.601413    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:22.767494 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.767437    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"]
Oct 30 21:25:22.770126 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:25:22.770095    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde5762f3_98dd_4c97_a9f7_a65698c9f271.slice/crio-184373fdfcbe45399e3d418e7eaceac732d77b5623452ca3b0756766fbfccc79 WatchSource:0}: Error finding container 184373fdfcbe45399e3d418e7eaceac732d77b5623452ca3b0756766fbfccc79: Status 404 returned error can't find the container with id 184373fdfcbe45399e3d418e7eaceac732d77b5623452ca3b0756766fbfccc79
Oct 30 21:25:22.785103 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.785082    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:22.972277 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:22.972243    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:23.335436 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:23.335364    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6" event={"ID":"de5762f3-98dd-4c97-a9f7-a65698c9f271","Type":"ContainerStarted","Data":"184373fdfcbe45399e3d418e7eaceac732d77b5623452ca3b0756766fbfccc79"}
Oct 30 21:25:25.346259 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:25.346187    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6" event={"ID":"de5762f3-98dd-4c97-a9f7-a65698c9f271","Type":"ContainerStarted","Data":"f1bf4fe9b53dd9f7b937624ce101e6798acf3326da959c95cb02e4ac04ff765e"}
Oct 30 21:25:25.385439 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:25.385419    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:25.428551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:25.428525    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:25.465720 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:25.465680    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6" podStartSLOduration=1.16087731 podStartE2EDuration="3.465665629s" totalImagesPullingTime="2.304788319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:25:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:25:25.465382775 +0000 UTC m=+834.410328135" watchObservedRunningTime="2026-10-30 21:25:25.465665629 +0000 UTC m=+834.410610988"
Oct 30 21:25:26.450762 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:26.450734    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:25:27.761637 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:27.761592    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:30.141176 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:30.141129    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:30.750191 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:30.750160    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:30.937340 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:30.937302    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:31.135864 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:31.135780    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:32.235975 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:32.235941    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:32.384888 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:32.384851    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:32.398074 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:32.398049    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:32.987187 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:32.987131    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:33.391091 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:33.391022    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:25:37.748818 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:37.748787    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:37.986965 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:25:37.986932    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:25:40.027199 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:40.027165    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:25:40.117762 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:40.117709    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:40.741969 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:40.741936    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:40.930958 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:40.930926    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:42.757034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:42.756965    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:47.551715 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:47.551632    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:47.752452 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:47.752423    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:52.255664 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:52.255629    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:54.811083 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:54.811047    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:25:55.436870 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:55.436834    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:55.919041 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:55.919007    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"]
Oct 30 21:25:55.923001 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:55.922983    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:25:55.961362 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:55.961335    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-tmp-dir\") pod \"premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") " pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:25:55.961504 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:55.961371    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-dshm\") pod \"premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") " pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:25:55.961504 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:55.961487    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-model-cache\") pod \"premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") " pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:25:55.961617 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:55.961514    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-home\") pod \"premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") " pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:25:55.961671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:55.961631    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g8kg\" (UniqueName: \"kubernetes.io/projected/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-kube-api-access-7g8kg\") pod \"premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") " pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:25:55.961777 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:55.961759    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-tls-certs\") pod \"premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") " pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:25:55.975156 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:55.975133    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-0a4eab\"/\"openshift-service-ca.crt\""
Oct 30 21:25:56.024442 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:56.024407    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-0a4eab\"/\"default-dockercfg-vkfnk\""
Oct 30 21:25:56.024570 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:56.024479    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-0a4eab\"/\"kube-root-ca.crt\""
Oct 30 21:25:56.024733 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:56.024715    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-0a4eab\"/\"premium-w5-0a4eab-kserve-self-signed-certs\""
Oct 30 21:25:56.026246 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:56.026229    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"]
Oct 30 21:25:56.062375 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:56.062341    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-tmp-dir\") pod \"premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") " pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:25:56.062710 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:56.062676    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-dshm\") pod \"premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") " pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:25:56.062822 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:56.062726    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-model-cache\") pod \"premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") " pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:25:56.062822 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:56.062762    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-home\") pod \"premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") " pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:25:56.062822 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:56.062808    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g8kg\" (UniqueName: \"kubernetes.io/projected/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-kube-api-access-7g8kg\") pod \"premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") " pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:25:56.062989 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:56.062883    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-tls-certs\") pod \"premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") " pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:25:56.062989 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:56.062928    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-tmp-dir\") pod \"premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") " pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:25:56.064298 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:56.064270    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-home\") pod \"premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") " pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:25:56.064298 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:56.064290    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-model-cache\") pod \"premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") " pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:25:56.067875 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:56.067836    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:56.071775 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:56.071748    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-dshm\") pod \"premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") " pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:25:56.072024 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:56.072003    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-tls-certs\") pod \"premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") " pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:25:56.122045 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:56.122017    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g8kg\" (UniqueName: \"kubernetes.io/projected/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-kube-api-access-7g8kg\") pod \"premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") " pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:25:56.235050 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:56.234973    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:25:56.622317 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:56.622293    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"]
Oct 30 21:25:56.624864 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:25:56.624836    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9eadf71_d6c7_400f_9c6f_bea93e8a3750.slice/crio-660f8b22c1072ca0e83f9e05208c1c1df8499e8313b2bc79f7c43f06fd48074f WatchSource:0}: Error finding container 660f8b22c1072ca0e83f9e05208c1c1df8499e8313b2bc79f7c43f06fd48074f: Status 404 returned error can't find the container with id 660f8b22c1072ca0e83f9e05208c1c1df8499e8313b2bc79f7c43f06fd48074f
Oct 30 21:25:57.265595 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:57.265562    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:57.482469 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:57.482437    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n" event={"ID":"d9eadf71-d6c7-400f-9c6f-bea93e8a3750","Type":"ContainerStarted","Data":"0a911e7459a0a1da287b0b804186da6f3a50ea97871fa988c5278387e9f267be"}
Oct 30 21:25:57.482658 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:57.482511    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n" event={"ID":"d9eadf71-d6c7-400f-9c6f-bea93e8a3750","Type":"ContainerStarted","Data":"660f8b22c1072ca0e83f9e05208c1c1df8499e8313b2bc79f7c43f06fd48074f"}
Oct 30 21:25:58.235694 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:25:58.235660    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:26:02.065769 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:02.065729    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:03.744990 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.744933    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n" podStartSLOduration=8.744919988 podStartE2EDuration="8.744919988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:25:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:25:57.596586324 +0000 UTC m=+866.541531684" watchObservedRunningTime="2026-10-30 21:26:03.744919988 +0000 UTC m=+872.689865347"
Oct 30 21:26:03.746689 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.746666    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"]
Oct 30 21:26:03.749989 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.749973    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:03.801894 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.801865    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-847c62\"/\"kube-root-ca.crt\""
Oct 30 21:26:03.823170 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.823146    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-847c62\"/\"openshift-service-ca.crt\""
Oct 30 21:26:03.830691 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.830657    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-tmp-dir\") pod \"simulator-w4-847c62-kserve-79945b54f7-jnwz7\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") " pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:03.830801 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.830711    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-home\") pod \"simulator-w4-847c62-kserve-79945b54f7-jnwz7\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") " pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:03.830884 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.830868    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-dshm\") pod \"simulator-w4-847c62-kserve-79945b54f7-jnwz7\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") " pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:03.830938 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.830920    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj89t\" (UniqueName: \"kubernetes.io/projected/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-kube-api-access-qj89t\") pod \"simulator-w4-847c62-kserve-79945b54f7-jnwz7\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") " pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:03.831068 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.831048    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-model-cache\") pod \"simulator-w4-847c62-kserve-79945b54f7-jnwz7\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") " pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:03.831130 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.831086    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-tls-certs\") pod \"simulator-w4-847c62-kserve-79945b54f7-jnwz7\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") " pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:03.850967 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.850947    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-847c62\"/\"simulator-w4-847c62-kserve-self-signed-certs\""
Oct 30 21:26:03.851155 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.851143    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-847c62\"/\"default-dockercfg-rrwk7\""
Oct 30 21:26:03.852739 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.852720    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"]
Oct 30 21:26:03.877008 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.876989    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:03.932437 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.932393    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-model-cache\") pod \"simulator-w4-847c62-kserve-79945b54f7-jnwz7\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") " pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:03.932437 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.932430    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-tls-certs\") pod \"simulator-w4-847c62-kserve-79945b54f7-jnwz7\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") " pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:03.932718 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.932577    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-tmp-dir\") pod \"simulator-w4-847c62-kserve-79945b54f7-jnwz7\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") " pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:03.932718 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.932618    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-home\") pod \"simulator-w4-847c62-kserve-79945b54f7-jnwz7\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") " pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:03.932718 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.932682    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-dshm\") pod \"simulator-w4-847c62-kserve-79945b54f7-jnwz7\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") " pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:03.932872 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.932728    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj89t\" (UniqueName: \"kubernetes.io/projected/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-kube-api-access-qj89t\") pod \"simulator-w4-847c62-kserve-79945b54f7-jnwz7\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") " pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:03.932931 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.932888    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-model-cache\") pod \"simulator-w4-847c62-kserve-79945b54f7-jnwz7\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") " pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:03.932931 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.932905    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-tmp-dir\") pod \"simulator-w4-847c62-kserve-79945b54f7-jnwz7\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") " pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:03.933032 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.932974    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-home\") pod \"simulator-w4-847c62-kserve-79945b54f7-jnwz7\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") " pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:03.934851 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.934821    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-dshm\") pod \"simulator-w4-847c62-kserve-79945b54f7-jnwz7\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") " pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:03.934989 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.934955    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-tls-certs\") pod \"simulator-w4-847c62-kserve-79945b54f7-jnwz7\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") " pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:03.989571 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:03.989540    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj89t\" (UniqueName: \"kubernetes.io/projected/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-kube-api-access-qj89t\") pod \"simulator-w4-847c62-kserve-79945b54f7-jnwz7\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") " pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:04.061475 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:04.061392    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:04.438530 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:04.438432    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"]
Oct 30 21:26:04.440805 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:26:04.440780    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod504b9039_7a53_4f4d_bf60_20eceb9f6d3c.slice/crio-feda00e5d1e6033a69bd0e87f11d84f109012072d511550824675d2dc57f265a WatchSource:0}: Error finding container feda00e5d1e6033a69bd0e87f11d84f109012072d511550824675d2dc57f265a: Status 404 returned error can't find the container with id feda00e5d1e6033a69bd0e87f11d84f109012072d511550824675d2dc57f265a
Oct 30 21:26:04.520834 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:04.520797    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7" event={"ID":"504b9039-7a53-4f4d-bf60-20eceb9f6d3c","Type":"ContainerStarted","Data":"125f5ee81a409355bd31286820b47dab761a2cc3fd2f89894cae7d40f173c208"}
Oct 30 21:26:04.521001 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:04.520849    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7" event={"ID":"504b9039-7a53-4f4d-bf60-20eceb9f6d3c","Type":"ContainerStarted","Data":"feda00e5d1e6033a69bd0e87f11d84f109012072d511550824675d2dc57f265a"}
Oct 30 21:26:04.635214 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:04.635158    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7" podStartSLOduration=1.6351421579999998 podStartE2EDuration="1.635142158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:26:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:26:04.634197349 +0000 UTC m=+873.579142711" watchObservedRunningTime="2026-10-30 21:26:04.635142158 +0000 UTC m=+873.580087517"
Oct 30 21:26:05.062340 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:05.062305    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:06.029005 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:06.028969    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:06.214639 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:06.214528    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:06.235513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:06.235478    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:26:06.247810 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:06.247787    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:26:06.540531 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:06.540507    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:26:06.780065 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:06.780030    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:07.988339 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:26:07.988305    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:26:10.853048 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:10.853014    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:26:10.980136 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:10.980103    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:11.559404 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:11.559377    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:14.061816 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:14.061778    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:14.073995 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:14.073973    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:14.575533 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:14.575504    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:26:16.251244 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:16.251205    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:20.947019 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:20.946987    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:21.143497 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:21.143445    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:25.652922 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:25.652885    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:26.290269 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:26.290221    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:27.384116 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:27.384085    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:26:30.541370 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:30.541323    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:31.247930 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:31.247905    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:26:31.250777 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:31.250754    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:26:35.255376 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:35.255344    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:37.988181 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:26:37.988140    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:26:40.132669 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.132636    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"]
Oct 30 21:26:40.137417 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.137399    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:40.189539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.189511    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-38b832\"/\"openshift-service-ca.crt\""
Oct 30 21:26:40.239042 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.239011    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-38b832\"/\"default-dockercfg-289hb\""
Oct 30 21:26:40.239042 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.239039    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-38b832\"/\"premium-w2-38b832-kserve-self-signed-certs\""
Oct 30 21:26:40.240134 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.240110    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:40.241140 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.241121    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"]
Oct 30 21:26:40.249937 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.249917    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-home\") pod \"premium-w2-38b832-kserve-544986cd88-bgcld\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") " pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:40.250018 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.249973    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-dshm\") pod \"premium-w2-38b832-kserve-544986cd88-bgcld\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") " pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:40.250077 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.250014    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-model-cache\") pod \"premium-w2-38b832-kserve-544986cd88-bgcld\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") " pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:40.250077 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.250060    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxsgn\" (UniqueName: \"kubernetes.io/projected/afd04a47-10c4-4ccf-879c-c549765a0c50-kube-api-access-xxsgn\") pod \"premium-w2-38b832-kserve-544986cd88-bgcld\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") " pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:40.250394 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.250367    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afd04a47-10c4-4ccf-879c-c549765a0c50-tls-certs\") pod \"premium-w2-38b832-kserve-544986cd88-bgcld\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") " pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:40.251366 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.250973    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-tmp-dir\") pod \"premium-w2-38b832-kserve-544986cd88-bgcld\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") " pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:40.290280 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.290249    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-38b832\"/\"kube-root-ca.crt\""
Oct 30 21:26:40.352947 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.352906    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-tmp-dir\") pod \"premium-w2-38b832-kserve-544986cd88-bgcld\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") " pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:40.353139 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.352966    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-home\") pod \"premium-w2-38b832-kserve-544986cd88-bgcld\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") " pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:40.353139 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.353008    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-dshm\") pod \"premium-w2-38b832-kserve-544986cd88-bgcld\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") " pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:40.353139 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.353030    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-model-cache\") pod \"premium-w2-38b832-kserve-544986cd88-bgcld\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") " pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:40.353139 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.353068    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxsgn\" (UniqueName: \"kubernetes.io/projected/afd04a47-10c4-4ccf-879c-c549765a0c50-kube-api-access-xxsgn\") pod \"premium-w2-38b832-kserve-544986cd88-bgcld\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") " pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:40.353139 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.353136    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afd04a47-10c4-4ccf-879c-c549765a0c50-tls-certs\") pod \"premium-w2-38b832-kserve-544986cd88-bgcld\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") " pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:40.353429 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.353402    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-home\") pod \"premium-w2-38b832-kserve-544986cd88-bgcld\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") " pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:40.353429 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.353419    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-tmp-dir\") pod \"premium-w2-38b832-kserve-544986cd88-bgcld\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") " pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:40.353838 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.353807    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-model-cache\") pod \"premium-w2-38b832-kserve-544986cd88-bgcld\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") " pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:40.355526 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.355495    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-dshm\") pod \"premium-w2-38b832-kserve-544986cd88-bgcld\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") " pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:40.355641 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.355620    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afd04a47-10c4-4ccf-879c-c549765a0c50-tls-certs\") pod \"premium-w2-38b832-kserve-544986cd88-bgcld\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") " pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:40.409790 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.409725    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxsgn\" (UniqueName: \"kubernetes.io/projected/afd04a47-10c4-4ccf-879c-c549765a0c50-kube-api-access-xxsgn\") pod \"premium-w2-38b832-kserve-544986cd88-bgcld\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") " pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:40.430632 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.430610    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:40.450908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.450886    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:40.840008 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:40.839983    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"]
Oct 30 21:26:40.842646 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:26:40.842618    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafd04a47_10c4_4ccf_879c_c549765a0c50.slice/crio-8e28ce88f58ead4656afa144361c50c12a66f7cbb2c74f48bd24d98189776e1a WatchSource:0}: Error finding container 8e28ce88f58ead4656afa144361c50c12a66f7cbb2c74f48bd24d98189776e1a: Status 404 returned error can't find the container with id 8e28ce88f58ead4656afa144361c50c12a66f7cbb2c74f48bd24d98189776e1a
Oct 30 21:26:41.700111 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:41.700077    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld" event={"ID":"afd04a47-10c4-4ccf-879c-c549765a0c50","Type":"ContainerStarted","Data":"fc1fd3c5b2c3e815c38320e738c34ead08dafeaeda96deb1614c62d92dd0ae99"}
Oct 30 21:26:41.700512 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:41.700119    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld" event={"ID":"afd04a47-10c4-4ccf-879c-c549765a0c50","Type":"ContainerStarted","Data":"8e28ce88f58ead4656afa144361c50c12a66f7cbb2c74f48bd24d98189776e1a"}
Oct 30 21:26:41.817096 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:41.817050    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld" podStartSLOduration=1.817036035 podStartE2EDuration="1.817036035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:26:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:26:41.815604323 +0000 UTC m=+910.760549689" watchObservedRunningTime="2026-10-30 21:26:41.817036035 +0000 UTC m=+910.761981395"
Oct 30 21:26:42.452018 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:42.451985    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:44.980539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:44.980508    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:47.324665 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:47.324633    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:26:48.225547 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:48.225517    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:49.773755 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:49.773722    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:50.451361 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:50.451327    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:50.463231 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:50.463206    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:50.751246 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:50.751181    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:26:54.571359 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:54.571322    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:55.572779 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:55.572750    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:59.359790 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:26:59.359754    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:03.582597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.582568    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"]
Oct 30 21:27:03.586047 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.586025    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:03.658071 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.658040    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5870207c-906d-47f0-bb38-ca1020a0dccb-tls-certs\") pod \"premium-w1-8ce31a-kserve-797cddc464-bh6sj\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") " pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:03.658213 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.658107    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-tmp-dir\") pod \"premium-w1-8ce31a-kserve-797cddc464-bh6sj\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") " pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:03.658257 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.658211    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-home\") pod \"premium-w1-8ce31a-kserve-797cddc464-bh6sj\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") " pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:03.658291 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.658255    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk25c\" (UniqueName: \"kubernetes.io/projected/5870207c-906d-47f0-bb38-ca1020a0dccb-kube-api-access-sk25c\") pod \"premium-w1-8ce31a-kserve-797cddc464-bh6sj\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") " pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:03.658396 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.658376    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-model-cache\") pod \"premium-w1-8ce31a-kserve-797cddc464-bh6sj\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") " pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:03.658430 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.658414    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-dshm\") pod \"premium-w1-8ce31a-kserve-797cddc464-bh6sj\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") " pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:03.685314 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.685292    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-8ce31a\"/\"openshift-service-ca.crt\""
Oct 30 21:27:03.687054 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.687036    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-8ce31a\"/\"default-dockercfg-zprht\""
Oct 30 21:27:03.687111 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.687096    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-8ce31a\"/\"premium-w1-8ce31a-kserve-self-signed-certs\""
Oct 30 21:27:03.687147 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.687100    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-8ce31a\"/\"kube-root-ca.crt\""
Oct 30 21:27:03.688800 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.688783    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"]
Oct 30 21:27:03.706612 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.706585    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:03.759264 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.759236    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-model-cache\") pod \"premium-w1-8ce31a-kserve-797cddc464-bh6sj\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") " pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:03.759448 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.759269    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-dshm\") pod \"premium-w1-8ce31a-kserve-797cddc464-bh6sj\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") " pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:03.759448 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.759320    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5870207c-906d-47f0-bb38-ca1020a0dccb-tls-certs\") pod \"premium-w1-8ce31a-kserve-797cddc464-bh6sj\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") " pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:03.759448 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.759358    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-tmp-dir\") pod \"premium-w1-8ce31a-kserve-797cddc464-bh6sj\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") " pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:03.759448 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.759374    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-home\") pod \"premium-w1-8ce31a-kserve-797cddc464-bh6sj\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") " pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:03.759448 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.759392    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk25c\" (UniqueName: \"kubernetes.io/projected/5870207c-906d-47f0-bb38-ca1020a0dccb-kube-api-access-sk25c\") pod \"premium-w1-8ce31a-kserve-797cddc464-bh6sj\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") " pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:03.759730 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.759708    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-model-cache\") pod \"premium-w1-8ce31a-kserve-797cddc464-bh6sj\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") " pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:03.759790 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.759754    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-home\") pod \"premium-w1-8ce31a-kserve-797cddc464-bh6sj\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") " pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:03.759867 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.759844    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-tmp-dir\") pod \"premium-w1-8ce31a-kserve-797cddc464-bh6sj\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") " pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:03.761616 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.761594    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-dshm\") pod \"premium-w1-8ce31a-kserve-797cddc464-bh6sj\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") " pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:03.761783 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.761768    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5870207c-906d-47f0-bb38-ca1020a0dccb-tls-certs\") pod \"premium-w1-8ce31a-kserve-797cddc464-bh6sj\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") " pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:03.815833 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.815805    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk25c\" (UniqueName: \"kubernetes.io/projected/5870207c-906d-47f0-bb38-ca1020a0dccb-kube-api-access-sk25c\") pod \"premium-w1-8ce31a-kserve-797cddc464-bh6sj\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") " pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:03.899269 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:03.899187    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:04.257081 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:04.257046    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:04.287547 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:04.287525    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"]
Oct 30 21:27:04.290173 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:27:04.290145    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5870207c_906d_47f0_bb38_ca1020a0dccb.slice/crio-6de4f00b76faba18524643abcccb1fc2f7d1cdc7f56ab93d0a5d6d996b8a4e74 WatchSource:0}: Error finding container 6de4f00b76faba18524643abcccb1fc2f7d1cdc7f56ab93d0a5d6d996b8a4e74: Status 404 returned error can't find the container with id 6de4f00b76faba18524643abcccb1fc2f7d1cdc7f56ab93d0a5d6d996b8a4e74
Oct 30 21:27:04.804873 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:04.804840    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj" event={"ID":"5870207c-906d-47f0-bb38-ca1020a0dccb","Type":"ContainerStarted","Data":"db7e24e64261b3041d24b3fb70754bef643c65140367c17e37d934b0feface84"}
Oct 30 21:27:04.805232 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:04.804880    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj" event={"ID":"5870207c-906d-47f0-bb38-ca1020a0dccb","Type":"ContainerStarted","Data":"6de4f00b76faba18524643abcccb1fc2f7d1cdc7f56ab93d0a5d6d996b8a4e74"}
Oct 30 21:27:04.899725 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:04.899691    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:04.926039 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:04.925987    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj" podStartSLOduration=1.925973607 podStartE2EDuration="1.925973607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:27:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:04.924036585 +0000 UTC m=+933.868981944" watchObservedRunningTime="2026-10-30 21:27:04.925973607 +0000 UTC m=+933.870918967"
Oct 30 21:27:07.987960 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:27:07.987922    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:27:08.982714 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:08.982675    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:13.858826 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:13.858745    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:13.899776 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:13.899744    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:13.912084 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:13.912063    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:14.858840 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:14.858812    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:27:18.648439 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:18.648389    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:21.182562 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:21.182529    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:21.377311 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:21.377275    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:23.358960 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:23.358928    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:24.660191 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.660157    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"]
Oct 30 21:27:24.663830 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.663811    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:24.750138 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.750108    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-dshm\") pod \"premium-w4-847c62-kserve-6597cd59bd-2zkkk\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") " pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:24.750288 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.750155    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58f59123-9a14-4cd0-8c9e-17448eae2bca-tls-certs\") pod \"premium-w4-847c62-kserve-6597cd59bd-2zkkk\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") " pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:24.750288 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.750190    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-model-cache\") pod \"premium-w4-847c62-kserve-6597cd59bd-2zkkk\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") " pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:24.750364 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.750313    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-tmp-dir\") pod \"premium-w4-847c62-kserve-6597cd59bd-2zkkk\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") " pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:24.750417 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.750405    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh49b\" (UniqueName: \"kubernetes.io/projected/58f59123-9a14-4cd0-8c9e-17448eae2bca-kube-api-access-zh49b\") pod \"premium-w4-847c62-kserve-6597cd59bd-2zkkk\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") " pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:24.750451 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.750443    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-home\") pod \"premium-w4-847c62-kserve-6597cd59bd-2zkkk\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") " pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:24.764552 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.764525    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-847c62\"/\"premium-w4-847c62-kserve-self-signed-certs\""
Oct 30 21:27:24.766334 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.766313    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"]
Oct 30 21:27:24.806662 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.806632    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:24.851549 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.851521    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-model-cache\") pod \"premium-w4-847c62-kserve-6597cd59bd-2zkkk\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") " pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:24.851716 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.851567    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-tmp-dir\") pod \"premium-w4-847c62-kserve-6597cd59bd-2zkkk\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") " pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:24.851716 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.851623    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh49b\" (UniqueName: \"kubernetes.io/projected/58f59123-9a14-4cd0-8c9e-17448eae2bca-kube-api-access-zh49b\") pod \"premium-w4-847c62-kserve-6597cd59bd-2zkkk\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") " pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:24.851716 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.851668    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-home\") pod \"premium-w4-847c62-kserve-6597cd59bd-2zkkk\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") " pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:24.851716 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.851698    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-dshm\") pod \"premium-w4-847c62-kserve-6597cd59bd-2zkkk\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") " pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:24.851917 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.851740    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58f59123-9a14-4cd0-8c9e-17448eae2bca-tls-certs\") pod \"premium-w4-847c62-kserve-6597cd59bd-2zkkk\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") " pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:24.852026 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.851991    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-model-cache\") pod \"premium-w4-847c62-kserve-6597cd59bd-2zkkk\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") " pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:24.852026 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.852004    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-tmp-dir\") pod \"premium-w4-847c62-kserve-6597cd59bd-2zkkk\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") " pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:24.852168 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.852141    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-home\") pod \"premium-w4-847c62-kserve-6597cd59bd-2zkkk\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") " pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:24.854051 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.854024    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-dshm\") pod \"premium-w4-847c62-kserve-6597cd59bd-2zkkk\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") " pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:24.854280 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.854263    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58f59123-9a14-4cd0-8c9e-17448eae2bca-tls-certs\") pod \"premium-w4-847c62-kserve-6597cd59bd-2zkkk\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") " pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:24.908529 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.908496    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh49b\" (UniqueName: \"kubernetes.io/projected/58f59123-9a14-4cd0-8c9e-17448eae2bca-kube-api-access-zh49b\") pod \"premium-w4-847c62-kserve-6597cd59bd-2zkkk\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") " pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:24.975327 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:24.975292    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:25.098503 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:25.098472    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:27:25.366691 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:25.366661    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"]
Oct 30 21:27:25.369121 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:27:25.369096    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58f59123_9a14_4cd0_8c9e_17448eae2bca.slice/crio-48c46335a13822b034cce06001253d34a99279f544e20fbab82c58156667b8f8 WatchSource:0}: Error finding container 48c46335a13822b034cce06001253d34a99279f544e20fbab82c58156667b8f8: Status 404 returned error can't find the container with id 48c46335a13822b034cce06001253d34a99279f544e20fbab82c58156667b8f8
Oct 30 21:27:25.900433 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:25.900397    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk" event={"ID":"58f59123-9a14-4cd0-8c9e-17448eae2bca","Type":"ContainerStarted","Data":"0e325845bb794a6cc9eab62c9b5c18d940af7e848989bfb3d427506b77ebf7e9"}
Oct 30 21:27:25.900828 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:25.900442    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk" event={"ID":"58f59123-9a14-4cd0-8c9e-17448eae2bca","Type":"ContainerStarted","Data":"48c46335a13822b034cce06001253d34a99279f544e20fbab82c58156667b8f8"}
Oct 30 21:27:25.976389 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:25.976360    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:26.014611 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:26.014561    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk" podStartSLOduration=2.014544109 podStartE2EDuration="2.014544109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:27:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:26.01331335 +0000 UTC m=+954.958258708" watchObservedRunningTime="2026-10-30 21:27:26.014544109 +0000 UTC m=+954.959489470"
Oct 30 21:27:28.055439 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:28.055368    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:32.841485 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:32.841427    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:34.975791 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:34.975758    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:34.988059 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:34.988036    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:35.955873 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:35.955844    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:27:37.751028 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:37.750998    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:37.989426 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:27:37.989393    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:27:42.655587 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:42.655553    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:44.736119 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:44.736087    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:47.458650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:47.458605    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:52.156595 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:52.156552    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:56.823077 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:56.823041    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:27:56.955271 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:27:56.955238    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:01.760029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:28:01.759997    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:06.540931 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:28:06.540898    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:07.987558 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:28:07.987516    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:28:11.348172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:28:11.348141    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:16.100042 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:28:16.100007    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:18.333768 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:28:18.333734    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:20.845041 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:28:20.845001    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:21.732443 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:28:21.732411    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:25.652540 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:28:25.652498    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:30.549993 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:28:30.549960    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:33.356747 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:28:33.356711    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:28:35.283118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:28:35.283073    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:37.988076 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:28:37.988037    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:28:40.053835 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:28:40.053802    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:44.840554 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:28:44.840410    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:49.558627 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:28:49.558593    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:54.275556 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:28:54.275483    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:58.961905 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:28:58.961870    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:03.661589 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:03.661556    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:07.988819 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:29:07.988781    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:29:08.341627 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:08.341551    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:13.147410 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:13.147377    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:15.886603 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:15.886565    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:17.848343 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:17.848303    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:29:18.051534 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:18.051500    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:22.051090 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:22.051055    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:22.751902 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:22.751849    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:27.437115 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:27.437082    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:32.191660 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:32.191616    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:36.865670 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:36.865641    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:37.989162 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:29:37.989124    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:29:41.553658 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:41.553618    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:46.353605 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:46.353557    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:51.144821 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:51.144784    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:52.884832 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:52.884799    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"]
Oct 30 21:29:52.888433 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:52.888412    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:52.940628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:52.940596    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-38b832-openshift-default-dockercfg-q7nbg\""
Oct 30 21:29:52.993530 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:52.993496    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"]
Oct 30 21:29:53.026386 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.026338    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2082b08f-ec75-4897-ab22-816004a7a1f4-istiod-ca-cert\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.026559 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.026484    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2mrl\" (UniqueName: \"kubernetes.io/projected/2082b08f-ec75-4897-ab22-816004a7a1f4-kube-api-access-q2mrl\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.026559 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.026532    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-envoy\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.026696 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.026610    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-token\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.026696 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.026647    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-workload-certs\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.026696 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.026686    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-credential-socket\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.026846 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.026735    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-data\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.026846 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.026766    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-workload-socket\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.026944 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.026854    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-podinfo\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.127665 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.127638    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-credential-socket\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.127765 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.127678    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-data\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.127765 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.127707    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-workload-socket\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.127873 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.127770    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-podinfo\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.127873 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.127799    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2082b08f-ec75-4897-ab22-816004a7a1f4-istiod-ca-cert\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.127873 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.127849    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2mrl\" (UniqueName: \"kubernetes.io/projected/2082b08f-ec75-4897-ab22-816004a7a1f4-kube-api-access-q2mrl\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.128005 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.127879    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-envoy\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.128005 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.127928    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-token\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.128005 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.127952    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-workload-certs\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.128626 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.128206    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-credential-socket\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.128626 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.128279    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-workload-certs\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.128738 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.128712    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-data\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.128738 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.128724    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2082b08f-ec75-4897-ab22-816004a7a1f4-istiod-ca-cert\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.128913 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.128893    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-workload-socket\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.130168 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.130146    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-envoy\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.130362 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.130346    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-podinfo\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.186625 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.186595    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-token\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.186751 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.186679    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2mrl\" (UniqueName: \"kubernetes.io/projected/2082b08f-ec75-4897-ab22-816004a7a1f4-kube-api-access-q2mrl\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.192410 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.192390    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"]
Oct 30 21:29:53.196907 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.196889    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.200479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.200441    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:53.248559 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.248509    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-8ce31a-openshift-default-dockercfg-kn28f\""
Oct 30 21:29:53.262058 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.261981    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"]
Oct 30 21:29:53.330043 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.330014    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-podinfo\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.330200 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.330095    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77llj\" (UniqueName: \"kubernetes.io/projected/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-kube-api-access-77llj\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.330200 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.330158    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-envoy\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.330200 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.330193    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istiod-ca-cert\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.330347 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.330215    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-workload-certs\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.330347 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.330232    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-token\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.330347 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.330255    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-data\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.330539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.330421    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-workload-socket\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.330596 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.330543    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-credential-socket\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.431950 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.431917    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77llj\" (UniqueName: \"kubernetes.io/projected/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-kube-api-access-77llj\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.432120 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.431960    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-envoy\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.432120 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.431998    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istiod-ca-cert\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.432120 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.432028    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-workload-certs\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.432120 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.432049    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-token\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.432339 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.432198    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-data\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.432339 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.432256    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-workload-socket\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.432339 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.432335    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-credential-socket\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.432521 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.432387    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-podinfo\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.432521 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.432503    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-workload-certs\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.432700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.432682    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-data\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.432762 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.432728    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-workload-socket\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.432762 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.432749    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-credential-socket\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.432839 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.432822    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istiod-ca-cert\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.434134 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.434114    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-envoy\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.434646 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.434630    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-podinfo\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.487624 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.487568    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-token\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.487837 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.487819    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77llj\" (UniqueName: \"kubernetes.io/projected/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-kube-api-access-77llj\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.515106 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.515081    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:53.632052 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.627075    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"]
Oct 30 21:29:53.635706 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:29:53.635675    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2082b08f_ec75_4897_ab22_816004a7a1f4.slice/crio-f0c7733a561f530f9057dd6a5cfd95fe33e11501465d54a1c93fdde32d63a232 WatchSource:0}: Error finding container f0c7733a561f530f9057dd6a5cfd95fe33e11501465d54a1c93fdde32d63a232: Status 404 returned error can't find the container with id f0c7733a561f530f9057dd6a5cfd95fe33e11501465d54a1c93fdde32d63a232
Oct 30 21:29:53.637998 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.637964    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:29:53.638069 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.638027    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:29:53.638069 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.638055    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:29:53.893613 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.893585    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"]
Oct 30 21:29:53.896072 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:29:53.896045    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee67ec5_b09a_40e1_9438_51a8d0c5f4cc.slice/crio-672b4b6eeae5592558987fb552913c2bde07ee40f6c256ee80c404037adb3370 WatchSource:0}: Error finding container 672b4b6eeae5592558987fb552913c2bde07ee40f6c256ee80c404037adb3370: Status 404 returned error can't find the container with id 672b4b6eeae5592558987fb552913c2bde07ee40f6c256ee80c404037adb3370
Oct 30 21:29:53.898523 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.898489    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:29:53.898605 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.898559    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:29:53.898605 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:53.898587    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:29:54.584753 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:54.584719    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm" event={"ID":"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc","Type":"ContainerStarted","Data":"5788bebae6ee5c3771ece9fbb9bcbcbf6d39adb80abceaf881aa71e825377142"}
Oct 30 21:29:54.584928 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:54.584782    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm" event={"ID":"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc","Type":"ContainerStarted","Data":"672b4b6eeae5592558987fb552913c2bde07ee40f6c256ee80c404037adb3370"}
Oct 30 21:29:54.601486 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:54.599345    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg" event={"ID":"2082b08f-ec75-4897-ab22-816004a7a1f4","Type":"ContainerStarted","Data":"6c889e8a023c4ee32cd761080da65d8d48db831a241dd7b70e0a6271d486d4cb"}
Oct 30 21:29:54.601486 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:54.599427    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg" event={"ID":"2082b08f-ec75-4897-ab22-816004a7a1f4","Type":"ContainerStarted","Data":"f0c7733a561f530f9057dd6a5cfd95fe33e11501465d54a1c93fdde32d63a232"}
Oct 30 21:29:54.710651 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:54.710580    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm" podStartSLOduration=1.710562151 podStartE2EDuration="1.710562151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:29:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:29:54.708813504 +0000 UTC m=+1103.653758864" watchObservedRunningTime="2026-10-30 21:29:54.710562151 +0000 UTC m=+1103.655507514"
Oct 30 21:29:55.229482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:55.222896    4522 patch_prober.go:29] interesting pod/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Oct 30 21:29:55.229482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:55.222978    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg" podUID="2082b08f-ec75-4897-ab22-816004a7a1f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Oct 30 21:29:55.236494 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:55.236368    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:29:55.526538 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:55.525576    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:29:55.531481 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:55.528146    4522 patch_prober.go:29] interesting pod/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Oct 30 21:29:55.531481 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:55.528206    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm" podUID="aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Oct 30 21:29:56.021836 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:56.021767    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:56.205484 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:56.203809    4522 patch_prober.go:29] interesting pod/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Oct 30 21:29:56.205484 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:56.203868    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg" podUID="2082b08f-ec75-4897-ab22-816004a7a1f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Oct 30 21:29:56.519214 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:56.518796    4522 patch_prober.go:29] interesting pod/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Oct 30 21:29:56.519214 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:56.518855    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm" podUID="aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Oct 30 21:29:57.244991 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:57.241583    4522 patch_prober.go:29] interesting pod/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Oct 30 21:29:57.244991 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:57.241644    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg" podUID="2082b08f-ec75-4897-ab22-816004a7a1f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Oct 30 21:29:57.518532 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:57.517826    4522 patch_prober.go:29] interesting pod/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Oct 30 21:29:57.518532 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:57.517887    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm" podUID="aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Oct 30 21:29:58.206483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:58.203824    4522 patch_prober.go:29] interesting pod/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Oct 30 21:29:58.206483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:58.203883    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg" podUID="2082b08f-ec75-4897-ab22-816004a7a1f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Oct 30 21:29:58.521917 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:58.521825    4522 patch_prober.go:29] interesting pod/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Oct 30 21:29:58.522155 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:58.522121    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm" podUID="aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Oct 30 21:29:59.205484 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:59.200951    4522 patch_prober.go:29] interesting pod/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Oct 30 21:29:59.205484 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:59.201023    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg" podUID="2082b08f-ec75-4897-ab22-816004a7a1f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Oct 30 21:29:59.516147 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:59.516042    4522 patch_prober.go:29] interesting pod/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Oct 30 21:29:59.516147 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:29:59.516113    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm" podUID="aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Oct 30 21:30:00.204793 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:00.204761    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:30:00.205156 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:00.205132    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:30:00.205882 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:00.205865    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:30:00.372476 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:00.372410    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg" podStartSLOduration=8.372395202 podStartE2EDuration="8.372395202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:29:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:29:54.82979321 +0000 UTC m=+1103.774738570" watchObservedRunningTime="2026-10-30 21:30:00.372395202 +0000 UTC m=+1109.317340561"
Oct 30 21:30:00.681068 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:00.681037    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:30:00.681594 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:00.681574    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:30:00.682594 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:00.682569    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:30:00.983627 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:00.983535    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:01.852926 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:01.852891    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:30:05.214052 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:05.214016    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:05.762549 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:05.762516    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:07.027843 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.027813    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"]
Oct 30 21:30:07.032783 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.032764    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.078721 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.078694    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"]
Oct 30 21:30:07.078904 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.078884    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw" podUID="594ab7ad-be34-44fd-a637-154a4b44f177" containerName="istio-proxy" containerID="cri-o://e848b63aadec74afb23c1f1a3bb607c098f0bf4e9fde47a51aeb08ce869893e3" gracePeriod=30
Oct 30 21:30:07.125900 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.125871    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-9f52c3-openshift-default-dockercfg-ftmnt\""
Oct 30 21:30:07.137909 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.137840    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"]
Oct 30 21:30:07.197995 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.197946    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-credential-socket\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.198177 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.198017    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-envoy\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.198248 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.198166    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-token\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.198248 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.198215    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-workload-socket\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.198339 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.198258    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-podinfo\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.198393 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.198360    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-workload-certs\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.198454 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.198395    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istiod-ca-cert\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.198454 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.198441    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-data\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.198593 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.198489    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9wwn\" (UniqueName: \"kubernetes.io/projected/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-kube-api-access-m9wwn\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.299946 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.299873    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-credential-socket\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.299946 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.299914    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-envoy\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.300173 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.300007    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-token\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.300173 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.300032    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-workload-socket\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.300173 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.300057    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-podinfo\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.300173 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.300145    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-workload-certs\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.300173 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.300169    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istiod-ca-cert\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.300430 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.300233    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-data\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.300430 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.300261    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9wwn\" (UniqueName: \"kubernetes.io/projected/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-kube-api-access-m9wwn\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.300430 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.300312    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-credential-socket\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.300654 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.300630    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-workload-certs\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.300752 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.300731    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-workload-socket\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.300926 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.300887    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-data\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.301034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.300948    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istiod-ca-cert\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.302652 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.302623    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-envoy\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.302786 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.302768    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-podinfo\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.356801 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.356777    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-token\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.357205 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.357184    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9wwn\" (UniqueName: \"kubernetes.io/projected/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-kube-api-access-m9wwn\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.646058 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.645992    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:07.683867 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.683839    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"]
Oct 30 21:30:07.688536 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.688513    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.740397 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.740369    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-be9451-openshift-default-dockercfg-lwh6g\""
Oct 30 21:30:07.747033 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.747008    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"]
Oct 30 21:30:07.805511 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.805449    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-workload-socket\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.805669 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.805583    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istiod-ca-cert\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.805717 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.805676    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-envoy\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.805717 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.805710    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-token\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.805800 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.805732    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-data\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.805914 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.805891    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-podinfo\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.805962 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.805933    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq2bw\" (UniqueName: \"kubernetes.io/projected/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-kube-api-access-wq2bw\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.806024 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.806010    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-credential-socket\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.806087 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.806073    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-workload-certs\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.906842 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.906789    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istiod-ca-cert\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.906842 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.906831    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-envoy\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.907034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.906859    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-token\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.907034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.906881    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-data\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.907034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.906918    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-podinfo\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.907034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.906937    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq2bw\" (UniqueName: \"kubernetes.io/projected/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-kube-api-access-wq2bw\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.907034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.906970    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-credential-socket\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.907034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.907007    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-workload-certs\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.907334 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.907170    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-workload-socket\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.907334 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.907298    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-data\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.907538 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.907350    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-workload-certs\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.907538 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.907514    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-workload-socket\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.907653 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.907560    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-credential-socket\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.907709 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.907651    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istiod-ca-cert\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.909166 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.909141    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-envoy\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.909259 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.909165    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-podinfo\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.962537 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.962514    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-token\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.962823 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:07.962808    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq2bw\" (UniqueName: \"kubernetes.io/projected/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-kube-api-access-wq2bw\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:07.987588 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:30:07.987563    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:30:08.006866 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:08.006847    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:08.078512 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:08.078446    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"]
Oct 30 21:30:08.081319 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:30:08.081286    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b1659e_bd26_4e4f_a16f_84c9dbc6657a.slice/crio-ac08255a99a13865fa3d40df571bf4ba85988ac1821e7a8b631fc93bc5599d38 WatchSource:0}: Error finding container ac08255a99a13865fa3d40df571bf4ba85988ac1821e7a8b631fc93bc5599d38: Status 404 returned error can't find the container with id ac08255a99a13865fa3d40df571bf4ba85988ac1821e7a8b631fc93bc5599d38
Oct 30 21:30:08.083844 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:08.083809    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:30:08.083944 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:08.083879    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:30:08.083944 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:08.083910    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:30:08.385740 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:08.385714    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"]
Oct 30 21:30:08.388493 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:30:08.388439    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode00a76e2_1fa7_4361_aff4_10aedc28a9fa.slice/crio-e93c6417b1867e0142057a4cfd3738acc415e9a354f5f998bb1667e369ea9600 WatchSource:0}: Error finding container e93c6417b1867e0142057a4cfd3738acc415e9a354f5f998bb1667e369ea9600: Status 404 returned error can't find the container with id e93c6417b1867e0142057a4cfd3738acc415e9a354f5f998bb1667e369ea9600
Oct 30 21:30:08.391675 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:08.391641    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:30:08.391756 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:08.391718    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:30:08.391813 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:08.391760    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:30:08.668570 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:08.668538    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:08.721040 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:08.721009    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn" event={"ID":"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a","Type":"ContainerStarted","Data":"b1cb58543b6e6d4435ce6a9033e5fd1d3185394be81168552f8f92a6e7a0e659"}
Oct 30 21:30:08.721253 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:08.721232    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn" event={"ID":"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a","Type":"ContainerStarted","Data":"ac08255a99a13865fa3d40df571bf4ba85988ac1821e7a8b631fc93bc5599d38"}
Oct 30 21:30:08.723800 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:08.723772    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4" event={"ID":"e00a76e2-1fa7-4361-aff4-10aedc28a9fa","Type":"ContainerStarted","Data":"ecd2d2bfec6ab792166e141fc016ce5a79180a45fa5b6185abff0d8b7a94f5a2"}
Oct 30 21:30:08.723959 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:08.723815    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4" event={"ID":"e00a76e2-1fa7-4361-aff4-10aedc28a9fa","Type":"ContainerStarted","Data":"e93c6417b1867e0142057a4cfd3738acc415e9a354f5f998bb1667e369ea9600"}
Oct 30 21:30:08.841681 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:08.839940    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn" podStartSLOduration=2.839926727 podStartE2EDuration="2.839926727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:30:08.838447199 +0000 UTC m=+1117.783392558" watchObservedRunningTime="2026-10-30 21:30:08.839926727 +0000 UTC m=+1117.784872086"
Oct 30 21:30:08.964531 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:08.960747    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4" podStartSLOduration=1.9607303489999999 podStartE2EDuration="1.960730349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:30:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:30:08.956921567 +0000 UTC m=+1117.901866928" watchObservedRunningTime="2026-10-30 21:30:08.960730349 +0000 UTC m=+1117.905675713"
Oct 30 21:30:09.010960 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:09.010914    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:09.018650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:09.018615    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Oct 30 21:30:09.018976 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:09.018930    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4" podUID="e00a76e2-1fa7-4361-aff4-10aedc28a9fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Oct 30 21:30:09.646390 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:09.646349    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:09.647674 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:09.647651    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Oct 30 21:30:09.647738 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:09.647699    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn" podUID="c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Oct 30 21:30:10.007905 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:10.007867    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Oct 30 21:30:10.008173 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:10.008146    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4" podUID="e00a76e2-1fa7-4361-aff4-10aedc28a9fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Oct 30 21:30:10.646357 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:10.646324    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Oct 30 21:30:10.646566 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:10.646380    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn" podUID="c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Oct 30 21:30:10.749440 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:10.748559    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:11.008483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:11.007880    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Oct 30 21:30:11.008483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:11.007939    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4" podUID="e00a76e2-1fa7-4361-aff4-10aedc28a9fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Oct 30 21:30:11.646424 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:11.646392    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Oct 30 21:30:11.646588 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:11.646439    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn" podUID="c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Oct 30 21:30:11.653958 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:11.653923    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:12.016483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.015820    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Oct 30 21:30:12.016483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.015876    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4" podUID="e00a76e2-1fa7-4361-aff4-10aedc28a9fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Oct 30 21:30:12.464036 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.464014    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:30:12.568242 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.568161    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/594ab7ad-be34-44fd-a637-154a4b44f177-istio-token\" (UniqueName: \"kubernetes.io/projected/594ab7ad-be34-44fd-a637-154a4b44f177-istio-token\") pod \"594ab7ad-be34-44fd-a637-154a4b44f177\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") "
Oct 30 21:30:12.568242 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.568234    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-credential-socket\") pod \"594ab7ad-be34-44fd-a637-154a4b44f177\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") "
Oct 30 21:30:12.568416 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.568268    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-workload-socket\") pod \"594ab7ad-be34-44fd-a637-154a4b44f177\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") "
Oct 30 21:30:12.568416 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.568311    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/594ab7ad-be34-44fd-a637-154a4b44f177-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/594ab7ad-be34-44fd-a637-154a4b44f177-istiod-ca-cert\") pod \"594ab7ad-be34-44fd-a637-154a4b44f177\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") "
Oct 30 21:30:12.568416 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.568396    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/594ab7ad-be34-44fd-a637-154a4b44f177-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/594ab7ad-be34-44fd-a637-154a4b44f177-istio-podinfo\") pod \"594ab7ad-be34-44fd-a637-154a4b44f177\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") "
Oct 30 21:30:12.568539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.568428    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/594ab7ad-be34-44fd-a637-154a4b44f177-kube-api-access-rthxk\" (UniqueName: \"kubernetes.io/projected/594ab7ad-be34-44fd-a637-154a4b44f177-kube-api-access-rthxk\") pod \"594ab7ad-be34-44fd-a637-154a4b44f177\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") "
Oct 30 21:30:12.568539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.568482    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-istio-data\") pod \"594ab7ad-be34-44fd-a637-154a4b44f177\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") "
Oct 30 21:30:12.568603 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.568535    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-workload-certs\") pod \"594ab7ad-be34-44fd-a637-154a4b44f177\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") "
Oct 30 21:30:12.568603 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.568578    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-istio-envoy\") pod \"594ab7ad-be34-44fd-a637-154a4b44f177\" (UID: \"594ab7ad-be34-44fd-a637-154a4b44f177\") "
Oct 30 21:30:12.568663 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.568637    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-workload-socket" pod "594ab7ad-be34-44fd-a637-154a4b44f177" (UID: "594ab7ad-be34-44fd-a637-154a4b44f177"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:30:12.569120 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.568790    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-credential-socket" pod "594ab7ad-be34-44fd-a637-154a4b44f177" (UID: "594ab7ad-be34-44fd-a637-154a4b44f177"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:30:12.569120 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.568950    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:12.569120 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.568967    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:12.569307 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.569212    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/594ab7ad-be34-44fd-a637-154a4b44f177-istiod-ca-cert" pod "594ab7ad-be34-44fd-a637-154a4b44f177" (UID: "594ab7ad-be34-44fd-a637-154a4b44f177"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:30:12.569471 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.569425    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-workload-certs" pod "594ab7ad-be34-44fd-a637-154a4b44f177" (UID: "594ab7ad-be34-44fd-a637-154a4b44f177"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:30:12.569471 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.569441    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-istio-data" pod "594ab7ad-be34-44fd-a637-154a4b44f177" (UID: "594ab7ad-be34-44fd-a637-154a4b44f177"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:30:12.570840 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.570805    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/594ab7ad-be34-44fd-a637-154a4b44f177-istio-token" pod "594ab7ad-be34-44fd-a637-154a4b44f177" (UID: "594ab7ad-be34-44fd-a637-154a4b44f177"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:12.570950 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.570930    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/594ab7ad-be34-44fd-a637-154a4b44f177-kube-api-access-rthxk" pod "594ab7ad-be34-44fd-a637-154a4b44f177" (UID: "594ab7ad-be34-44fd-a637-154a4b44f177"). InnerVolumeSpecName "kube-api-access-rthxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:12.571303 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.571280    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/594ab7ad-be34-44fd-a637-154a4b44f177-istio-podinfo" pod "594ab7ad-be34-44fd-a637-154a4b44f177" (UID: "594ab7ad-be34-44fd-a637-154a4b44f177"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:30:12.571343 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.571313    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-istio-envoy" pod "594ab7ad-be34-44fd-a637-154a4b44f177" (UID: "594ab7ad-be34-44fd-a637-154a4b44f177"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:30:12.647282 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.647246    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Oct 30 21:30:12.647653 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.647304    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn" podUID="c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Oct 30 21:30:12.670194 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.670158    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/594ab7ad-be34-44fd-a637-154a4b44f177-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:12.670324 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.670196    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/594ab7ad-be34-44fd-a637-154a4b44f177-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:12.670324 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.670213    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rthxk\" (UniqueName: \"kubernetes.io/projected/594ab7ad-be34-44fd-a637-154a4b44f177-kube-api-access-rthxk\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:12.670324 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.670228    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:12.670324 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.670242    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:12.670324 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.670255    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/594ab7ad-be34-44fd-a637-154a4b44f177-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:12.670324 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.670268    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/594ab7ad-be34-44fd-a637-154a4b44f177-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:12.762029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.761868    4522 generic.go:356] "Generic (PLEG): container finished" podID="594ab7ad-be34-44fd-a637-154a4b44f177" containerID="e848b63aadec74afb23c1f1a3bb607c098f0bf4e9fde47a51aeb08ce869893e3" exitCode=0
Oct 30 21:30:12.762029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.761909    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"
Oct 30 21:30:12.762029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.761943    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw" event={"ID":"594ab7ad-be34-44fd-a637-154a4b44f177","Type":"ContainerDied","Data":"e848b63aadec74afb23c1f1a3bb607c098f0bf4e9fde47a51aeb08ce869893e3"}
Oct 30 21:30:12.762029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.762003    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw" event={"ID":"594ab7ad-be34-44fd-a637-154a4b44f177","Type":"ContainerDied","Data":"8d985e14e8c490bed10b288f82ed813cf9d5d1126beafcc4db2dd33e1be80891"}
Oct 30 21:30:12.762029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.762036    4522 scope.go:122] "RemoveContainer" containerID="e848b63aadec74afb23c1f1a3bb607c098f0bf4e9fde47a51aeb08ce869893e3"
Oct 30 21:30:12.773599 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.773581    4522 scope.go:122] "RemoveContainer" containerID="e848b63aadec74afb23c1f1a3bb607c098f0bf4e9fde47a51aeb08ce869893e3"
Oct 30 21:30:12.773916 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:30:12.773895    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e848b63aadec74afb23c1f1a3bb607c098f0bf4e9fde47a51aeb08ce869893e3\": container with ID starting with e848b63aadec74afb23c1f1a3bb607c098f0bf4e9fde47a51aeb08ce869893e3 not found: ID does not exist" containerID="e848b63aadec74afb23c1f1a3bb607c098f0bf4e9fde47a51aeb08ce869893e3"
Oct 30 21:30:12.774003 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.773922    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e848b63aadec74afb23c1f1a3bb607c098f0bf4e9fde47a51aeb08ce869893e3"} err="failed to get container status \"e848b63aadec74afb23c1f1a3bb607c098f0bf4e9fde47a51aeb08ce869893e3\": rpc error: code = NotFound desc = could not find container \"e848b63aadec74afb23c1f1a3bb607c098f0bf4e9fde47a51aeb08ce869893e3\": container with ID starting with e848b63aadec74afb23c1f1a3bb607c098f0bf4e9fde47a51aeb08ce869893e3 not found: ID does not exist"
Oct 30 21:30:12.935498 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.931036    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"]
Oct 30 21:30:12.938301 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:12.938273    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5w8gw"]
Oct 30 21:30:13.007880 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:13.007842    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Oct 30 21:30:13.008144 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:13.008118    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4" podUID="e00a76e2-1fa7-4361-aff4-10aedc28a9fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Oct 30 21:30:13.232533 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:13.223373    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="594ab7ad-be34-44fd-a637-154a4b44f177" path="/var/lib/kubelet/pods/594ab7ad-be34-44fd-a637-154a4b44f177/volumes"
Oct 30 21:30:13.647240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:13.647127    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Oct 30 21:30:13.647240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:13.647181    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn" podUID="c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Oct 30 21:30:14.012248 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:14.011868    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Oct 30 21:30:14.012248 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:14.011937    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4" podUID="e00a76e2-1fa7-4361-aff4-10aedc28a9fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Oct 30 21:30:14.658249 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:14.658207    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:14.658781 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:14.658687    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:14.659684 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:14.659663    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:30:15.078116 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:15.078081    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:15.078598 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:15.078480    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:15.079384 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:15.079363    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:30:15.656031 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:15.655997    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:19.881886 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:19.881858    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:20.501004 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:20.500966    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:22.421589 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:22.421548    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:25.102303 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:25.102275    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:29.969672 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:29.969631    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:32.875280 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:32.875247    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:30:34.691369 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:34.691331    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:35.538492 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:35.538440    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:37.987916 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:30:37.987882    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:30:39.513731 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:39.513694    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:44.139811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:44.139772    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:48.850782 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:48.850738    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:50.412185 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:50.412154    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:52.691729 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.691693    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"]
Oct 30 21:30:52.692109 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.692080    4522 cpu_manager.go:414] "containerMap: removing container" podUID="594ab7ad-be34-44fd-a637-154a4b44f177" containerName="istio-proxy"
Oct 30 21:30:52.692109 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.692091    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="594ab7ad-be34-44fd-a637-154a4b44f177" containerName="istio-proxy"
Oct 30 21:30:52.692184 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.692169    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="594ab7ad-be34-44fd-a637-154a4b44f177" containerName="istio-proxy"
Oct 30 21:30:52.695222 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.695207    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.747139 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.747114    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-0a4eab-openshift-default-dockercfg-f7j2g\""
Oct 30 21:30:52.798401 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.798371    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"]
Oct 30 21:30:52.802592 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.802565    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-workload-certs\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.802714 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.802633    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-envoy\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.802714 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.802685    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-workload-socket\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.802831 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.802765    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-token\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.802831 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.802815    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-podinfo\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.802922 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.802853    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-credential-socket\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.803019 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.802996    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istiod-ca-cert\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.803079 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.803058    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wrxr\" (UniqueName: \"kubernetes.io/projected/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-kube-api-access-9wrxr\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.803147 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.803134    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-data\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.903861 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.903832    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-data\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.904030 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.903882    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-workload-certs\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.904030 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.903926    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-envoy\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.904030 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.903943    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-workload-socket\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.904030 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.903963    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-token\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.904030 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.903990    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-podinfo\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.904030 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.904022    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-credential-socket\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.904312 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.904107    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istiod-ca-cert\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.904312 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.904133    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wrxr\" (UniqueName: \"kubernetes.io/projected/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-kube-api-access-9wrxr\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.904574 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.904545    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-data\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.904702 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.904586    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-workload-socket\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.904702 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.904631    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-workload-certs\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.904702 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.904665    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-credential-socket\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.905061 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.905036    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istiod-ca-cert\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.906249 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.906225    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-envoy\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.906515 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.906496    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-podinfo\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.960121 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.960067    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wrxr\" (UniqueName: \"kubernetes.io/projected/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-kube-api-access-9wrxr\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:52.960121 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:52.960072    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-token\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:53.007187 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:53.007160    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:53.432069 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:53.431985    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"]
Oct 30 21:30:53.434366 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:30:53.434339    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d82e144_f9a4_4729_9ed3_7f09e0cd09fa.slice/crio-790d5bc635e4f2776549f6a26c5782eb46c878dfd980f6ee39f0193f03a07b9e WatchSource:0}: Error finding container 790d5bc635e4f2776549f6a26c5782eb46c878dfd980f6ee39f0193f03a07b9e: Status 404 returned error can't find the container with id 790d5bc635e4f2776549f6a26c5782eb46c878dfd980f6ee39f0193f03a07b9e
Oct 30 21:30:53.436530 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:53.436498    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:30:53.436594 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:53.436567    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:30:53.436626 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:53.436597    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:30:53.557655 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:53.556316    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:53.963987 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:53.963951    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g" event={"ID":"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa","Type":"ContainerStarted","Data":"934e290127161ffdaa99db5ca618eb7079156394f094bf4d078233722aa58271"}
Oct 30 21:30:53.964500 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:53.964009    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g" event={"ID":"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa","Type":"ContainerStarted","Data":"790d5bc635e4f2776549f6a26c5782eb46c878dfd980f6ee39f0193f03a07b9e"}
Oct 30 21:30:54.010642 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:54.010585    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:30:54.012387 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:54.012355    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 30 21:30:54.012554 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:54.012415    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g" podUID="2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 30 21:30:54.082785 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:54.082731    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g" podStartSLOduration=2.082715907 podStartE2EDuration="2.082715907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:30:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:30:54.080756222 +0000 UTC m=+1163.025701584" watchObservedRunningTime="2026-10-30 21:30:54.082715907 +0000 UTC m=+1163.027661266"
Oct 30 21:30:55.010955 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:55.010915    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 30 21:30:55.011337 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:55.010987    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g" podUID="2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 30 21:30:56.007841 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:56.007806    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 30 21:30:56.008273 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:56.008244    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g" podUID="2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 30 21:30:57.010897 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:57.010867    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 30 21:30:57.011304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:57.010920    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g" podUID="2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 30 21:30:58.010826 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:58.010792    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 30 21:30:58.010996 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:58.010841    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g" podUID="2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 30 21:30:58.382003 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:58.381913    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:58.804483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:58.804047    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:30:59.011038 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:59.011006    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 30 21:30:59.011556 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:30:59.011068    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g" podUID="2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 30 21:31:00.012569 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:00.012539    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:31:00.012945 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:00.012900    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:31:00.013700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:00.013681    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:31:01.201256 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:01.201213    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:03.170114 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:03.170073    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:07.965739 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:07.965710    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:07.991008 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:31:07.990972    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:31:12.651751 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:12.651717    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:14.988422 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:14.988391    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:17.368731 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:17.368685    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:20.551015 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:20.550969    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:22.170409 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:22.170375    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:22.728418 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:22.728388    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:26.828622 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:26.828582    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:31.281215 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:31.281188    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:31:31.283697 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:31.283675    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:31:31.532164 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:31.532085    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:36.273489 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:36.273392    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:37.034784 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:37.034751    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:31:37.989964 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:31:37.989892    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:31:41.104878 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:41.104838    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:45.858846 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:45.858769    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:50.598817 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:50.598770    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:54.180150 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.180118    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"]
Oct 30 21:31:54.183797 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.183777    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.245925 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.245896    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-workload-socket\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.246037 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.245940    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c332502d-bb95-46fb-abfa-a8f25dcf6932-istiod-ca-cert\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.246037 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.246026    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-workload-certs\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.246134 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.246044    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-credential-socket\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.246134 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.246071    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-data\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.246228 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.246188    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-envoy\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.246228 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.246216    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-podinfo\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.246317 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.246299    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjhp5\" (UniqueName: \"kubernetes.io/projected/c332502d-bb95-46fb-abfa-a8f25dcf6932-kube-api-access-fjhp5\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.246366 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.246326    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-token\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.276934 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.276907    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"]
Oct 30 21:31:54.347643 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.347617    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjhp5\" (UniqueName: \"kubernetes.io/projected/c332502d-bb95-46fb-abfa-a8f25dcf6932-kube-api-access-fjhp5\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.347766 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.347651    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-token\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.347766 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.347732    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-workload-socket\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.347933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.347774    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c332502d-bb95-46fb-abfa-a8f25dcf6932-istiod-ca-cert\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.347933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.347818    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-workload-certs\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.347933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.347845    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-credential-socket\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.347933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.347884    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-data\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.347933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.347922    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-envoy\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.348180 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.347949    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-podinfo\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.348234 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.348219    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-workload-socket\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.348445 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.348417    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-workload-certs\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.348574 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.348517    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-data\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.348574 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.348541    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-credential-socket\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.348715 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.348687    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c332502d-bb95-46fb-abfa-a8f25dcf6932-istiod-ca-cert\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.350342 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.350315    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-envoy\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.350430 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.350351    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-podinfo\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.404606 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.404576    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-token\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.404789 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.404771    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjhp5\" (UniqueName: \"kubernetes.io/projected/c332502d-bb95-46fb-abfa-a8f25dcf6932-kube-api-access-fjhp5\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.496340 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.496289    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:54.923082 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.923056    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"]
Oct 30 21:31:54.925871 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:31:54.925844    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc332502d_bb95_46fb_abfa_a8f25dcf6932.slice/crio-78aa6d2f0405c69745c87c2daac4cbf046eed55de403ce7b32afccd190c8e932 WatchSource:0}: Error finding container 78aa6d2f0405c69745c87c2daac4cbf046eed55de403ce7b32afccd190c8e932: Status 404 returned error can't find the container with id 78aa6d2f0405c69745c87c2daac4cbf046eed55de403ce7b32afccd190c8e932
Oct 30 21:31:54.928188 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.928151    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:31:54.928270 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.928219    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:31:54.928270 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:54.928249    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:31:55.273078 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.272986    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:55.276874 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.276830    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz" event={"ID":"c332502d-bb95-46fb-abfa-a8f25dcf6932","Type":"ContainerStarted","Data":"7ab959d6cc5b7c7c3b314fdffa0f8f30dd9de97037a3c0b4b51e096876b620c2"}
Oct 30 21:31:55.277007 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.276896    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz" event={"ID":"c332502d-bb95-46fb-abfa-a8f25dcf6932","Type":"ContainerStarted","Data":"78aa6d2f0405c69745c87c2daac4cbf046eed55de403ce7b32afccd190c8e932"}
Oct 30 21:31:55.395509 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.395439    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz" podStartSLOduration=1.395424398 podStartE2EDuration="1.395424398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:31:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:31:55.393276472 +0000 UTC m=+1224.338221831" watchObservedRunningTime="2026-10-30 21:31:55.395424398 +0000 UTC m=+1224.340369756"
Oct 30 21:31:55.503664 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.503609    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:31:55.504637 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.504604    4522 patch_prober.go:29] interesting pod/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Oct 30 21:31:55.504788 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.504676    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz" podUID="c332502d-bb95-46fb-abfa-a8f25dcf6932" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Oct 30 21:31:55.640425 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.640331    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"]
Oct 30 21:31:55.644204 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.644181    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:55.664854 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.664831    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-tmp-dir\") pod \"distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") " pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:55.664975 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.664922    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-model-cache\") pod \"distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") " pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:55.665015 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.664997    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-home\") pod \"distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") " pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:55.665070 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.665059    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-dshm\") pod \"distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") " pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:55.665114 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.665081    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/336f0a2d-1023-411d-9ff4-33dad5c413d5-tls-certs\") pod \"distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") " pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:55.665166 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.665145    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gsc4\" (UniqueName: \"kubernetes.io/projected/336f0a2d-1023-411d-9ff4-33dad5c413d5-kube-api-access-2gsc4\") pod \"distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") " pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:55.717110 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.716716    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-9ac5c5\"/\"default-dockercfg-8tlqp\""
Oct 30 21:31:55.717110 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.716821    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"]
Oct 30 21:31:55.717110 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.716901    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-9ac5c5\"/\"distinct-2-w6-9ac5c5-kserve-self-signed-certs\""
Oct 30 21:31:55.717110 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.716935    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-9ac5c5\"/\"openshift-service-ca.crt\""
Oct 30 21:31:55.717110 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.716998    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-9ac5c5\"/\"kube-root-ca.crt\""
Oct 30 21:31:55.766138 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.766096    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-model-cache\") pod \"distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") " pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:55.766302 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.766226    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-home\") pod \"distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") " pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:55.766302 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.766278    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-dshm\") pod \"distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") " pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:55.766415 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.766306    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/336f0a2d-1023-411d-9ff4-33dad5c413d5-tls-certs\") pod \"distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") " pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:55.766415 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.766350    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gsc4\" (UniqueName: \"kubernetes.io/projected/336f0a2d-1023-411d-9ff4-33dad5c413d5-kube-api-access-2gsc4\") pod \"distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") " pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:55.766533 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.766438    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-tmp-dir\") pod \"distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") " pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:55.766593 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.766579    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-home\") pod \"distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") " pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:55.766649 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.766590    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-model-cache\") pod \"distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") " pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:55.766780 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.766760    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-tmp-dir\") pod \"distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") " pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:55.768500 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.768476    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-dshm\") pod \"distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") " pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:55.768796 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.768778    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/336f0a2d-1023-411d-9ff4-33dad5c413d5-tls-certs\") pod \"distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") " pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:55.820496 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.817621    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:55.830489 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.830359    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gsc4\" (UniqueName: \"kubernetes.io/projected/336f0a2d-1023-411d-9ff4-33dad5c413d5-kube-api-access-2gsc4\") pod \"distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") " pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:55.957152 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:55.957118    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:56.408527 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:56.396117    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"]
Oct 30 21:31:56.415654 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:31:56.415604    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod336f0a2d_1023_411d_9ff4_33dad5c413d5.slice/crio-dba867410fbf72a9beaaed5082dd352fce1f01eb0dd86a5156a79fff7b32867c WatchSource:0}: Error finding container dba867410fbf72a9beaaed5082dd352fce1f01eb0dd86a5156a79fff7b32867c: Status 404 returned error can't find the container with id dba867410fbf72a9beaaed5082dd352fce1f01eb0dd86a5156a79fff7b32867c
Oct 30 21:31:56.504630 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:56.500785    4522 patch_prober.go:29] interesting pod/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Oct 30 21:31:56.504630 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:56.500832    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz" podUID="c332502d-bb95-46fb-abfa-a8f25dcf6932" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Oct 30 21:31:57.312648 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:57.312612    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5" event={"ID":"336f0a2d-1023-411d-9ff4-33dad5c413d5","Type":"ContainerStarted","Data":"fc1a8e5bfb6f93352746d8f9c4b249c4c5a50c395294221f4331efd401a4826d"}
Oct 30 21:31:57.312840 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:57.312660    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5" event={"ID":"336f0a2d-1023-411d-9ff4-33dad5c413d5","Type":"ContainerStarted","Data":"dba867410fbf72a9beaaed5082dd352fce1f01eb0dd86a5156a79fff7b32867c"}
Oct 30 21:31:57.427272 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:57.427221    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5" podStartSLOduration=2.427208651 podStartE2EDuration="2.427208651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:31:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:31:57.425517196 +0000 UTC m=+1226.370462557" watchObservedRunningTime="2026-10-30 21:31:57.427208651 +0000 UTC m=+1226.372154045"
Oct 30 21:31:57.510499 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:57.507833    4522 patch_prober.go:29] interesting pod/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Oct 30 21:31:57.510499 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:57.507888    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz" podUID="c332502d-bb95-46fb-abfa-a8f25dcf6932" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Oct 30 21:31:57.957693 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:57.957659    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:31:58.506489 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:58.503863    4522 patch_prober.go:29] interesting pod/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Oct 30 21:31:58.506489 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:58.503942    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz" podUID="c332502d-bb95-46fb-abfa-a8f25dcf6932" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Oct 30 21:31:59.322950 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:59.322913    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:59.499849 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:59.499810    4522 patch_prober.go:29] interesting pod/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Oct 30 21:31:59.500123 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:59.500094    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz" podUID="c332502d-bb95-46fb-abfa-a8f25dcf6932" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Oct 30 21:31:59.519774 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:59.519741    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:59.718152 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:31:59.718124    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:00.297481 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:00.289867    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:00.510485 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:00.497757    4522 patch_prober.go:29] interesting pod/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Oct 30 21:32:00.510485 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:00.497814    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz" podUID="c332502d-bb95-46fb-abfa-a8f25dcf6932" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Oct 30 21:32:01.496751 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:01.496714    4522 patch_prober.go:29] interesting pod/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Oct 30 21:32:01.497111 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:01.496776    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz" podUID="c332502d-bb95-46fb-abfa-a8f25dcf6932" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Oct 30 21:32:02.500759 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:02.500730    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:32:02.501113 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:02.501054    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:32:02.501825 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:02.501808    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:32:04.953994 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:04.953953    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:05.957501 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:05.957472    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:32:05.969289 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:05.969267    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:32:06.366880 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:06.366802    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:32:07.987266 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:32:07.987228    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:32:08.018839 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:08.018813    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"]
Oct 30 21:32:08.019017 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:08.018999    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k" podUID="f5cce060-d1b6-48b1-8ede-5414e089961e" containerName="istio-proxy" containerID="cri-o://790687fa85cc97ad2ccb55a65d09b2cb957cbe56ebca6181552b9de4ce05772d" gracePeriod=30
Oct 30 21:32:09.656550 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:09.656516    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:11.564055 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:11.564027    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:12.306557 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:12.306524    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:12.766650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:12.766617    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-g7k4k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:32:12.767015 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:12.766667    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k" podUID="f5cce060-d1b6-48b1-8ede-5414e089961e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:32:13.285657 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.285600    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:32:13.367667 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.367639    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-credential-socket\") pod \"f5cce060-d1b6-48b1-8ede-5414e089961e\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") "
Oct 30 21:32:13.367811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.367675    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f5cce060-d1b6-48b1-8ede-5414e089961e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5cce060-d1b6-48b1-8ede-5414e089961e-istiod-ca-cert\") pod \"f5cce060-d1b6-48b1-8ede-5414e089961e\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") "
Oct 30 21:32:13.367811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.367695    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-data\") pod \"f5cce060-d1b6-48b1-8ede-5414e089961e\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") "
Oct 30 21:32:13.367811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.367740    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-podinfo\") pod \"f5cce060-d1b6-48b1-8ede-5414e089961e\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") "
Oct 30 21:32:13.367811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.367774    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5cce060-d1b6-48b1-8ede-5414e089961e-kube-api-access-whvtz\" (UniqueName: \"kubernetes.io/projected/f5cce060-d1b6-48b1-8ede-5414e089961e-kube-api-access-whvtz\") pod \"f5cce060-d1b6-48b1-8ede-5414e089961e\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") "
Oct 30 21:32:13.367811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.367804    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-envoy\") pod \"f5cce060-d1b6-48b1-8ede-5414e089961e\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") "
Oct 30 21:32:13.368092 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.367936    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-credential-socket" pod "f5cce060-d1b6-48b1-8ede-5414e089961e" (UID: "f5cce060-d1b6-48b1-8ede-5414e089961e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:32:13.368092 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.367996    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-workload-certs\") pod \"f5cce060-d1b6-48b1-8ede-5414e089961e\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") "
Oct 30 21:32:13.368092 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.368077    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-workload-socket\") pod \"f5cce060-d1b6-48b1-8ede-5414e089961e\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") "
Oct 30 21:32:13.368247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.368126    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-data" pod "f5cce060-d1b6-48b1-8ede-5414e089961e" (UID: "f5cce060-d1b6-48b1-8ede-5414e089961e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:32:13.368247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.368137    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-token\" (UniqueName: \"kubernetes.io/projected/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-token\") pod \"f5cce060-d1b6-48b1-8ede-5414e089961e\" (UID: \"f5cce060-d1b6-48b1-8ede-5414e089961e\") "
Oct 30 21:32:13.368247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.368143    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5cce060-d1b6-48b1-8ede-5414e089961e-istiod-ca-cert" pod "f5cce060-d1b6-48b1-8ede-5414e089961e" (UID: "f5cce060-d1b6-48b1-8ede-5414e089961e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:32:13.368247 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.368224    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-workload-certs" pod "f5cce060-d1b6-48b1-8ede-5414e089961e" (UID: "f5cce060-d1b6-48b1-8ede-5414e089961e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:32:13.368431 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.368345    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-workload-socket" pod "f5cce060-d1b6-48b1-8ede-5414e089961e" (UID: "f5cce060-d1b6-48b1-8ede-5414e089961e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:32:13.368690 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.368664    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:13.368813 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.368694    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:13.368813 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.368709    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:13.368813 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.368724    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5cce060-d1b6-48b1-8ede-5414e089961e-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:13.368813 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.368737    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:13.369962 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.369935    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-envoy" pod "f5cce060-d1b6-48b1-8ede-5414e089961e" (UID: "f5cce060-d1b6-48b1-8ede-5414e089961e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:32:13.370048 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.370020    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5cce060-d1b6-48b1-8ede-5414e089961e-kube-api-access-whvtz" pod "f5cce060-d1b6-48b1-8ede-5414e089961e" (UID: "f5cce060-d1b6-48b1-8ede-5414e089961e"). InnerVolumeSpecName "kube-api-access-whvtz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:32:13.370142 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.370129    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-token" pod "f5cce060-d1b6-48b1-8ede-5414e089961e" (UID: "f5cce060-d1b6-48b1-8ede-5414e089961e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:32:13.370995 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.370973    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-podinfo" pod "f5cce060-d1b6-48b1-8ede-5414e089961e" (UID: "f5cce060-d1b6-48b1-8ede-5414e089961e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:32:13.391595 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.391573    4522 generic.go:356] "Generic (PLEG): container finished" podID="f5cce060-d1b6-48b1-8ede-5414e089961e" containerID="790687fa85cc97ad2ccb55a65d09b2cb957cbe56ebca6181552b9de4ce05772d" exitCode=0
Oct 30 21:32:13.391679 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.391607    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k" event={"ID":"f5cce060-d1b6-48b1-8ede-5414e089961e","Type":"ContainerDied","Data":"790687fa85cc97ad2ccb55a65d09b2cb957cbe56ebca6181552b9de4ce05772d"}
Oct 30 21:32:13.391679 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.391639    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"
Oct 30 21:32:13.391745 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.391678    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k" event={"ID":"f5cce060-d1b6-48b1-8ede-5414e089961e","Type":"ContainerDied","Data":"bfe858e7b87d6cdb84668f808ffc5f4ab4bd42bad443f50447e4ade967f1028b"}
Oct 30 21:32:13.391745 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.391699    4522 scope.go:122] "RemoveContainer" containerID="790687fa85cc97ad2ccb55a65d09b2cb957cbe56ebca6181552b9de4ce05772d"
Oct 30 21:32:13.404270 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.404245    4522 scope.go:122] "RemoveContainer" containerID="790687fa85cc97ad2ccb55a65d09b2cb957cbe56ebca6181552b9de4ce05772d"
Oct 30 21:32:13.404553 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:32:13.404535    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"790687fa85cc97ad2ccb55a65d09b2cb957cbe56ebca6181552b9de4ce05772d\": container with ID starting with 790687fa85cc97ad2ccb55a65d09b2cb957cbe56ebca6181552b9de4ce05772d not found: ID does not exist" containerID="790687fa85cc97ad2ccb55a65d09b2cb957cbe56ebca6181552b9de4ce05772d"
Oct 30 21:32:13.404604 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.404560    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"790687fa85cc97ad2ccb55a65d09b2cb957cbe56ebca6181552b9de4ce05772d"} err="failed to get container status \"790687fa85cc97ad2ccb55a65d09b2cb957cbe56ebca6181552b9de4ce05772d\": rpc error: code = NotFound desc = could not find container \"790687fa85cc97ad2ccb55a65d09b2cb957cbe56ebca6181552b9de4ce05772d\": container with ID starting with 790687fa85cc97ad2ccb55a65d09b2cb957cbe56ebca6181552b9de4ce05772d not found: ID does not exist"
Oct 30 21:32:13.470536 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.470506    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whvtz\" (UniqueName: \"kubernetes.io/projected/f5cce060-d1b6-48b1-8ede-5414e089961e-kube-api-access-whvtz\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:13.470536 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.470536    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:13.470656 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.470552    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:13.470656 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.470565    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5cce060-d1b6-48b1-8ede-5414e089961e-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:13.567599 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.567488    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"]
Oct 30 21:32:13.571017 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:13.570993    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-g7k4k"]
Oct 30 21:32:14.575598 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:14.575566    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:15.191206 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:15.191166    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f5cce060-d1b6-48b1-8ede-5414e089961e" path="/var/lib/kubelet/pods/f5cce060-d1b6-48b1-8ede-5414e089961e/volumes"
Oct 30 21:32:18.491381 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:18.491348    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:32:19.096632 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:19.096596    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:19.285376 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:19.285347    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:19.498425 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:19.498393    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:23.080665 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:23.080629    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:23.920374 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:23.920338    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"]
Oct 30 21:32:23.920771 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:23.920758    4522 cpu_manager.go:414] "containerMap: removing container" podUID="f5cce060-d1b6-48b1-8ede-5414e089961e" containerName="istio-proxy"
Oct 30 21:32:23.920823 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:23.920772    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f5cce060-d1b6-48b1-8ede-5414e089961e" containerName="istio-proxy"
Oct 30 21:32:23.920866 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:23.920857    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="f5cce060-d1b6-48b1-8ede-5414e089961e" containerName="istio-proxy"
Oct 30 21:32:23.923837 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:23.923818    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:24.024470 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.024424    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-be9451\"/\"distinct-2-w0-be9451-kserve-self-signed-certs\""
Oct 30 21:32:24.026687 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.026662    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"]
Oct 30 21:32:24.069154 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.069125    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:24.080353 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.080329    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-dshm\") pod \"distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") " pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:24.080479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.080364    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-model-cache\") pod \"distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") " pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:24.080540 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.080517    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-home\") pod \"distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") " pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:24.080638 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.080625    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4f4d580-1397-4f98-b232-d803802890f8-tls-certs\") pod \"distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") " pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:24.080681 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.080648    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-tmp-dir\") pod \"distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") " pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:24.080681 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.080664    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t5zz\" (UniqueName: \"kubernetes.io/projected/a4f4d580-1397-4f98-b232-d803802890f8-kube-api-access-2t5zz\") pod \"distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") " pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:24.181654 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.181583    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4f4d580-1397-4f98-b232-d803802890f8-tls-certs\") pod \"distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") " pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:24.181654 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.181617    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-tmp-dir\") pod \"distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") " pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:24.181654 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.181637    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t5zz\" (UniqueName: \"kubernetes.io/projected/a4f4d580-1397-4f98-b232-d803802890f8-kube-api-access-2t5zz\") pod \"distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") " pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:24.181935 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.181668    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-dshm\") pod \"distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") " pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:24.181935 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.181698    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-model-cache\") pod \"distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") " pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:24.181935 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.181786    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-home\") pod \"distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") " pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:24.182118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.182071    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-tmp-dir\") pod \"distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") " pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:24.182186 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.182139    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-model-cache\") pod \"distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") " pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:24.182243 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.182201    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-home\") pod \"distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") " pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:24.184198 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.184174    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-dshm\") pod \"distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") " pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:24.184567 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.184544    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4f4d580-1397-4f98-b232-d803802890f8-tls-certs\") pod \"distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") " pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:24.237841 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.237808    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t5zz\" (UniqueName: \"kubernetes.io/projected/a4f4d580-1397-4f98-b232-d803802890f8-kube-api-access-2t5zz\") pod \"distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") " pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:24.267380 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.267351    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:24.535850 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.535769    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:24.906498 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:24.906393    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"]
Oct 30 21:32:24.909343 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:32:24.909320    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4f4d580_1397_4f98_b232_d803802890f8.slice/crio-216cdb289d845574d7e57c59d6af289b354e939d4d869696b922f7b8b29f7f85 WatchSource:0}: Error finding container 216cdb289d845574d7e57c59d6af289b354e939d4d869696b922f7b8b29f7f85: Status 404 returned error can't find the container with id 216cdb289d845574d7e57c59d6af289b354e939d4d869696b922f7b8b29f7f85
Oct 30 21:32:25.451762 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:25.451728    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn" event={"ID":"a4f4d580-1397-4f98-b232-d803802890f8","Type":"ContainerStarted","Data":"98443958deba0d730ba7be6f54ee139ab4710eb9c2805af3f70cdaad28a15403"}
Oct 30 21:32:25.452140 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:25.451772    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn" event={"ID":"a4f4d580-1397-4f98-b232-d803802890f8","Type":"ContainerStarted","Data":"216cdb289d845574d7e57c59d6af289b354e939d4d869696b922f7b8b29f7f85"}
Oct 30 21:32:25.536026 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:25.535995    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:25.570928 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:25.570864    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn" podStartSLOduration=2.570846045 podStartE2EDuration="2.570846045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:32:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:32:25.569519436 +0000 UTC m=+1254.514464797" watchObservedRunningTime="2026-10-30 21:32:25.570846045 +0000 UTC m=+1254.515791408"
Oct 30 21:32:28.938758 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:28.938720    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:33.620124 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:33.620074    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:34.535964 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:34.535933    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:34.570734 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:34.570705    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:35.583749 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:35.583712    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:32:37.991431 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:32:37.991391    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:32:38.486996 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:38.486958    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:43.158236 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:43.158196    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:46.459978 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:46.459939    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:46.650833 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:46.650801    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:47.863591 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:47.863554    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:48.833263 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:48.833233    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:52.647084 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:52.647053    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:57.453022 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:57.452989    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:58.442068 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:58.442034    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:59.287895 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:59.287865    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:59.650053 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:32:59.649966    4522 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal" podUID="f52de7228915512f349d24482d38315b" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": context deadline exceeded"
Oct 30 21:33:01.889881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:01.889833    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:33:02.282325 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:02.282293    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:07.136831 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:07.136792    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:07.987942 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:33:07.987907    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:33:11.025093 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:11.025059    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:12.171573 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:12.171538    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:16.927947 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:16.927858    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:19.203474 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.203432    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"]
Oct 30 21:33:19.207205 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.207186    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:19.283901 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.283762    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-model-cache\") pod \"distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") " pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:19.283901 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.283819    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-tmp-dir\") pod \"distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") " pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:19.284103 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.284000    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5wxn\" (UniqueName: \"kubernetes.io/projected/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-kube-api-access-h5wxn\") pod \"distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") " pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:19.284165 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.284113    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-tls-certs\") pod \"distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") " pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:19.284220 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.284176    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-home\") pod \"distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") " pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:19.284220 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.284209    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-dshm\") pod \"distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") " pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:19.310047 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.310023    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-0a4eab\"/\"distinct-2-w5-0a4eab-kserve-self-signed-certs\""
Oct 30 21:33:19.312131 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.312110    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"]
Oct 30 21:33:19.341578 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.341551    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:19.385178 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.385136    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-model-cache\") pod \"distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") " pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:19.385178 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.385177    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-tmp-dir\") pod \"distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") " pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:19.385395 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.385292    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5wxn\" (UniqueName: \"kubernetes.io/projected/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-kube-api-access-h5wxn\") pod \"distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") " pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:19.385395 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.385383    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-tls-certs\") pod \"distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") " pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:19.385585 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.385423    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-home\") pod \"distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") " pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:19.385585 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.385448    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-dshm\") pod \"distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") " pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:19.385585 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.385568    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-model-cache\") pod \"distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") " pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:19.385744 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.385620    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-tmp-dir\") pod \"distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") " pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:19.385807 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.385769    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-home\") pod \"distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") " pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:19.387629 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.387608    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-dshm\") pod \"distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") " pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:19.387859 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.387841    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-tls-certs\") pod \"distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") " pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:19.442539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.442508    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5wxn\" (UniqueName: \"kubernetes.io/projected/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-kube-api-access-h5wxn\") pod \"distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") " pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:19.518781 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.518712    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:19.907157 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:19.907135    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"]
Oct 30 21:33:19.909713 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:33:19.909686    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5782d3ab_29c5_44a1_abc5_c8f8dbc0ad15.slice/crio-75751fb4c1aaab27c7e1e452e2ed3b1288acb78a513850b08216a214fd85bb29 WatchSource:0}: Error finding container 75751fb4c1aaab27c7e1e452e2ed3b1288acb78a513850b08216a214fd85bb29: Status 404 returned error can't find the container with id 75751fb4c1aaab27c7e1e452e2ed3b1288acb78a513850b08216a214fd85bb29
Oct 30 21:33:20.750727 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:20.750689    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n" event={"ID":"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15","Type":"ContainerStarted","Data":"f2e91e7972de439ba20afbed8a8312db2567c19e437018bb657b73a83337cf68"}
Oct 30 21:33:20.751183 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:20.750740    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n" event={"ID":"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15","Type":"ContainerStarted","Data":"75751fb4c1aaab27c7e1e452e2ed3b1288acb78a513850b08216a214fd85bb29"}
Oct 30 21:33:20.867019 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:20.866971    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n" podStartSLOduration=1.86695772 podStartE2EDuration="1.86695772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:33:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:33:20.865136993 +0000 UTC m=+1309.810082350" watchObservedRunningTime="2026-10-30 21:33:20.86695772 +0000 UTC m=+1309.811903076"
Oct 30 21:33:21.518907 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:21.518876    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:21.744825 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:21.744794    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:23.418620 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:23.418591    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:26.451578 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:26.451526    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:29.519067 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:29.519035    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:29.535976 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:29.535948    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:29.804725 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:29.804659    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:33:31.158798 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:31.158766    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:36.083413 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:36.083374    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:37.987545 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:33:37.987509    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:33:39.999514 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:39.999479    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"]
Oct 30 21:33:40.003368 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.003343    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.100725 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.100683    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5z7z\" (UniqueName: \"kubernetes.io/projected/4f516f9b-32d2-4823-87f0-39d5967eee9c-kube-api-access-j5z7z\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.100920 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.100756    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-data\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.100920 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.100793    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-workload-socket\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.100920 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.100818    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-credential-socket\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.100920 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.100853    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f516f9b-32d2-4823-87f0-39d5967eee9c-istiod-ca-cert\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.100920 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.100889    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-envoy\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.101182 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.100920    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-workload-certs\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.101182 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.100955    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-podinfo\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.101182 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.101021    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-token\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.101916 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.101886    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"]
Oct 30 21:33:40.201903 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.201869    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5z7z\" (UniqueName: \"kubernetes.io/projected/4f516f9b-32d2-4823-87f0-39d5967eee9c-kube-api-access-j5z7z\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.202077 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.201920    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-data\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.202077 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.202059    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-workload-socket\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.202183 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.202101    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-credential-socket\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.202183 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.202143    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f516f9b-32d2-4823-87f0-39d5967eee9c-istiod-ca-cert\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.202295 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.202184    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-envoy\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.202295 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.202221    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-workload-certs\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.202295 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.202235    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-data\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.202295 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.202255    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-podinfo\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.202529 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.202334    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-token\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.202529 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.202449    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-workload-socket\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.202529 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.202517    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-credential-socket\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.202958 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.202934    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f516f9b-32d2-4823-87f0-39d5967eee9c-istiod-ca-cert\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.203059 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.202955    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-workload-certs\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.204470 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.204437    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-envoy\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.204809 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.204793    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-podinfo\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.259113 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.259050    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5z7z\" (UniqueName: \"kubernetes.io/projected/4f516f9b-32d2-4823-87f0-39d5967eee9c-kube-api-access-j5z7z\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.259113 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.259103    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-token\") pod \"e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") " pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.315146 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.315119    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:40.748839 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.748815    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"]
Oct 30 21:33:40.750430 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:33:40.750401    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f516f9b_32d2_4823_87f0_39d5967eee9c.slice/crio-cadc4049e4a4e780e5636c95b756ee051ab56f21beeb018c50e6e0817e8a0be3 WatchSource:0}: Error finding container cadc4049e4a4e780e5636c95b756ee051ab56f21beeb018c50e6e0817e8a0be3: Status 404 returned error can't find the container with id cadc4049e4a4e780e5636c95b756ee051ab56f21beeb018c50e6e0817e8a0be3
Oct 30 21:33:40.752880 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.752828    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:33:40.753002 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.752912    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:33:40.753002 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.752955    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:33:40.855650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.855615    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw" event={"ID":"4f516f9b-32d2-4823-87f0-39d5967eee9c","Type":"ContainerStarted","Data":"4f86ee57c1da10708593d138f8eeec35a3e78ccaf056efca6ae2e62551db3d49"}
Oct 30 21:33:40.855789 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.855679    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw" event={"ID":"4f516f9b-32d2-4823-87f0-39d5967eee9c","Type":"ContainerStarted","Data":"cadc4049e4a4e780e5636c95b756ee051ab56f21beeb018c50e6e0817e8a0be3"}
Oct 30 21:33:40.867511 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.867426    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:40.975133 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:40.975075    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw" podStartSLOduration=1.975063048 podStartE2EDuration="1.975063048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:33:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:33:40.972413394 +0000 UTC m=+1329.917358753" watchObservedRunningTime="2026-10-30 21:33:40.975063048 +0000 UTC m=+1329.920008407"
Oct 30 21:33:41.315749 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:41.315715    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:41.317251 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:41.317222    4522 patch_prober.go:29] interesting pod/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Oct 30 21:33:41.317356 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:41.317271    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw" podUID="4f516f9b-32d2-4823-87f0-39d5967eee9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Oct 30 21:33:42.316162 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:42.316129    4522 patch_prober.go:29] interesting pod/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Oct 30 21:33:42.316535 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:42.316177    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw" podUID="4f516f9b-32d2-4823-87f0-39d5967eee9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Oct 30 21:33:43.316379 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:43.316347    4522 patch_prober.go:29] interesting pod/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Oct 30 21:33:43.316782 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:43.316422    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw" podUID="4f516f9b-32d2-4823-87f0-39d5967eee9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Oct 30 21:33:44.318819 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:44.318784    4522 patch_prober.go:29] interesting pod/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Oct 30 21:33:44.319318 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:44.318841    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw" podUID="4f516f9b-32d2-4823-87f0-39d5967eee9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Oct 30 21:33:44.417898 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:44.417851    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:45.316304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:45.316268    4522 patch_prober.go:29] interesting pod/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Oct 30 21:33:45.316503 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:45.316320    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw" podUID="4f516f9b-32d2-4823-87f0-39d5967eee9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Oct 30 21:33:45.717646 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:45.717573    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:46.316414 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:46.316375    4522 patch_prober.go:29] interesting pod/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Oct 30 21:33:46.316616 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:46.316438    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw" podUID="4f516f9b-32d2-4823-87f0-39d5967eee9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Oct 30 21:33:47.315611 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:47.315580    4522 patch_prober.go:29] interesting pod/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Oct 30 21:33:47.316081 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:47.315647    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw" podUID="4f516f9b-32d2-4823-87f0-39d5967eee9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Oct 30 21:33:48.320582 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:48.320552    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:48.320947 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:48.320797    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:48.321389 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:48.321372    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:33:50.565760 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:50.565727    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:55.248027 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:55.247991    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:59.969692 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:33:59.969656    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:03.301894 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:03.301865    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:34:04.857892 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:04.857857    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:07.987192 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:34:07.987148    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:34:08.593954 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.593921    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"]
Oct 30 21:34:08.597935 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.597915    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.649986 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.649962    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-847c62-openshift-default-dockercfg-67hhh\""
Oct 30 21:34:08.710159 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.710133    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"]
Oct 30 21:34:08.717563 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.717536    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m42n\" (UniqueName: \"kubernetes.io/projected/d524ef3a-e3da-481e-842b-5c8980edb670-kube-api-access-8m42n\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.717680 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.717576    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-istio-data\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.717680 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.717603    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-workload-certs\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.717796 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.717708    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d524ef3a-e3da-481e-842b-5c8980edb670-istiod-ca-cert\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.717796 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.717758    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-istio-envoy\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.717879 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.717856    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d524ef3a-e3da-481e-842b-5c8980edb670-istio-podinfo\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.717918 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.717908    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-workload-socket\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.717957 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.717926    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d524ef3a-e3da-481e-842b-5c8980edb670-istio-token\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.717957 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.717943    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-credential-socket\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.819213 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.819180    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-workload-socket\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.819402 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.819214    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d524ef3a-e3da-481e-842b-5c8980edb670-istio-token\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.819402 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.819245    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-credential-socket\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.819402 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.819351    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m42n\" (UniqueName: \"kubernetes.io/projected/d524ef3a-e3da-481e-842b-5c8980edb670-kube-api-access-8m42n\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.819402 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.819397    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-istio-data\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.819652 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.819428    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-workload-certs\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.819652 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.819562    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d524ef3a-e3da-481e-842b-5c8980edb670-istiod-ca-cert\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.819652 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.819620    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-istio-envoy\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.819812 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.819683    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d524ef3a-e3da-481e-842b-5c8980edb670-istio-podinfo\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.819812 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.819722    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-credential-socket\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.819812 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.819774    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-workload-socket\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.819938 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.819828    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-istio-data\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.820210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.820185    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d524ef3a-e3da-481e-842b-5c8980edb670-istiod-ca-cert\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.820473 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.820440    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-workload-certs\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.821846 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.821812    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-istio-envoy\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.822288 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.822272    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d524ef3a-e3da-481e-842b-5c8980edb670-istio-podinfo\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.876359 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.876299    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d524ef3a-e3da-481e-842b-5c8980edb670-istio-token\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.876548 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.876527    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m42n\" (UniqueName: \"kubernetes.io/projected/d524ef3a-e3da-481e-842b-5c8980edb670-kube-api-access-8m42n\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:08.910967 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:08.910941    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:09.224867 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.224839    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"]
Oct 30 21:34:09.228309 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.228290    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.325159 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.325123    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-token\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.325297 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.325229    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istiod-ca-cert\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.325355 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.325335    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k2h7\" (UniqueName: \"kubernetes.io/projected/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-kube-api-access-2k2h7\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.325390 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.325364    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-data\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.325511 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.325477    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-podinfo\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.325755 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.325524    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-workload-socket\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.325755 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.325623    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-envoy\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.325755 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.325646    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-credential-socket\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.325755 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.325666    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-workload-certs\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.336682 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.336658    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"]
Oct 30 21:34:09.408664 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.408637    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"]
Oct 30 21:34:09.410757 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:34:09.410733    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd524ef3a_e3da_481e_842b_5c8980edb670.slice/crio-a96d0cf0d169824b9e71e4d91f463036027322aede3b4fb8038f1ea085bf189b WatchSource:0}: Error finding container a96d0cf0d169824b9e71e4d91f463036027322aede3b4fb8038f1ea085bf189b: Status 404 returned error can't find the container with id a96d0cf0d169824b9e71e4d91f463036027322aede3b4fb8038f1ea085bf189b
Oct 30 21:34:09.413021 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.412991    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:34:09.413104 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.413051    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:34:09.413104 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.413079    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:34:09.426274 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.426255    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-token\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.426367 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.426304    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istiod-ca-cert\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.426367 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.426343    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k2h7\" (UniqueName: \"kubernetes.io/projected/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-kube-api-access-2k2h7\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.426367 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.426360    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-data\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.426534 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.426392    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-podinfo\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.426534 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.426430    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-workload-socket\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.426534 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.426497    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-envoy\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.426534 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.426522    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-credential-socket\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.426735 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.426547    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-workload-certs\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.426825 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.426799    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-data\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.426943 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.426852    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-credential-socket\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.426943 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.426909    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-workload-socket\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.427048 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.426960    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-workload-certs\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.427383 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.427363    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istiod-ca-cert\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.428898 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.428872    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-envoy\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.429051 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.429028    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-podinfo\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.482815 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.482762    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-token\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.482935 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.482919    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k2h7\" (UniqueName: \"kubernetes.io/projected/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-kube-api-access-2k2h7\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.542868 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.542835    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:09.746635 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.746549    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:09.969089 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.969063    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"]
Oct 30 21:34:09.971445 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:34:09.971415    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c90b3ce_f6a1_4ce6_a690_7831b4638d29.slice/crio-b05b25d94b08af011f34504b0f1937bc1946cb7975ba05e65b501e07c3a965ce WatchSource:0}: Error finding container b05b25d94b08af011f34504b0f1937bc1946cb7975ba05e65b501e07c3a965ce: Status 404 returned error can't find the container with id b05b25d94b08af011f34504b0f1937bc1946cb7975ba05e65b501e07c3a965ce
Oct 30 21:34:09.973882 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.973851    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:34:09.973949 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.973912    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:34:09.973949 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:09.973938    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:34:10.024768 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:10.024741    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr" event={"ID":"0c90b3ce-f6a1-4ce6-a690-7831b4638d29","Type":"ContainerStarted","Data":"b05b25d94b08af011f34504b0f1937bc1946cb7975ba05e65b501e07c3a965ce"}
Oct 30 21:34:10.026410 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:10.026385    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf" event={"ID":"d524ef3a-e3da-481e-842b-5c8980edb670","Type":"ContainerStarted","Data":"b840272e7fed5e8c4d336d5fc9714038d91a43f19c83f450a816db803571bbae"}
Oct 30 21:34:10.026524 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:10.026438    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf" event={"ID":"d524ef3a-e3da-481e-842b-5c8980edb670","Type":"ContainerStarted","Data":"a96d0cf0d169824b9e71e4d91f463036027322aede3b4fb8038f1ea085bf189b"}
Oct 30 21:34:10.145509 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:10.145444    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf" podStartSLOduration=2.145430891 podStartE2EDuration="2.145430891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:34:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:34:10.142275535 +0000 UTC m=+1359.087220895" watchObservedRunningTime="2026-10-30 21:34:10.145430891 +0000 UTC m=+1359.090376251"
Oct 30 21:34:10.915480 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:10.914815    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:10.936476 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:10.919578    4522 patch_prober.go:29] interesting pod/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Oct 30 21:34:10.936476 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:10.919638    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf" podUID="d524ef3a-e3da-481e-842b-5c8980edb670" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Oct 30 21:34:11.048401 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:11.048358    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr" event={"ID":"0c90b3ce-f6a1-4ce6-a690-7831b4638d29","Type":"ContainerStarted","Data":"b5f623651728fc1860fa5f6826d04bfe39bdfddb14229e6c87ce6ed63defb605"}
Oct 30 21:34:11.244308 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:11.244244    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr" podStartSLOduration=2.244229815 podStartE2EDuration="2.244229815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:34:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:34:11.243304565 +0000 UTC m=+1360.188249927" watchObservedRunningTime="2026-10-30 21:34:11.244229815 +0000 UTC m=+1360.189175211"
Oct 30 21:34:11.543262 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:11.543164    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:11.545552 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:11.545524    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Oct 30 21:34:11.545701 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:11.545576    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr" podUID="0c90b3ce-f6a1-4ce6-a690-7831b4638d29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Oct 30 21:34:11.920479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:11.919802    4522 patch_prober.go:29] interesting pod/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Oct 30 21:34:11.920479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:11.919862    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf" podUID="d524ef3a-e3da-481e-842b-5c8980edb670" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Oct 30 21:34:12.544478 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:12.543140    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Oct 30 21:34:12.544478 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:12.543187    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr" podUID="0c90b3ce-f6a1-4ce6-a690-7831b4638d29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Oct 30 21:34:12.912209 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:12.912121    4522 patch_prober.go:29] interesting pod/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Oct 30 21:34:12.912494 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:12.912441    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf" podUID="d524ef3a-e3da-481e-842b-5c8980edb670" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Oct 30 21:34:13.544115 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:13.544080    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Oct 30 21:34:13.544598 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:13.544137    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr" podUID="0c90b3ce-f6a1-4ce6-a690-7831b4638d29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Oct 30 21:34:13.912959 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:13.912866    4522 patch_prober.go:29] interesting pod/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Oct 30 21:34:13.913238 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:13.913199    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf" podUID="d524ef3a-e3da-481e-842b-5c8980edb670" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Oct 30 21:34:14.543413 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:14.543378    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Oct 30 21:34:14.543644 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:14.543439    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr" podUID="0c90b3ce-f6a1-4ce6-a690-7831b4638d29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Oct 30 21:34:14.738544 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:14.738335    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:14.928481 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:14.926428    4522 patch_prober.go:29] interesting pod/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Oct 30 21:34:14.928481 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:14.926511    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf" podUID="d524ef3a-e3da-481e-842b-5c8980edb670" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Oct 30 21:34:15.544291 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:15.544255    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Oct 30 21:34:15.544478 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:15.544312    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr" podUID="0c90b3ce-f6a1-4ce6-a690-7831b4638d29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Oct 30 21:34:15.911647 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:15.911553    4522 patch_prober.go:29] interesting pod/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Oct 30 21:34:15.911647 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:15.911629    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf" podUID="d524ef3a-e3da-481e-842b-5c8980edb670" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Oct 30 21:34:16.543902 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:16.543863    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Oct 30 21:34:16.544059 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:16.543940    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr" podUID="0c90b3ce-f6a1-4ce6-a690-7831b4638d29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Oct 30 21:34:16.949973 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:16.949944    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:16.950838 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:16.950809    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:16.951714 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:16.951695    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:34:17.547454 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:17.547421    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:17.547811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:17.547793    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:17.548424 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:17.548404    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:34:19.586070 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:19.586032    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:25.383644 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:25.383610    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:25.572820 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:25.572792    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:29.049675 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:29.049646    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:33.739681 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:33.739642    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:37.988215 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:34:37.988180    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:34:38.548812 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:38.548776    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:39.126705 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.126672    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"]
Oct 30 21:34:39.130674 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.130652    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.235750 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.235715    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"]
Oct 30 21:34:39.235982 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.235933    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr" podUID="ddc38af0-5f7f-45af-b8f7-7331b4d5068a" containerName="istio-proxy" containerID="cri-o://7386a60ec2a489174dc9c1d463ded462bc6c68010d5540eeaedacfd58a5574f4" gracePeriod=30
Oct 30 21:34:39.238895 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.238872    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"]
Oct 30 21:34:39.247936 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.247909    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-podinfo\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.248055 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.247964    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-credential-socket\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.248055 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.247989    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-workload-certs\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.248055 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.248024    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-envoy\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.248211 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.248125    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-data\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.248211 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.248151    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-token\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.248211 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.248185    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18a2be02-5bed-4207-87ea-f5fde7dcef87-istiod-ca-cert\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.248359 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.248210    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-workload-socket\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.248359 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.248312    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8vjm\" (UniqueName: \"kubernetes.io/projected/18a2be02-5bed-4207-87ea-f5fde7dcef87-kube-api-access-h8vjm\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.349032 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.348998    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-workload-socket\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.349273 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.349231    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8vjm\" (UniqueName: \"kubernetes.io/projected/18a2be02-5bed-4207-87ea-f5fde7dcef87-kube-api-access-h8vjm\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.349389 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.349369    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-podinfo\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.349448 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.349411    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-credential-socket\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.349448 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.349428    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-workload-certs\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.349575 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.349451    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-envoy\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.349575 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.349472    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-workload-socket\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.349707 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.349612    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-data\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.349707 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.349638    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-token\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.349707 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.349671    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18a2be02-5bed-4207-87ea-f5fde7dcef87-istiod-ca-cert\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.349862 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.349719    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-credential-socket\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.350033 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.350009    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-data\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.350291 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.350270    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-workload-certs\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.350374 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.350330    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18a2be02-5bed-4207-87ea-f5fde7dcef87-istiod-ca-cert\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.351950 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.351922    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-podinfo\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.351950 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.351947    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-envoy\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.405139 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.405047    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8vjm\" (UniqueName: \"kubernetes.io/projected/18a2be02-5bed-4207-87ea-f5fde7dcef87-kube-api-access-h8vjm\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.405508 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.405481    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-token\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.443246 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.443220    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:39.853144 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.853110    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"]
Oct 30 21:34:39.858435 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.858414    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:39.875557 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.875536    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"]
Oct 30 21:34:39.877167 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:34:39.877146    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a2be02_5bed_4207_87ea_f5fde7dcef87.slice/crio-56b6a079ee3be5ec024ccc0aae935c906229322993ba7f3f0de1d18d7064607f WatchSource:0}: Error finding container 56b6a079ee3be5ec024ccc0aae935c906229322993ba7f3f0de1d18d7064607f: Status 404 returned error can't find the container with id 56b6a079ee3be5ec024ccc0aae935c906229322993ba7f3f0de1d18d7064607f
Oct 30 21:34:39.879546 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.879516    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:34:39.879622 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.879575    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:34:39.879622 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.879606    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:34:39.917168 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.917142    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"]
Oct 30 21:34:39.956605 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.956582    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-envoy\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:39.956716 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.956625    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-workload-socket\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:39.956716 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.956643    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istiod-ca-cert\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:39.956834 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.956810    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-podinfo\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:39.956928 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.956915    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-data\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:39.956996 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.956980    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-credential-socket\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:39.957096 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.957083    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-workload-certs\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:39.957154 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.957118    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-token\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:39.957193 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:39.957152    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clbxt\" (UniqueName: \"kubernetes.io/projected/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-kube-api-access-clbxt\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:40.058093 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.058054    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-envoy\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:40.058093 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.058096    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-workload-socket\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:40.058327 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.058119    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istiod-ca-cert\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:40.058327 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.058173    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-podinfo\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:40.058327 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.058219    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-data\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:40.058327 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.058265    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-credential-socket\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:40.058327 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.058318    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-workload-certs\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:40.058605 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.058339    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-token\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:40.058605 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.058363    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clbxt\" (UniqueName: \"kubernetes.io/projected/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-kube-api-access-clbxt\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:40.058714 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.058601    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-workload-socket\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:40.058714 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.058647    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-data\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:40.058905 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.058879    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-workload-certs\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:40.058965 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.058900    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-credential-socket\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:40.059311 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.059293    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istiod-ca-cert\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:40.060428 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.060402    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-envoy\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:40.060660 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.060645    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-podinfo\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:40.115215 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.115147    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-token\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:40.115381 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.115356    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clbxt\" (UniqueName: \"kubernetes.io/projected/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-kube-api-access-clbxt\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:40.171526 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.171498    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:40.230572 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.230453    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl" event={"ID":"18a2be02-5bed-4207-87ea-f5fde7dcef87","Type":"ContainerStarted","Data":"9ac8544ed1e8692f0a400a9e4784f8426d3e79b8453bb4589e7743d75a218c1d"}
Oct 30 21:34:40.230572 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.230534    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl" event={"ID":"18a2be02-5bed-4207-87ea-f5fde7dcef87","Type":"ContainerStarted","Data":"56b6a079ee3be5ec024ccc0aae935c906229322993ba7f3f0de1d18d7064607f"}
Oct 30 21:34:40.349971 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.349917    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl" podStartSLOduration=1.349903821 podStartE2EDuration="1.349903821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:34:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:34:40.347565696 +0000 UTC m=+1389.292511108" watchObservedRunningTime="2026-10-30 21:34:40.349903821 +0000 UTC m=+1389.294849180"
Oct 30 21:34:40.443980 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.443951    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:40.445201 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.445179    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Oct 30 21:34:40.445274 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.445223    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl" podUID="18a2be02-5bed-4207-87ea-f5fde7dcef87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Oct 30 21:34:40.615981 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.615429    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"]
Oct 30 21:34:40.618771 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.618726    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:34:40.618853 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.618813    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:34:40.618900 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:40.618872    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:34:41.236983 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:41.236946    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf" event={"ID":"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d","Type":"ContainerStarted","Data":"910be7374f01bf45953cf60243fe63bdabed498aaeadb70862e0214f36f1f1c4"}
Oct 30 21:34:41.237414 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:41.237003    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf" event={"ID":"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d","Type":"ContainerStarted","Data":"65a5e311263fe4a4d7f03bc83826eb08e849dd805686ddbdd1cb49f927abb480"}
Oct 30 21:34:41.368473 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:41.368418    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf" podStartSLOduration=2.368404486 podStartE2EDuration="2.368404486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:34:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:34:41.365756034 +0000 UTC m=+1390.310701393" watchObservedRunningTime="2026-10-30 21:34:41.368404486 +0000 UTC m=+1390.313349845"
Oct 30 21:34:41.444087 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:41.444046    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Oct 30 21:34:41.444279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:41.444106    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl" podUID="18a2be02-5bed-4207-87ea-f5fde7dcef87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Oct 30 21:34:42.172603 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:42.172562    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:42.173788 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:42.173762    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 30 21:34:42.173850 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:42.173827    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf" podUID="2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 30 21:34:42.332484 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:42.319648    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dbsgr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:34:42.332484 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:42.319709    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr" podUID="ddc38af0-5f7f-45af-b8f7-7331b4d5068a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:34:42.443935 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:42.443786    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Oct 30 21:34:42.443935 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:42.443842    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl" podUID="18a2be02-5bed-4207-87ea-f5fde7dcef87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Oct 30 21:34:43.172188 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:43.172147    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 30 21:34:43.172377 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:43.172222    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf" podUID="2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 30 21:34:43.435683 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:43.434047    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:43.448309 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:43.448274    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Oct 30 21:34:43.448603 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:43.448573    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl" podUID="18a2be02-5bed-4207-87ea-f5fde7dcef87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Oct 30 21:34:44.171957 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.171922    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 30 21:34:44.172174 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.171972    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf" podUID="2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 30 21:34:44.444660 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.444579    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Oct 30 21:34:44.444660 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.444644    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl" podUID="18a2be02-5bed-4207-87ea-f5fde7dcef87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Oct 30 21:34:44.665651 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.665626    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:34:44.861075 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.859868    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-token\" (UniqueName: \"kubernetes.io/projected/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-token\") pod \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") "
Oct 30 21:34:44.861075 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.859979    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-data\") pod \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") "
Oct 30 21:34:44.861075 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.860021    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-credential-socket\") pod \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") "
Oct 30 21:34:44.861075 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.860075    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-workload-socket\") pod \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") "
Oct 30 21:34:44.861075 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.860116    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-kube-api-access-sqzp2\" (UniqueName: \"kubernetes.io/projected/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-kube-api-access-sqzp2\") pod \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") "
Oct 30 21:34:44.861075 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.860146    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istiod-ca-cert\") pod \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") "
Oct 30 21:34:44.861075 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.860181    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-workload-certs\") pod \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") "
Oct 30 21:34:44.861075 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.860219    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-podinfo\") pod \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") "
Oct 30 21:34:44.861075 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.860391    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-envoy\") pod \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\" (UID: \"ddc38af0-5f7f-45af-b8f7-7331b4d5068a\") "
Oct 30 21:34:44.861075 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.860727    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-data" pod "ddc38af0-5f7f-45af-b8f7-7331b4d5068a" (UID: "ddc38af0-5f7f-45af-b8f7-7331b4d5068a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:34:44.861075 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.860846    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-credential-socket" pod "ddc38af0-5f7f-45af-b8f7-7331b4d5068a" (UID: "ddc38af0-5f7f-45af-b8f7-7331b4d5068a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:34:44.861075 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.860923    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:44.861075 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.860935    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:44.861075 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.861078    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-workload-certs" pod "ddc38af0-5f7f-45af-b8f7-7331b4d5068a" (UID: "ddc38af0-5f7f-45af-b8f7-7331b4d5068a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:34:44.861812 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.861223    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-workload-socket" pod "ddc38af0-5f7f-45af-b8f7-7331b4d5068a" (UID: "ddc38af0-5f7f-45af-b8f7-7331b4d5068a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:34:44.861812 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.861430    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istiod-ca-cert" pod "ddc38af0-5f7f-45af-b8f7-7331b4d5068a" (UID: "ddc38af0-5f7f-45af-b8f7-7331b4d5068a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:34:44.863443 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.863114    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-kube-api-access-sqzp2" pod "ddc38af0-5f7f-45af-b8f7-7331b4d5068a" (UID: "ddc38af0-5f7f-45af-b8f7-7331b4d5068a"). InnerVolumeSpecName "kube-api-access-sqzp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:34:44.864510 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.863548    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-envoy" pod "ddc38af0-5f7f-45af-b8f7-7331b4d5068a" (UID: "ddc38af0-5f7f-45af-b8f7-7331b4d5068a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:34:44.864510 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.863870    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-podinfo" pod "ddc38af0-5f7f-45af-b8f7-7331b4d5068a" (UID: "ddc38af0-5f7f-45af-b8f7-7331b4d5068a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:34:44.864510 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.863906    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-token" pod "ddc38af0-5f7f-45af-b8f7-7331b4d5068a" (UID: "ddc38af0-5f7f-45af-b8f7-7331b4d5068a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:34:44.961855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.961824    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:44.961855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.961851    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqzp2\" (UniqueName: \"kubernetes.io/projected/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-kube-api-access-sqzp2\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:44.961855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.961862    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:44.962085 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.961872    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:44.962085 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.961883    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:44.962085 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.961891    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:44.962085 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:44.961899    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc38af0-5f7f-45af-b8f7-7331b4d5068a-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:45.172526 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:45.172497    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 30 21:34:45.172677 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:45.172552    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf" podUID="2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 30 21:34:45.261188 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:45.261153    4522 generic.go:356] "Generic (PLEG): container finished" podID="ddc38af0-5f7f-45af-b8f7-7331b4d5068a" containerID="7386a60ec2a489174dc9c1d463ded462bc6c68010d5540eeaedacfd58a5574f4" exitCode=0
Oct 30 21:34:45.261938 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:45.261215    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"
Oct 30 21:34:45.261938 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:45.261237    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr" event={"ID":"ddc38af0-5f7f-45af-b8f7-7331b4d5068a","Type":"ContainerDied","Data":"7386a60ec2a489174dc9c1d463ded462bc6c68010d5540eeaedacfd58a5574f4"}
Oct 30 21:34:45.261938 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:45.261531    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr" event={"ID":"ddc38af0-5f7f-45af-b8f7-7331b4d5068a","Type":"ContainerDied","Data":"dbacef74693da6abf6676af5d93c18ddfd917ce030f9bef3bca4045854252d93"}
Oct 30 21:34:45.261938 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:45.261556    4522 scope.go:122] "RemoveContainer" containerID="7386a60ec2a489174dc9c1d463ded462bc6c68010d5540eeaedacfd58a5574f4"
Oct 30 21:34:45.270773 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:45.270754    4522 scope.go:122] "RemoveContainer" containerID="7386a60ec2a489174dc9c1d463ded462bc6c68010d5540eeaedacfd58a5574f4"
Oct 30 21:34:45.271032 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:34:45.271016    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7386a60ec2a489174dc9c1d463ded462bc6c68010d5540eeaedacfd58a5574f4\": container with ID starting with 7386a60ec2a489174dc9c1d463ded462bc6c68010d5540eeaedacfd58a5574f4 not found: ID does not exist" containerID="7386a60ec2a489174dc9c1d463ded462bc6c68010d5540eeaedacfd58a5574f4"
Oct 30 21:34:45.271072 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:45.271042    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7386a60ec2a489174dc9c1d463ded462bc6c68010d5540eeaedacfd58a5574f4"} err="failed to get container status \"7386a60ec2a489174dc9c1d463ded462bc6c68010d5540eeaedacfd58a5574f4\": rpc error: code = NotFound desc = could not find container \"7386a60ec2a489174dc9c1d463ded462bc6c68010d5540eeaedacfd58a5574f4\": container with ID starting with 7386a60ec2a489174dc9c1d463ded462bc6c68010d5540eeaedacfd58a5574f4 not found: ID does not exist"
Oct 30 21:34:45.435533 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:45.435188    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"]
Oct 30 21:34:45.444590 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:45.444563    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Oct 30 21:34:45.444727 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:45.444626    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl" podUID="18a2be02-5bed-4207-87ea-f5fde7dcef87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Oct 30 21:34:45.465520 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:45.465497    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dbsgr"]
Oct 30 21:34:46.172017 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:46.171977    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 30 21:34:46.172209 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:46.172036    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf" podUID="2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 30 21:34:46.443938 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:46.443865    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Oct 30 21:34:46.443938 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:46.443922    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl" podUID="18a2be02-5bed-4207-87ea-f5fde7dcef87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Oct 30 21:34:47.172579 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:47.172545    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 30 21:34:47.173066 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:47.172599    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf" podUID="2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 30 21:34:47.196117 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:47.196070    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ddc38af0-5f7f-45af-b8f7-7331b4d5068a" path="/var/lib/kubelet/pods/ddc38af0-5f7f-45af-b8f7-7331b4d5068a/volumes"
Oct 30 21:34:47.447732 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:47.447663    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:47.447956 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:47.447935    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:47.448734 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:47.448718    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:34:47.651429 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:47.651394    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:48.176365 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:48.176338    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:48.176832 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:48.176643    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:48.177385 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:48.177366    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:34:48.350928 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:48.350894    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:53.052792 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:53.052744    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:55.240966 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.240935    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"]
Oct 30 21:34:55.241407 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.241392    4522 cpu_manager.go:414] "containerMap: removing container" podUID="ddc38af0-5f7f-45af-b8f7-7331b4d5068a" containerName="istio-proxy"
Oct 30 21:34:55.241452 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.241408    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ddc38af0-5f7f-45af-b8f7-7331b4d5068a" containerName="istio-proxy"
Oct 30 21:34:55.241521 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.241510    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="ddc38af0-5f7f-45af-b8f7-7331b4d5068a" containerName="istio-proxy"
Oct 30 21:34:55.244750 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.244731    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.347281 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.347238    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"]
Oct 30 21:34:55.380066 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.380030    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-workload-socket\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.380233 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.380160    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-data\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.380282 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.380232    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-envoy\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.380282 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.380269    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-token\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.380360 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.380322    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-credential-socket\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.380506 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.380485    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55t5t\" (UniqueName: \"kubernetes.io/projected/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-kube-api-access-55t5t\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.380563 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.380539    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-workload-certs\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.380650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.380633    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istiod-ca-cert\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.380696 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.380668    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-podinfo\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.481211 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.481178    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-credential-socket\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.481372 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.481225    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55t5t\" (UniqueName: \"kubernetes.io/projected/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-kube-api-access-55t5t\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.481372 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.481255    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-workload-certs\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.481372 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.481288    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istiod-ca-cert\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.481372 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.481306    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-podinfo\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.481372 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.481332    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-workload-socket\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.481691 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.481379    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-data\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.481691 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.481402    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-envoy\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.481691 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.481647    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-token\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.481691 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.481663    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-credential-socket\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.481691 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.481687    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-workload-certs\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.481942 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.481793    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-workload-socket\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.481942 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.481857    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-data\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.482270 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.482250    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istiod-ca-cert\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.483701 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.483677    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-envoy\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.483893 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.483875    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-podinfo\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.537656 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.537597    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-token\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.537779 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.537725    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55t5t\" (UniqueName: \"kubernetes.io/projected/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-kube-api-access-55t5t\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.556824 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.556799    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:55.981391 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:55.981357    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"]
Oct 30 21:34:56.023328 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:34:56.023277    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c59d15b_3c97_44d5_a0b0_df53e4c8f646.slice/crio-88acd80ffa605656443895f52429b7e0d465fda7bf88b475a1de20f382760c71 WatchSource:0}: Error finding container 88acd80ffa605656443895f52429b7e0d465fda7bf88b475a1de20f382760c71: Status 404 returned error can't find the container with id 88acd80ffa605656443895f52429b7e0d465fda7bf88b475a1de20f382760c71
Oct 30 21:34:56.025754 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:56.025718    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:34:56.025827 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:56.025805    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:34:56.025867 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:56.025834    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:34:56.327768 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:56.327681    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz" event={"ID":"7c59d15b-3c97-44d5-a0b0-df53e4c8f646","Type":"ContainerStarted","Data":"a868b47e29abc2ddc88a4a2bde693bc8cc96e6b672f73d7bd96525884117a8e1"}
Oct 30 21:34:56.327768 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:56.327748    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz" event={"ID":"7c59d15b-3c97-44d5-a0b0-df53e4c8f646","Type":"ContainerStarted","Data":"88acd80ffa605656443895f52429b7e0d465fda7bf88b475a1de20f382760c71"}
Oct 30 21:34:56.445522 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:56.445451    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz" podStartSLOduration=1.445433543 podStartE2EDuration="1.445433543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:34:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:34:56.443209063 +0000 UTC m=+1405.388154422" watchObservedRunningTime="2026-10-30 21:34:56.445433543 +0000 UTC m=+1405.390378903"
Oct 30 21:34:56.557676 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:56.557647    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:34:57.558773 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:57.558743    4522 patch_prober.go:29] interesting pod/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Oct 30 21:34:57.559157 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:57.558796    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz" podUID="7c59d15b-3c97-44d5-a0b0-df53e4c8f646" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Oct 30 21:34:57.812555 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:57.810840    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:58.557445 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:58.557413    4522 patch_prober.go:29] interesting pod/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Oct 30 21:34:58.557610 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:58.557488    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz" podUID="7c59d15b-3c97-44d5-a0b0-df53e4c8f646" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Oct 30 21:34:59.557383 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:59.557349    4522 patch_prober.go:29] interesting pod/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Oct 30 21:34:59.557809 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:34:59.557402    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz" podUID="7c59d15b-3c97-44d5-a0b0-df53e4c8f646" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Oct 30 21:35:00.557420 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:00.557388    4522 patch_prober.go:29] interesting pod/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Oct 30 21:35:00.557805 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:00.557450    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz" podUID="7c59d15b-3c97-44d5-a0b0-df53e4c8f646" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Oct 30 21:35:01.557993 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:01.557956    4522 patch_prober.go:29] interesting pod/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Oct 30 21:35:01.558380 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:01.558019    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz" podUID="7c59d15b-3c97-44d5-a0b0-df53e4c8f646" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Oct 30 21:35:02.557563 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:02.557523    4522 patch_prober.go:29] interesting pod/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Oct 30 21:35:02.557736 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:02.557606    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz" podUID="7c59d15b-3c97-44d5-a0b0-df53e4c8f646" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Oct 30 21:35:02.689995 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:02.689950    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:03.561850 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:03.561820    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:35:03.562110 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:03.562090    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:35:03.562833 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:03.562812    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:35:07.192298 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:07.192269    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:35:07.442985 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:07.442902    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:08.121136 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:35:08.121088    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:35:09.361599 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:09.361547    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5" podUID="336f0a2d-1023-411d-9ff4-33dad5c413d5" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:09.562484 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:09.530551    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn" podUID="a4f4d580-1397-4f98-b232-d803802890f8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:09.562484 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:09.539786    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n" podUID="d9eadf71-d6c7-400f-9c6f-bea93e8a3750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:09.573480 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:09.568550    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7" podUID="504b9039-7a53-4f4d-bf60-20eceb9f6d3c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:09.764482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:09.754515    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld" podUID="afd04a47-10c4-4ccf-879c-c549765a0c50" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:09.807484 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:09.799369    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n" podUID="5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:09.851483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:09.850548    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj" podUID="5870207c-906d-47f0-bb38-ca1020a0dccb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:09.950775 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:09.950729    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk" podUID="58f59123-9a14-4cd0-8c9e-17448eae2bca" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded"
Oct 30 21:35:10.402483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:10.401482    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5" podUID="336f0a2d-1023-411d-9ff4-33dad5c413d5" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Oct 30 21:35:10.402483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:10.402117    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:35:10.460496 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:10.458201    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6" podUID="de5762f3-98dd-4c97-a9f7-a65698c9f271" containerName="main" probeResult="failure" output="Get \"https://10.133.0.39:8000/ready\": context deadline exceeded"
Oct 30 21:35:10.551683 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:10.551589    4522 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n" podUID="5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:10.594615 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:10.578403    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7" podUID="504b9039-7a53-4f4d-bf60-20eceb9f6d3c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:10.604485 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:10.578444    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n" podUID="d9eadf71-d6c7-400f-9c6f-bea93e8a3750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": context deadline exceeded"
Oct 30 21:35:10.614489 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:10.578479    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn" podUID="a4f4d580-1397-4f98-b232-d803802890f8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Oct 30 21:35:10.638482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:10.604765    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:35:10.638482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:10.614776    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:35:10.638482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:10.614818    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:35:11.155484 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:10.888217    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj" podUID="5870207c-906d-47f0-bb38-ca1020a0dccb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:11.163481 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:10.901232    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n" podUID="5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:11.167756 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:10.901732    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld" podUID="afd04a47-10c4-4ccf-879c-c549765a0c50" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": context deadline exceeded"
Oct 30 21:35:11.175486 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:11.036818    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk" podUID="58f59123-9a14-4cd0-8c9e-17448eae2bca" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:11.179478 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:11.149040    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:35:11.185613 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:11.185586    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:35:11.189484 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:11.185793    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:35:11.193709 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:11.193688    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:35:11.193867 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:11.193852    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:35:11.424543 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:11.410124    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5" podUID="336f0a2d-1023-411d-9ff4-33dad5c413d5" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:11.496577 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:11.496532    4522 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld" podUID="afd04a47-10c4-4ccf-879c-c549765a0c50" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/health\": context deadline exceeded"
Oct 30 21:35:11.648489 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:11.647548    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn" podUID="a4f4d580-1397-4f98-b232-d803802890f8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:11.650200 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:11.650167    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n" podUID="d9eadf71-d6c7-400f-9c6f-bea93e8a3750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:11.658133 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:11.657787    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:35:11.789561 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:11.789192    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:35:11.853676 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:11.830014    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:35:11.990401 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:11.990364    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:35:12.403483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:12.392597    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:35:12.409539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:12.406548    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:35:12.409539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:12.406609    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:35:13.202251 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:13.202213    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:18.065197 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:18.065153    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:20.135966 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:20.135924    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:20.340207 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:20.340175    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:20.535145 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:20.535105    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:20.939156 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:20.939113    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:21.125703 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:21.125671    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:21.319284 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:21.319208    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:22.787313 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:22.787281    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:24.101991 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:24.101958    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:24.816525 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:24.816489    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"]
Oct 30 21:35:24.820349 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:24.820325    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:24.881316 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:24.881289    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"]
Oct 30 21:35:24.988102 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:24.988072    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-credential-socket\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:24.988254 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:24.988111    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-workload-certs\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:24.988254 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:24.988193    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-data\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:24.988254 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:24.988228    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-workload-socket\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:24.988353 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:24.988257    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-envoy\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:24.988413 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:24.988394    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istiod-ca-cert\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:24.988449 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:24.988438    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsmdd\" (UniqueName: \"kubernetes.io/projected/66e432f7-6822-4fa3-9a9f-90cefabb0d17-kube-api-access-bsmdd\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:24.988538 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:24.988474    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-token\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:24.988593 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:24.988550    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-podinfo\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:25.089364 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.089279    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istiod-ca-cert\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:25.089364 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.089334    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsmdd\" (UniqueName: \"kubernetes.io/projected/66e432f7-6822-4fa3-9a9f-90cefabb0d17-kube-api-access-bsmdd\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:25.089364 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.089356    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-token\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:25.089677 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.089372    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-podinfo\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:25.089677 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.089424    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-credential-socket\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:25.089677 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.089454    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-workload-certs\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:25.089677 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.089516    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-data\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:25.089677 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.089548    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-workload-socket\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:25.089677 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.089592    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-envoy\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:25.090023 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.089987    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-workload-certs\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:25.090023 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.090004    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-credential-socket\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:25.090109 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.090039    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-data\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:25.090109 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.090090    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-workload-socket\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:25.090391 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.090374    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istiod-ca-cert\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:25.091812 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.091795    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-podinfo\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:25.091884 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.091868    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-envoy\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:25.160380 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.160345    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-token\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:25.160856 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.160836    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsmdd\" (UniqueName: \"kubernetes.io/projected/66e432f7-6822-4fa3-9a9f-90cefabb0d17-kube-api-access-bsmdd\") pod \"e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") " pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:25.254442 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.254408    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:25.275222 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.275195    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"]
Oct 30 21:35:25.280213 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.280195    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.348478 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.348304    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"]
Oct 30 21:35:25.392529 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.392492    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-credential-socket\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.392529 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.392542    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlrkm\" (UniqueName: \"kubernetes.io/projected/fe7de012-dd07-498f-bc46-cd733c546162-kube-api-access-nlrkm\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.392800 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.392691    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-workload-certs\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.392800 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.392743    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-istio-data\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.392913 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.392811    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe7de012-dd07-498f-bc46-cd733c546162-istiod-ca-cert\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.392913 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.392842    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe7de012-dd07-498f-bc46-cd733c546162-istio-podinfo\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.392913 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.392861    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-workload-socket\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.393080 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.392931    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-istio-envoy\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.393080 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.393003    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe7de012-dd07-498f-bc46-cd733c546162-istio-token\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.434072 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.434036    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:25.494323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.494285    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-credential-socket\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.495014 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.494898    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-credential-socket\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.495131 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.495045    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlrkm\" (UniqueName: \"kubernetes.io/projected/fe7de012-dd07-498f-bc46-cd733c546162-kube-api-access-nlrkm\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.495532 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.495511    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-workload-certs\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.496034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.495911    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-workload-certs\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.496197 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.496178    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-istio-data\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.497332 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.496641    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe7de012-dd07-498f-bc46-cd733c546162-istiod-ca-cert\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.497540 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.496550    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-istio-data\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.497540 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.497303    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe7de012-dd07-498f-bc46-cd733c546162-istiod-ca-cert\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.497749 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.497730    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe7de012-dd07-498f-bc46-cd733c546162-istio-podinfo\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.498654 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.498626    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-workload-socket\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.498788 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.498767    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-workload-socket\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.500017 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.499992    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-istio-envoy\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.502408 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.502380    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-istio-envoy\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.502772 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.502451    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe7de012-dd07-498f-bc46-cd733c546162-istio-token\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.506818 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.506789    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe7de012-dd07-498f-bc46-cd733c546162-istio-podinfo\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.554766 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.554731    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlrkm\" (UniqueName: \"kubernetes.io/projected/fe7de012-dd07-498f-bc46-cd733c546162-kube-api-access-nlrkm\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.558103 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.558066    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe7de012-dd07-498f-bc46-cd733c546162-istio-token\") pod \"e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") " pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.594700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.594665    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:25.862858 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.862818    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"]
Oct 30 21:35:25.869489 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.869441    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:35:25.869584 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.869522    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:35:25.869584 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.869550    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:35:25.983216 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.983175    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"]
Oct 30 21:35:25.987695 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:35:25.987667    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe7de012_dd07_498f_bc46_cd733c546162.slice/crio-e222a42ea87cd4af4a6c487385aed716d71950b7126ec49ca8ee4c626f222e8d WatchSource:0}: Error finding container e222a42ea87cd4af4a6c487385aed716d71950b7126ec49ca8ee4c626f222e8d: Status 404 returned error can't find the container with id e222a42ea87cd4af4a6c487385aed716d71950b7126ec49ca8ee4c626f222e8d
Oct 30 21:35:25.990336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.990303    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:35:25.990489 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.990385    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:35:25.990489 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:25.990431    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:35:26.050455 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:26.050427    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b" event={"ID":"fe7de012-dd07-498f-bc46-cd733c546162","Type":"ContainerStarted","Data":"e222a42ea87cd4af4a6c487385aed716d71950b7126ec49ca8ee4c626f222e8d"}
Oct 30 21:35:26.051986 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:26.051961    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn" event={"ID":"66e432f7-6822-4fa3-9a9f-90cefabb0d17","Type":"ContainerStarted","Data":"8822d144cf86cd159c88269a6aa450f033e21f0e8c94bfbfaa9edb80646a903e"}
Oct 30 21:35:26.052108 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:26.052003    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn" event={"ID":"66e432f7-6822-4fa3-9a9f-90cefabb0d17","Type":"ContainerStarted","Data":"a1fdcc4a8d1a863c0507e6ed4edf3cfb94f2b912134e15d9fb15f04cefd497d7"}
Oct 30 21:35:26.169870 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:26.169808    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn" podStartSLOduration=2.1697902239999998 podStartE2EDuration="2.169790224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:35:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:26.169172977 +0000 UTC m=+1435.114118338" watchObservedRunningTime="2026-10-30 21:35:26.169790224 +0000 UTC m=+1435.114735586"
Oct 30 21:35:26.434590 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:26.434499    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:26.436307 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:26.436279    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Oct 30 21:35:26.436372 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:26.436324    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn" podUID="66e432f7-6822-4fa3-9a9f-90cefabb0d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Oct 30 21:35:26.470390 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:26.470358    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:27.059330 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:27.059290    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b" event={"ID":"fe7de012-dd07-498f-bc46-cd733c546162","Type":"ContainerStarted","Data":"9aace06da24012e4d22ef9de25377b8755739b14be6996396538711c179677a7"}
Oct 30 21:35:27.180378 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:27.180325    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b" podStartSLOduration=2.180310566 podStartE2EDuration="2.180310566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:35:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:27.177707058 +0000 UTC m=+1436.122652422" watchObservedRunningTime="2026-10-30 21:35:27.180310566 +0000 UTC m=+1436.125255970"
Oct 30 21:35:27.437278 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:27.436829    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Oct 30 21:35:27.437278 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:27.436896    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn" podUID="66e432f7-6822-4fa3-9a9f-90cefabb0d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Oct 30 21:35:27.598484 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:27.597749    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:27.605621 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:27.605581    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 21:35:27.605896 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:27.605849    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b" podUID="fe7de012-dd07-498f-bc46-cd733c546162" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 21:35:27.670696 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:27.670665    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:28.146370 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:28.146288    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:28.369938 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:28.369828    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:28.437481 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:28.434508    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Oct 30 21:35:28.437481 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:28.434567    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn" podUID="66e432f7-6822-4fa3-9a9f-90cefabb0d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Oct 30 21:35:28.577780 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:28.577398    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:28.600855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:28.600821    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 21:35:28.601155 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:28.601109    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b" podUID="fe7de012-dd07-498f-bc46-cd733c546162" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 21:35:28.791346 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:28.791260    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:28.992485 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:28.991777    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:29.604426 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:29.603601    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Oct 30 21:35:29.604426 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:29.603672    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn" podUID="66e432f7-6822-4fa3-9a9f-90cefabb0d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Oct 30 21:35:29.665482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:29.625347    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 21:35:29.665482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:29.625413    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b" podUID="fe7de012-dd07-498f-bc46-cd733c546162" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 21:35:29.677373 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:29.604474    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:29.920481 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:29.917519    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:30.152914 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:30.152864    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:30.441479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:30.440976    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w"]
Oct 30 21:35:30.450713 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:30.450675    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Oct 30 21:35:30.472926 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:30.472873    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn" podUID="66e432f7-6822-4fa3-9a9f-90cefabb0d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Oct 30 21:35:30.512003 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:30.511969    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w"]
Oct 30 21:35:30.512343 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:30.512281    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w"
Oct 30 21:35:30.573768 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:30.573740    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-b25d536b\""
Oct 30 21:35:30.603483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:30.602808    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-b25d536b-dockercfg-b99n2\""
Oct 30 21:35:30.603974 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:30.603948    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 21:35:30.605190 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:30.605161    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b" podUID="fe7de012-dd07-498f-bc46-cd733c546162" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 21:35:30.616595 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:30.616446    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46c13d56-bb31-4ed5-ba61-16dc1ff17ad8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w\" (UID: \"46c13d56-bb31-4ed5-ba61-16dc1ff17ad8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w"
Oct 30 21:35:30.616595 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:30.616556    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nvk7\" (UniqueName: \"kubernetes.io/projected/46c13d56-bb31-4ed5-ba61-16dc1ff17ad8-kube-api-access-6nvk7\") pod \"payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w\" (UID: \"46c13d56-bb31-4ed5-ba61-16dc1ff17ad8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w"
Oct 30 21:35:30.720270 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:30.720173    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nvk7\" (UniqueName: \"kubernetes.io/projected/46c13d56-bb31-4ed5-ba61-16dc1ff17ad8-kube-api-access-6nvk7\") pod \"payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w\" (UID: \"46c13d56-bb31-4ed5-ba61-16dc1ff17ad8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w"
Oct 30 21:35:30.738864 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:30.738832    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46c13d56-bb31-4ed5-ba61-16dc1ff17ad8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w\" (UID: \"46c13d56-bb31-4ed5-ba61-16dc1ff17ad8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w"
Oct 30 21:35:30.743481 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:30.740064    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46c13d56-bb31-4ed5-ba61-16dc1ff17ad8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w\" (UID: \"46c13d56-bb31-4ed5-ba61-16dc1ff17ad8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w"
Oct 30 21:35:30.804390 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:30.804347    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nvk7\" (UniqueName: \"kubernetes.io/projected/46c13d56-bb31-4ed5-ba61-16dc1ff17ad8-kube-api-access-6nvk7\") pod \"payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w\" (UID: \"46c13d56-bb31-4ed5-ba61-16dc1ff17ad8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w"
Oct 30 21:35:30.866941 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:30.865635    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w"
Oct 30 21:35:31.235432 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:31.233911    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:31.354499 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:31.353855    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w"]
Oct 30 21:35:31.366844 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:35:31.366804    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c13d56_bb31_4ed5_ba61_16dc1ff17ad8.slice/crio-bdac43f117d93cde8d8002132dab0b2fab7a1443628843c80e7483e77ef8115d WatchSource:0}: Error finding container bdac43f117d93cde8d8002132dab0b2fab7a1443628843c80e7483e77ef8115d: Status 404 returned error can't find the container with id bdac43f117d93cde8d8002132dab0b2fab7a1443628843c80e7483e77ef8115d
Oct 30 21:35:31.368657 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:31.368636    4522 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:35:31.439538 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:31.434989    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Oct 30 21:35:31.439538 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:31.435043    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn" podUID="66e432f7-6822-4fa3-9a9f-90cefabb0d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Oct 30 21:35:31.463507 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:31.463019    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:31.603538 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:31.602954    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 21:35:31.603538 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:31.603028    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b" podUID="fe7de012-dd07-498f-bc46-cd733c546162" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 21:35:32.184268 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:32.184226    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w" event={"ID":"46c13d56-bb31-4ed5-ba61-16dc1ff17ad8","Type":"ContainerStarted","Data":"bdac43f117d93cde8d8002132dab0b2fab7a1443628843c80e7483e77ef8115d"}
Oct 30 21:35:32.435293 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:32.435206    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Oct 30 21:35:32.435293 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:32.435282    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn" podUID="66e432f7-6822-4fa3-9a9f-90cefabb0d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Oct 30 21:35:32.595861 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:32.595824    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 21:35:32.596045 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:32.595889    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b" podUID="fe7de012-dd07-498f-bc46-cd733c546162" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 21:35:33.278951 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:33.278913    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:33.631527 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:33.631079    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:33.634501 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:33.632190    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:33.634501 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:33.633065    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:35:33.815363 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:33.815332    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:33.816569 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:33.816521    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:33.817540 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:33.817518    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:35:33.895448 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:33.895338    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:34.171237 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.171207    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"]
Oct 30 21:35:34.180701 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.180671    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.234724 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.233772    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-9ac5c5-openshift-default-dockercfg-bnx6p\""
Oct 30 21:35:34.234884 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.234863    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"]
Oct 30 21:35:34.258776 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.258745    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twc4b\" (UniqueName: \"kubernetes.io/projected/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-kube-api-access-twc4b\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.258905 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.258835    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-data\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.258961 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.258900    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-podinfo\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.259042 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.259022    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-workload-socket\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.259106 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.259067    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-workload-certs\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.259106 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.259088    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-credential-socket\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.259208 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.259106    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-token\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.259208 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.259160    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-envoy\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.259314 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.259243    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istiod-ca-cert\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.360054 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.360022    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-podinfo\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.360531 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.360112    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-workload-socket\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.360531 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.360153    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-workload-certs\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.360531 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.360184    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-credential-socket\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.360531 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.360213    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-token\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.360531 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.360258    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-envoy\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.360531 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.360287    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istiod-ca-cert\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.360531 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.360341    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twc4b\" (UniqueName: \"kubernetes.io/projected/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-kube-api-access-twc4b\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.360531 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.360393    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-data\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.361023 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.360592    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-workload-socket\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.361023 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.360734    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-data\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.361023 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.360859    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-workload-certs\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.361023 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.360910    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-credential-socket\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.361743 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.361722    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istiod-ca-cert\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.365726 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.365699    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-envoy\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.365958 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.365927    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-podinfo\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.417727 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.417692    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-token\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.419030 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.419002    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:34.423092 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.423040    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twc4b\" (UniqueName: \"kubernetes.io/projected/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-kube-api-access-twc4b\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.495866 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.495834    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:34.615990 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.615955    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:34.937278 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.937254    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"]
Oct 30 21:35:34.939284 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:35:34.939261    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e3b1d2_3569_45a7_a6f1_26bd831bc9cd.slice/crio-9083b439980a2a16f6111fc0bb73e224976f8bcb26a39da9145d6b45a760e45e WatchSource:0}: Error finding container 9083b439980a2a16f6111fc0bb73e224976f8bcb26a39da9145d6b45a760e45e: Status 404 returned error can't find the container with id 9083b439980a2a16f6111fc0bb73e224976f8bcb26a39da9145d6b45a760e45e
Oct 30 21:35:34.941742 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.941712    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:35:34.941822 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.941775    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:35:34.941822 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:34.941804    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:35:35.210229 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:35.210186    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w" event={"ID":"46c13d56-bb31-4ed5-ba61-16dc1ff17ad8","Type":"ContainerStarted","Data":"500cc721e07027f18cbac86d6d2cd07493bbb09c9dadaf6722ece41d24121157"}
Oct 30 21:35:35.210420 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:35.210352    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w"
Oct 30 21:35:35.212036 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:35.212005    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5" event={"ID":"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd","Type":"ContainerStarted","Data":"cdf77882b0291bdaeb297649d3a6e752df70ceb1c98d0f44d39b46a68e637c27"}
Oct 30 21:35:35.212155 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:35.212056    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5" event={"ID":"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd","Type":"ContainerStarted","Data":"9083b439980a2a16f6111fc0bb73e224976f8bcb26a39da9145d6b45a760e45e"}
Oct 30 21:35:35.327483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:35.327407    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w" podStartSLOduration=1.913662135 podStartE2EDuration="5.327393939s" totalImagesPullingTime="3.413731804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:35:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:35.324966747 +0000 UTC m=+1444.269912110" watchObservedRunningTime="2026-10-30 21:35:35.327393939 +0000 UTC m=+1444.272339299"
Oct 30 21:35:35.442935 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:35.442873    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5" podStartSLOduration=1.442854347 podStartE2EDuration="1.442854347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:35:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:35.44156647 +0000 UTC m=+1444.386511829" watchObservedRunningTime="2026-10-30 21:35:35.442854347 +0000 UTC m=+1444.387799708"
Oct 30 21:35:35.502597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:35.502502    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:36.512445 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:36.512410    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 21:35:36.512967 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:36.512688    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5" podUID="76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 21:35:37.506833 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:37.506798    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 21:35:37.507145 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:37.507111    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5" podUID="76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 21:35:38.013063 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:35:38.012993    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:35:38.149730 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:38.149695    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:38.379835 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:38.379752    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:38.499879 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:38.499844    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 21:35:38.500199 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:38.500165    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5" podUID="76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 21:35:39.376617 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.376578    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:39.497496 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.496859    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 21:35:39.497496 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.496922    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5" podUID="76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 21:35:39.615525 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.612909    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"]
Oct 30 21:35:39.617758 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.617737    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.656250 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.656189    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"]
Oct 30 21:35:39.665704 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.665678    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-envoy\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.665813 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.665709    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-token\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.665813 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.665741    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-podinfo\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.665813 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.665801    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-workload-socket\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.665942 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.665835    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-data\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.665982 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.665954    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-credential-socket\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.666023 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.665994    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r9dx\" (UniqueName: \"kubernetes.io/projected/f6d41871-eb2d-4e14-90d0-77425f828f41-kube-api-access-7r9dx\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.666075 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.666034    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6d41871-eb2d-4e14-90d0-77425f828f41-istiod-ca-cert\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.666155 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.666134    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-workload-certs\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.775306 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.775269    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r9dx\" (UniqueName: \"kubernetes.io/projected/f6d41871-eb2d-4e14-90d0-77425f828f41-kube-api-access-7r9dx\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.775478 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.775348    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6d41871-eb2d-4e14-90d0-77425f828f41-istiod-ca-cert\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.775478 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.775386    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-workload-certs\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.775574 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.775556    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-envoy\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.775608 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.775595    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-token\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.775655 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.775642    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-podinfo\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.775691 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.775672    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-workload-socket\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.775723 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.775699    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-data\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.775801 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.775787    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-credential-socket\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.776259 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.776238    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-credential-socket\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.777231 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.777206    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6d41871-eb2d-4e14-90d0-77425f828f41-istiod-ca-cert\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.777518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.777499    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-workload-certs\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.778580 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.778557    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-workload-socket\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.779023 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.779002    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-data\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.779753 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.779722    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:39.780425 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.780402    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-podinfo\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.780608 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.780587    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-envoy\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.834018 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.833994    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r9dx\" (UniqueName: \"kubernetes.io/projected/f6d41871-eb2d-4e14-90d0-77425f828f41-kube-api-access-7r9dx\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.834183 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.834098    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-token\") pod \"e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") " pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:39.933078 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:39.933054    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:40.018935 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:40.018804    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:40.212015 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:40.211924    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:40.408670 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:40.408634    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"]
Oct 30 21:35:40.416110 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:35:40.416082    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6d41871_eb2d_4e14_90d0_77425f828f41.slice/crio-8e0fe082445e7e976022c296eda7e0bd630c0784e2eb5f8a94005ec1f06ccbce WatchSource:0}: Error finding container 8e0fe082445e7e976022c296eda7e0bd630c0784e2eb5f8a94005ec1f06ccbce: Status 404 returned error can't find the container with id 8e0fe082445e7e976022c296eda7e0bd630c0784e2eb5f8a94005ec1f06ccbce
Oct 30 21:35:40.419103 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:40.419054    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:35:40.419192 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:40.419138    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:35:40.419192 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:40.419180    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:35:40.508003 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:40.507965    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 21:35:40.508260 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:40.508232    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5" podUID="76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 21:35:41.249116 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:41.249077    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf" event={"ID":"f6d41871-eb2d-4e14-90d0-77425f828f41","Type":"ContainerStarted","Data":"fb2566a3f1235a4f51b6c5bb668ccdc502cef48b95238d9a9580357593435b1e"}
Oct 30 21:35:41.249303 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:41.249138    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf" event={"ID":"f6d41871-eb2d-4e14-90d0-77425f828f41","Type":"ContainerStarted","Data":"8e0fe082445e7e976022c296eda7e0bd630c0784e2eb5f8a94005ec1f06ccbce"}
Oct 30 21:35:41.465973 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:41.465917    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf" podStartSLOduration=2.465900281 podStartE2EDuration="2.465900281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:35:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:41.465143734 +0000 UTC m=+1450.410089095" watchObservedRunningTime="2026-10-30 21:35:41.465900281 +0000 UTC m=+1450.410845642"
Oct 30 21:35:41.501539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:41.498840    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 21:35:41.501539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:41.498902    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5" podUID="76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 21:35:41.933996 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:41.933958    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:41.935526 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:41.935499    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 21:35:41.935655 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:41.935549    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf" podUID="f6d41871-eb2d-4e14-90d0-77425f828f41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 21:35:42.511850 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:42.511808    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:42.512275 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:42.512196    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:42.512923 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:42.512902    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:35:42.934513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:42.934454    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 21:35:42.934683 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:42.934545    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf" podUID="f6d41871-eb2d-4e14-90d0-77425f828f41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 21:35:43.312271 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:43.312154    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:43.558401 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:43.558369    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:43.831719 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:43.831688    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb"]
Oct 30 21:35:43.835695 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:43.835673    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb"
Oct 30 21:35:43.910051 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:43.909982    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:43.933317 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:43.933269    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-6f787654\""
Oct 30 21:35:43.933514 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:43.933419    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-6f787654-dockercfg-8j26m\""
Oct 30 21:35:43.933623 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:43.933602    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 21:35:43.933677 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:43.933647    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf" podUID="f6d41871-eb2d-4e14-90d0-77425f828f41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 21:35:43.936333 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:43.936301    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb"]
Oct 30 21:35:43.960212 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:43.960183    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzdgc\" (UniqueName: \"kubernetes.io/projected/6ac2109a-ba6d-43f3-bc03-676e5decaf0c-kube-api-access-bzdgc\") pod \"payload-processing-e2e-derive-6f787654-8869d578f-4qclb\" (UID: \"6ac2109a-ba6d-43f3-bc03-676e5decaf0c\") " pod="openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb"
Oct 30 21:35:43.960379 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:43.960237    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ac2109a-ba6d-43f3-bc03-676e5decaf0c-plugins-config-volume\") pod \"payload-processing-e2e-derive-6f787654-8869d578f-4qclb\" (UID: \"6ac2109a-ba6d-43f3-bc03-676e5decaf0c\") " pod="openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb"
Oct 30 21:35:44.062481 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:44.061189    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzdgc\" (UniqueName: \"kubernetes.io/projected/6ac2109a-ba6d-43f3-bc03-676e5decaf0c-kube-api-access-bzdgc\") pod \"payload-processing-e2e-derive-6f787654-8869d578f-4qclb\" (UID: \"6ac2109a-ba6d-43f3-bc03-676e5decaf0c\") " pod="openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb"
Oct 30 21:35:44.062481 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:44.061286    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ac2109a-ba6d-43f3-bc03-676e5decaf0c-plugins-config-volume\") pod \"payload-processing-e2e-derive-6f787654-8869d578f-4qclb\" (UID: \"6ac2109a-ba6d-43f3-bc03-676e5decaf0c\") " pod="openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb"
Oct 30 21:35:44.069479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:44.068181    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ac2109a-ba6d-43f3-bc03-676e5decaf0c-plugins-config-volume\") pod \"payload-processing-e2e-derive-6f787654-8869d578f-4qclb\" (UID: \"6ac2109a-ba6d-43f3-bc03-676e5decaf0c\") " pod="openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb"
Oct 30 21:35:44.145557 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:44.145341    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:44.155675 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:44.155643    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzdgc\" (UniqueName: \"kubernetes.io/projected/6ac2109a-ba6d-43f3-bc03-676e5decaf0c-kube-api-access-bzdgc\") pod \"payload-processing-e2e-derive-6f787654-8869d578f-4qclb\" (UID: \"6ac2109a-ba6d-43f3-bc03-676e5decaf0c\") " pod="openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb"
Oct 30 21:35:44.449545 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:44.449515    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb"
Oct 30 21:35:44.727403 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:44.727286    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:44.847290 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:44.847265    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb"]
Oct 30 21:35:44.849313 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:35:44.849285    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ac2109a_ba6d_43f3_bc03_676e5decaf0c.slice/crio-2ef51d91e306cbd581c2ef97778ff8cbbac99f061a271f5e7bbfbe85c7e87039 WatchSource:0}: Error finding container 2ef51d91e306cbd581c2ef97778ff8cbbac99f061a271f5e7bbfbe85c7e87039: Status 404 returned error can't find the container with id 2ef51d91e306cbd581c2ef97778ff8cbbac99f061a271f5e7bbfbe85c7e87039
Oct 30 21:35:44.933730 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:44.933702    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 21:35:44.933848 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:44.933759    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf" podUID="f6d41871-eb2d-4e14-90d0-77425f828f41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 21:35:45.273920 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:45.273884    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb" event={"ID":"6ac2109a-ba6d-43f3-bc03-676e5decaf0c","Type":"ContainerStarted","Data":"2ec9eae9745f309fc82331f195b892a4dc860362468fc34226fa0efb95e9c20f"}
Oct 30 21:35:45.274098 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:45.273948    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb"
Oct 30 21:35:45.274098 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:45.273967    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb" event={"ID":"6ac2109a-ba6d-43f3-bc03-676e5decaf0c","Type":"ContainerStarted","Data":"2ef51d91e306cbd581c2ef97778ff8cbbac99f061a271f5e7bbfbe85c7e87039"}
Oct 30 21:35:45.933553 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:45.933523    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 21:35:45.933928 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:45.933573    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf" podUID="f6d41871-eb2d-4e14-90d0-77425f828f41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 21:35:46.220494 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:46.220400    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w"
Oct 30 21:35:46.335084 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:46.335029    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb" podStartSLOduration=3.335012998 podStartE2EDuration="3.335012998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:35:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:45.40487454 +0000 UTC m=+1454.349819907" watchObservedRunningTime="2026-10-30 21:35:46.335012998 +0000 UTC m=+1455.279958360"
Oct 30 21:35:46.933560 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:46.933520    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 21:35:46.934059 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:46.933577    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf" podUID="f6d41871-eb2d-4e14-90d0-77425f828f41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 21:35:47.691612 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:47.691573    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:47.938412 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:47.938381    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:47.938871 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:47.938778    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:47.939562 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:47.939544    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:35:48.384671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:48.384638    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:49.012710 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:49.012672    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:49.214097 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:49.214063    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:49.953887 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:49.953758    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:50.343481 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:50.343371    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:50.581393 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:50.581354    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:51.384963 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:51.384924    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6" podUID="de5762f3-98dd-4c97-a9f7-a65698c9f271" containerName="main" probeResult="failure" output="Get \"https://10.133.0.39:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:51.412700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:51.411749    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n" podUID="d9eadf71-d6c7-400f-9c6f-bea93e8a3750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": context deadline exceeded"
Oct 30 21:35:51.454609 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:51.454564    4522 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld" podUID="afd04a47-10c4-4ccf-879c-c549765a0c50" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:51.459607 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:51.459532    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n" podUID="5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:51.567607 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:51.567544    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld" podUID="afd04a47-10c4-4ccf-879c-c549765a0c50" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:51.651562 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:51.650658    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn" podUID="a4f4d580-1397-4f98-b232-d803802890f8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Oct 30 21:35:51.796616 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:51.796569    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj" podUID="5870207c-906d-47f0-bb38-ca1020a0dccb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:51.990996 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:51.990951    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk" podUID="58f59123-9a14-4cd0-8c9e-17448eae2bca" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:52.203143 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:52.203076    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7" podUID="504b9039-7a53-4f4d-bf60-20eceb9f6d3c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:52.402211 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:52.402028    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6" podUID="de5762f3-98dd-4c97-a9f7-a65698c9f271" containerName="main" probeResult="failure" output="Get \"https://10.133.0.39:8000/ready\": context deadline exceeded"
Oct 30 21:35:52.451511 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:52.412382    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:35:52.451511 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:52.414449    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n" podUID="d9eadf71-d6c7-400f-9c6f-bea93e8a3750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": context deadline exceeded"
Oct 30 21:35:52.451511 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:52.414785    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:35:52.460761 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:52.411964    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5" podUID="336f0a2d-1023-411d-9ff4-33dad5c413d5" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Oct 30 21:35:52.461497 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:52.460969    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n" podUID="5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:52.462108 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:52.462088    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:35:52.624525 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:52.582903    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld" podUID="afd04a47-10c4-4ccf-879c-c549765a0c50" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": context deadline exceeded"
Oct 30 21:35:52.624525 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:52.583345    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:35:52.705483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:52.682037    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn" podUID="a4f4d580-1397-4f98-b232-d803802890f8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:52.705483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:52.682490    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:35:52.816488 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:52.805559    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj" podUID="5870207c-906d-47f0-bb38-ca1020a0dccb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:52.816488 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:52.806917    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:35:53.025211 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:53.025114    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk" podUID="58f59123-9a14-4cd0-8c9e-17448eae2bca" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:53.061505 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:53.056684    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:35:53.220494 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:53.217678    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7" podUID="504b9039-7a53-4f4d-bf60-20eceb9f6d3c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": context deadline exceeded"
Oct 30 21:35:53.401537 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:53.361124    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:35:53.556483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:53.531778    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n" podUID="5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:53.653901 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:53.626631    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld" podUID="afd04a47-10c4-4ccf-879c-c549765a0c50" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:53.653901 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:53.537302    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6" podUID="de5762f3-98dd-4c97-a9f7-a65698c9f271" containerName="main" probeResult="failure" output="Get \"https://10.133.0.39:8000/ready\": context deadline exceeded"
Oct 30 21:35:53.653901 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:53.555834    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n" podUID="d9eadf71-d6c7-400f-9c6f-bea93e8a3750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": context deadline exceeded"
Oct 30 21:35:53.706484 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:53.692872    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn" podUID="a4f4d580-1397-4f98-b232-d803802890f8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:53.769482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:53.715196    4522 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6" podUID="de5762f3-98dd-4c97-a9f7-a65698c9f271" containerName="main" probeResult="failure" output="Get \"https://10.133.0.39:8000/health\": context deadline exceeded"
Oct 30 21:35:53.861088 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:53.861039    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj" podUID="5870207c-906d-47f0-bb38-ca1020a0dccb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:54.094484 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:54.092900    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk" podUID="58f59123-9a14-4cd0-8c9e-17448eae2bca" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:54.218490 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:54.217880    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7" podUID="504b9039-7a53-4f4d-bf60-20eceb9f6d3c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:54.575484 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:54.550480    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5" podUID="336f0a2d-1023-411d-9ff4-33dad5c413d5" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Oct 30 21:35:54.740483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:54.602090    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n" podUID="5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:54.765482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:54.608351    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:35:54.818639 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:54.632627    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld" podUID="afd04a47-10c4-4ccf-879c-c549765a0c50" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:54.822571 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:54.648038    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n" podUID="d9eadf71-d6c7-400f-9c6f-bea93e8a3750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": context deadline exceeded"
Oct 30 21:35:54.847615 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:54.697337    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn" podUID="a4f4d580-1397-4f98-b232-d803802890f8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:54.847908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:54.847885    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:35:54.891767 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:54.891724    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj" podUID="5870207c-906d-47f0-bb38-ca1020a0dccb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:54.987693 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:54.987649    4522 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj" podUID="5870207c-906d-47f0-bb38-ca1020a0dccb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/health\": context deadline exceeded"
Oct 30 21:35:55.102965 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:55.102865    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk" podUID="58f59123-9a14-4cd0-8c9e-17448eae2bca" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:55.154483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:55.128348    4522 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7" podUID="504b9039-7a53-4f4d-bf60-20eceb9f6d3c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/health\": context deadline exceeded"
Oct 30 21:35:55.333646 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:55.333591    4522 prober.go:122] "Probe failed" probeType="Liveness" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-9g42s" podUID="e7f278ca-5480-4bcf-a935-89b7a23f16dc" containerName="cert-manager-webhook" probeResult="failure" output="Get \"http://10.133.0.18:6080/livez\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:55.567303 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:55.564562    4522 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn" podUID="a4f4d580-1397-4f98-b232-d803802890f8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:55.591720 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:55.591540    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:55.642767 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:55.642715    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6" podUID="de5762f3-98dd-4c97-a9f7-a65698c9f271" containerName="main" probeResult="failure" output="Get \"https://10.133.0.39:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:55.716565 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:55.714543    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5" podUID="336f0a2d-1023-411d-9ff4-33dad5c413d5" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:55.716565 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:55.715282    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:35:55.756483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:55.740851    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n" podUID="5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:55.867536 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:55.861532    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn" podUID="a4f4d580-1397-4f98-b232-d803802890f8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:55.867536 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:55.861911    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld" podUID="afd04a47-10c4-4ccf-879c-c549765a0c50" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:55.867536 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:55.862190    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n" podUID="d9eadf71-d6c7-400f-9c6f-bea93e8a3750" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:55.880501 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:55.877185    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:35:55.940491 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:55.940105    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj" podUID="5870207c-906d-47f0-bb38-ca1020a0dccb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": context deadline exceeded"
Oct 30 21:35:56.017354 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:55.998348    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:35:56.026573 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:56.026539    4522 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk" podUID="58f59123-9a14-4cd0-8c9e-17448eae2bca" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:35:56.094114 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:56.094084    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:35:56.095080 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:56.095020    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:35:56.098126 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:56.096165    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:35:56.098942 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:56.098924    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:35:56.118438 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:56.118380    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:35:56.282570 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:56.282543    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb"
Oct 30 21:35:57.251362 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:57.251321    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:58.725647 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:58.725615    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:58.922115 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:58.922085    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:59.051621 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.051539    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"]
Oct 30 21:35:59.056454 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.056426    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.106627 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.106602    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:59.108352 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.108331    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 21:35:59.108479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.108414    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6b27n\""
Oct 30 21:35:59.140641 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.140611    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.140811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.140790    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.140901 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.140837    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.140983 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.140961    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.141019 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.140999    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dds5\" (UniqueName: \"kubernetes.io/projected/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-kube-api-access-9dds5\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.141051 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.141021    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.141086 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.141054    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.157496 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.157396    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 21:35:59.160652 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.160631    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"]
Oct 30 21:35:59.208446 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.208424    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 21:35:59.243433 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.243404    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.245753 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.244093    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.246543 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.246516    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.246676 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.246567    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.246676 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.246671    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.246801 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.246706    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dds5\" (UniqueName: \"kubernetes.io/projected/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-kube-api-access-9dds5\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.246801 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.246737    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.247610 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.247585    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.248760 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.248738    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.249510 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.249491    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.249579 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.249565    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.249836 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.249821    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.299294 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.299266    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.302807 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.302736    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dds5\" (UniqueName: \"kubernetes.io/projected/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-kube-api-access-9dds5\") pod \"istiod-openshift-gateway-7ddd9cfdc8-mht5g\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.370134 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.370112    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:35:59.809888 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:35:59.809863    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"]
Oct 30 21:35:59.811505 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:35:59.811474    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7763dd_12cc_4939_a7bf_f0bfdeef3952.slice/crio-3b2f658ffa2f27596ec93b577dc333a683ce37d8b1f7c5e985e4cfa0984b856d WatchSource:0}: Error finding container 3b2f658ffa2f27596ec93b577dc333a683ce37d8b1f7c5e985e4cfa0984b856d: Status 404 returned error can't find the container with id 3b2f658ffa2f27596ec93b577dc333a683ce37d8b1f7c5e985e4cfa0984b856d
Oct 30 21:36:00.176387 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:00.176342    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g" event={"ID":"3e7763dd-12cc-4939-a7bf-f0bfdeef3952","Type":"ContainerStarted","Data":"3b2f658ffa2f27596ec93b577dc333a683ce37d8b1f7c5e985e4cfa0984b856d"}
Oct 30 21:36:02.008879 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:02.008843    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:02.205159 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:02.205127    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:02.411046 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:02.410956    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:03.832811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:03.830121    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:36:03.832811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:03.830205    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:36:04.202827 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:04.202785    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g" event={"ID":"3e7763dd-12cc-4939-a7bf-f0bfdeef3952","Type":"ContainerStarted","Data":"18846f93c6ab1adef4ff20b93125efdd9fe9121585df1a4440b1fed699754435"}
Oct 30 21:36:04.203017 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:04.202842    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:36:04.204668 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:04.204640    4522 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-mht5g container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:36:04.204778 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:04.204690    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g" podUID="3e7763dd-12cc-4939-a7bf-f0bfdeef3952" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:36:04.409430 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:04.409384    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g" podStartSLOduration=1.394217276 podStartE2EDuration="5.409371493s" totalImagesPullingTime="4.015154217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:35:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:36:04.367414072 +0000 UTC m=+1473.312359431" watchObservedRunningTime="2026-10-30 21:36:04.409371493 +0000 UTC m=+1473.354316853"
Oct 30 21:36:05.208767 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:05.208731    4522 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-mht5g container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:36:05.209264 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:05.208801    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g" podUID="3e7763dd-12cc-4939-a7bf-f0bfdeef3952" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:36:07.644543 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:07.644505    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:07.988402 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:36:07.988368    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:36:08.209383 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:08.209350    4522 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-mht5g container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:36:08.209553 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:08.209407    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g" podUID="3e7763dd-12cc-4939-a7bf-f0bfdeef3952" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:36:08.557654 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:08.557624    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:09.554135 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:09.554108    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:09.754322 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:09.754292    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:10.883107 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:10.883067    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"]
Oct 30 21:36:10.888326 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:10.888301    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:10.992972 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:10.992940    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"]
Oct 30 21:36:11.021513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.021480    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4xnz\" (UniqueName: \"kubernetes.io/projected/50f3c6ee-4557-489f-a400-c9350be38799-kube-api-access-v4xnz\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.021654 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.021526    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50f3c6ee-4557-489f-a400-c9350be38799-istiod-ca-cert\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.021654 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.021555    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-credential-socket\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.021747 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.021689    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-istio-data\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.021794 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.021745    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50f3c6ee-4557-489f-a400-c9350be38799-istio-token\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.021872 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.021855    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-workload-socket\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.021991 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.021972    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-workload-certs\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.022076 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.022062    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50f3c6ee-4557-489f-a400-c9350be38799-istio-podinfo\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.022180 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.022167    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-istio-envoy\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.122882 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.122851    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-istio-envoy\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.123057 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.122909    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4xnz\" (UniqueName: \"kubernetes.io/projected/50f3c6ee-4557-489f-a400-c9350be38799-kube-api-access-v4xnz\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.123057 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.122933    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50f3c6ee-4557-489f-a400-c9350be38799-istiod-ca-cert\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.123057 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.122951    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-credential-socket\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.123057 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.122972    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-istio-data\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.123057 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.122997    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50f3c6ee-4557-489f-a400-c9350be38799-istio-token\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.123057 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.123055    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-workload-socket\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.123363 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.123148    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-workload-certs\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.123363 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.123233    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50f3c6ee-4557-489f-a400-c9350be38799-istio-podinfo\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.123363 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.123338    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-credential-socket\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.123561 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.123364    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-istio-data\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.123650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.123620    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-workload-socket\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.123792 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.123674    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-workload-certs\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.123792 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.123785    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50f3c6ee-4557-489f-a400-c9350be38799-istiod-ca-cert\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.125096 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.125076    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-istio-envoy\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.125573 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.125555    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50f3c6ee-4557-489f-a400-c9350be38799-istio-podinfo\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.179258 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.179236    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50f3c6ee-4557-489f-a400-c9350be38799-istio-token\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.179377 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.179337    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4xnz\" (UniqueName: \"kubernetes.io/projected/50f3c6ee-4557-489f-a400-c9350be38799-kube-api-access-v4xnz\") pod \"e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") " pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.200825 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.200798    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:11.209617 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.209594    4522 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-mht5g container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:36:11.209713 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.209633    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g" podUID="3e7763dd-12cc-4939-a7bf-f0bfdeef3952" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:36:11.550723 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.550646    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:11.646275 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.646242    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"]
Oct 30 21:36:11.646707 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:36:11.646670    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f3c6ee_4557_489f_a400_c9350be38799.slice/crio-4892855f85ab5c9d9a7d537bd691f6215d6efdf912417dc58b3b41d189173a22 WatchSource:0}: Error finding container 4892855f85ab5c9d9a7d537bd691f6215d6efdf912417dc58b3b41d189173a22: Status 404 returned error can't find the container with id 4892855f85ab5c9d9a7d537bd691f6215d6efdf912417dc58b3b41d189173a22
Oct 30 21:36:11.649399 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.649365    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:36:11.649499 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.649431    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:36:11.649499 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.649478    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:36:11.767248 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:11.767206    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:12.249162 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:12.249130    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb" event={"ID":"50f3c6ee-4557-489f-a400-c9350be38799","Type":"ContainerStarted","Data":"62ef7a536c90f667b78a48f793f049b5513d34a0b755458c683459ebe6f40cc8"}
Oct 30 21:36:12.249545 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:12.249181    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb" event={"ID":"50f3c6ee-4557-489f-a400-c9350be38799","Type":"ContainerStarted","Data":"4892855f85ab5c9d9a7d537bd691f6215d6efdf912417dc58b3b41d189173a22"}
Oct 30 21:36:12.303942 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:12.303868    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:12.373567 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:12.373502    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb" podStartSLOduration=2.373483347 podStartE2EDuration="2.373483347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:36:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:36:12.36900523 +0000 UTC m=+1481.313950591" watchObservedRunningTime="2026-10-30 21:36:12.373483347 +0000 UTC m=+1481.318428710"
Oct 30 21:36:12.509154 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:12.509058    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:12.712241 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:12.712204    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:13.214053 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:13.214010    4522 patch_prober.go:29] interesting pod/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 21:36:13.214245 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:13.214077    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb" podUID="50f3c6ee-4557-489f-a400-c9350be38799" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 21:36:13.218107 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:13.218084    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:14.202038 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:14.201994    4522 patch_prober.go:29] interesting pod/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 21:36:14.202665 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:14.202620    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb" podUID="50f3c6ee-4557-489f-a400-c9350be38799" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 21:36:14.214690 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:14.214651    4522 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-mht5g container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:36:14.214920 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:14.214896    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g" podUID="3e7763dd-12cc-4939-a7bf-f0bfdeef3952" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:36:14.953355 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:14.953319    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:15.209544 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:15.205568    4522 patch_prober.go:29] interesting pod/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 21:36:15.209544 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:15.205625    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb" podUID="50f3c6ee-4557-489f-a400-c9350be38799" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 21:36:16.217501 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:16.212475    4522 patch_prober.go:29] interesting pod/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 21:36:16.217501 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:16.212573    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb" podUID="50f3c6ee-4557-489f-a400-c9350be38799" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 21:36:17.211386 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:17.210801    4522 patch_prober.go:29] interesting pod/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 21:36:17.211386 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:17.210861    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb" podUID="50f3c6ee-4557-489f-a400-c9350be38799" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 21:36:17.215673 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:17.215647    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:36:17.452207 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:17.452177    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:18.201156 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:18.201119    4522 patch_prober.go:29] interesting pod/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Oct 30 21:36:18.201369 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:18.201184    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb" podUID="50f3c6ee-4557-489f-a400-c9350be38799" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Oct 30 21:36:19.205615 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.205584    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:19.206071 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.205975    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:19.206552 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.206533    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:36:19.554632 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.554549    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"]
Oct 30 21:36:19.558615 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.558590    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.626049 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.626015    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"]
Oct 30 21:36:19.679071 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.679036    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-podinfo\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.679386 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.679358    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-envoy\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.679526 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.679395    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-workload-socket\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.679526 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.679422    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6qtc\" (UniqueName: \"kubernetes.io/projected/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-kube-api-access-j6qtc\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.679526 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.679443    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-token\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.679526 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.679514    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-credential-socket\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.679733 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.679594    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-data\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.679827 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.679801    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-workload-certs\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.679923 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.679904    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istiod-ca-cert\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.781578 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.781553    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-envoy\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.781700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.781585    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-workload-socket\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.781700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.781609    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6qtc\" (UniqueName: \"kubernetes.io/projected/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-kube-api-access-j6qtc\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.781700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.781630    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-token\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.781700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.781686    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-credential-socket\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.781906 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.781711    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-data\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.781906 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.781850    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-workload-certs\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.782023 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.781927    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istiod-ca-cert\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.782023 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.782007    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-podinfo\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.782114 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.782072    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-workload-socket\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.782215 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.782187    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-credential-socket\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.782436 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.782412    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-data\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.782517 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.782487    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-workload-certs\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.782678 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.782658    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istiod-ca-cert\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.783872 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.783853    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-envoy\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.784254 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.784235    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-podinfo\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.839739 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.839692    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-token\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.839815 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.839765    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6qtc\" (UniqueName: \"kubernetes.io/projected/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-kube-api-access-j6qtc\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:19.871804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:19.871782    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:20.299504 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:20.299452    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"]
Oct 30 21:36:20.300096 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:36:20.300070    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ffe736d_1fe7_4ad2_8ddc_6868f6531ba9.slice/crio-479ec21993f0a28510963a3224487342a0be5fa069008dce380d0cca97d81a08 WatchSource:0}: Error finding container 479ec21993f0a28510963a3224487342a0be5fa069008dce380d0cca97d81a08: Status 404 returned error can't find the container with id 479ec21993f0a28510963a3224487342a0be5fa069008dce380d0cca97d81a08
Oct 30 21:36:20.302753 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:20.302706    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:36:20.302858 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:20.302782    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:36:20.302858 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:20.302809    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:36:21.320985 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:21.320943    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l" event={"ID":"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9","Type":"ContainerStarted","Data":"d11a6680b1fe6310dd2fb3b26670bfcfe559876c543a9f465ff3f38f89811097"}
Oct 30 21:36:21.321487 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:21.321015    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l" event={"ID":"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9","Type":"ContainerStarted","Data":"479ec21993f0a28510963a3224487342a0be5fa069008dce380d0cca97d81a08"}
Oct 30 21:36:21.512360 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:21.512288    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l" podStartSLOduration=2.512272561 podStartE2EDuration="2.512272561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:36:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:36:21.509673956 +0000 UTC m=+1490.454619316" watchObservedRunningTime="2026-10-30 21:36:21.512272561 +0000 UTC m=+1490.457217996"
Oct 30 21:36:21.872054 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:21.872022    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:21.873480 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:21.873429    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 21:36:21.873624 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:21.873525    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l" podUID="3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 21:36:22.002030 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:22.000952    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:22.215523 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:22.211382    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:22.872120 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:22.872083    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 21:36:22.872519 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:22.872141    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l" podUID="3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 21:36:23.873508 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:23.873430    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 21:36:23.873989 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:23.873546    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l" podUID="3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 21:36:24.547087 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.547038    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:24.759494 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.759440    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"]
Oct 30 21:36:24.771790 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.771756    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.856182 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.855836    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-workload-socket\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.856182 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.855891    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d537bd9-741d-448c-83ac-a0300dcc94a6-istiod-ca-cert\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.856182 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.856040    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-envoy\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.856182 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.856102    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-workload-certs\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.856415 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.856186    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-token\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.856415 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.856257    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-podinfo\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.856415 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.856359    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-data\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.856533 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.856425    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkjpf\" (UniqueName: \"kubernetes.io/projected/8d537bd9-741d-448c-83ac-a0300dcc94a6-kube-api-access-xkjpf\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.856533 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.856501    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-credential-socket\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.872700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.872672    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 21:36:24.872830 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.872714    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l" podUID="3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 21:36:24.957736 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.957701    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-envoy\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.958252 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.957775    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-workload-certs\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.958252 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.957805    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-token\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.958252 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.957877    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-podinfo\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.958252 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.957925    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-data\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.958252 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.957993    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkjpf\" (UniqueName: \"kubernetes.io/projected/8d537bd9-741d-448c-83ac-a0300dcc94a6-kube-api-access-xkjpf\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.958252 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.958072    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-credential-socket\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.958252 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.958165    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-workload-socket\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.958252 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.958204    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d537bd9-741d-448c-83ac-a0300dcc94a6-istiod-ca-cert\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.959518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.959062    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-workload-certs\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.959518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.959155    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d537bd9-741d-448c-83ac-a0300dcc94a6-istiod-ca-cert\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.959518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.959314    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-data\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.959798 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.959538    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-credential-socket\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.959798 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.959790    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-workload-socket\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.961878 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.961592    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-envoy\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.961878 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.961775    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-podinfo\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:24.983521 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:24.983495    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"]
Oct 30 21:36:25.018382 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:25.018318    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkjpf\" (UniqueName: \"kubernetes.io/projected/8d537bd9-741d-448c-83ac-a0300dcc94a6-kube-api-access-xkjpf\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:25.023336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:25.023310    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-token\") pod \"e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") " pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:25.110535 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:25.109998    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:25.556149 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:25.556124    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"]
Oct 30 21:36:25.557973 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:36:25.557942    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d537bd9_741d_448c_83ac_a0300dcc94a6.slice/crio-2f2c246aa0caaeaa4db9fadd26f46796bb5a7f20ecf8be54a5bdec85e19bb87c WatchSource:0}: Error finding container 2f2c246aa0caaeaa4db9fadd26f46796bb5a7f20ecf8be54a5bdec85e19bb87c: Status 404 returned error can't find the container with id 2f2c246aa0caaeaa4db9fadd26f46796bb5a7f20ecf8be54a5bdec85e19bb87c
Oct 30 21:36:25.560571 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:25.560530    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:36:25.560685 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:25.560603    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:36:25.560685 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:25.560642    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:36:25.872952 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:25.872872    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 21:36:25.872952 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:25.872922    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l" podUID="3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 21:36:26.353078 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:26.353045    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn" event={"ID":"8d537bd9-741d-448c-83ac-a0300dcc94a6","Type":"ContainerStarted","Data":"7486a0c8737f1101fe05e95f918ebc171d9a0e5f2e30f027dc6211c9da1de026"}
Oct 30 21:36:26.353499 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:26.353094    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn" event={"ID":"8d537bd9-741d-448c-83ac-a0300dcc94a6","Type":"ContainerStarted","Data":"2f2c246aa0caaeaa4db9fadd26f46796bb5a7f20ecf8be54a5bdec85e19bb87c"}
Oct 30 21:36:26.873491 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:26.873432    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 21:36:26.873663 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:26.873501    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l" podUID="3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 21:36:26.924974 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:26.924933    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:27.122428 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:27.121706    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:27.123470 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:27.123435    4522 patch_prober.go:29] interesting pod/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:36:27.123649 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:27.123528    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn" podUID="8d537bd9-741d-448c-83ac-a0300dcc94a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Oct 30 21:36:27.962840 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:27.962755    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:27.963765 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:27.963736    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:27.964413 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:27.964393    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:36:28.111856 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:28.111816    4522 patch_prober.go:29] interesting pod/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:36:28.112061 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:28.111877    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn" podUID="8d537bd9-741d-448c-83ac-a0300dcc94a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Oct 30 21:36:28.179802 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:28.179751    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn" podStartSLOduration=4.179737219 podStartE2EDuration="4.179737219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:36:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:36:26.51176462 +0000 UTC m=+1495.456709983" watchObservedRunningTime="2026-10-30 21:36:28.179737219 +0000 UTC m=+1497.124682581"
Oct 30 21:36:29.112481 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:29.112055    4522 patch_prober.go:29] interesting pod/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:36:29.112481 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:29.112111    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn" podUID="8d537bd9-741d-448c-83ac-a0300dcc94a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Oct 30 21:36:29.497494 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:29.496146    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:36:30.112628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:30.112588    4522 patch_prober.go:29] interesting pod/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:36:30.113132 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:30.112647    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn" podUID="8d537bd9-741d-448c-83ac-a0300dcc94a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Oct 30 21:36:31.151483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:31.134020    4522 patch_prober.go:29] interesting pod/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:36:31.151483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:31.134081    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn" podUID="8d537bd9-741d-448c-83ac-a0300dcc94a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Oct 30 21:36:31.673254 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:31.673024    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:36:31.690204 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:31.690176    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:36:32.165552 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:32.134588    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk" podUID="58f59123-9a14-4cd0-8c9e-17448eae2bca" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:36:32.165552 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:32.135588    4522 patch_prober.go:29] interesting pod/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:36:32.165552 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:32.135632    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn" podUID="8d537bd9-741d-448c-83ac-a0300dcc94a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Oct 30 21:36:32.324482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:32.323629    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:32.611482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:32.610370    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:32.611482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:32.610893    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7" podUID="504b9039-7a53-4f4d-bf60-20eceb9f6d3c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:36:32.734482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:32.734062    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn" podUID="a4f4d580-1397-4f98-b232-d803802890f8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:36:33.068535 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:33.068441    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:33.116329 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:33.116292    4522 patch_prober.go:29] interesting pod/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:36:33.116617 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:33.116585    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn" podUID="8d537bd9-741d-448c-83ac-a0300dcc94a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Oct 30 21:36:34.678756 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.678718    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"]
Oct 30 21:36:34.682997 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.682974    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.702064 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.702031    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-credential-socket\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.702169 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.702120    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-data\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.702169 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.702152    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-podinfo\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.702261 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.702245    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istiod-ca-cert\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.702325 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.702309    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-workload-socket\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.702360 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.702339    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-workload-certs\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.702399 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.702385    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-token\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.702440 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.702426    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-envoy\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.702510 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.702495    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dws5\" (UniqueName: \"kubernetes.io/projected/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-kube-api-access-8dws5\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.748014 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.747899    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"]
Oct 30 21:36:34.811686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.803503    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-credential-socket\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.811686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.803593    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-data\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.811686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.803626    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-podinfo\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.811686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.803725    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istiod-ca-cert\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.811686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.806685    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istiod-ca-cert\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.811686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.807370    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-credential-socket\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.811686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.807494    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-data\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.811686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.807554    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-workload-socket\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.811686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.810714    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-workload-certs\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.811686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.810659    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-workload-socket\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.811686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.811238    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-workload-certs\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.811686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.811340    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-token\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.811686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.811382    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-envoy\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.811686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.811441    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dws5\" (UniqueName: \"kubernetes.io/projected/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-kube-api-access-8dws5\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.824893 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.824860    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-podinfo\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.825516 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.825444    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-envoy\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.867607 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.867559    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-token\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:34.867719 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:34.867699    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dws5\" (UniqueName: \"kubernetes.io/projected/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-kube-api-access-8dws5\") pod \"e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") " pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:35.002985 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:35.002901    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:35.155735 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:35.155645    4522 patch_prober.go:29] interesting pod/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:36:35.155916 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:35.155752    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn" podUID="8d537bd9-741d-448c-83ac-a0300dcc94a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:36:35.199588 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:35.199555    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:35.200717 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:35.200690    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:35.201718 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:35.201697    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:36:35.501570 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:35.501530    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"]
Oct 30 21:36:35.501745 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:36:35.501722    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c9e599f_fc25_4057_b762_f2a2c53ee3fd.slice/crio-21d52318550e4c129e727cc0e13e6da67fdbf4bc6d8e98d7b333986e69a58b1e WatchSource:0}: Error finding container 21d52318550e4c129e727cc0e13e6da67fdbf4bc6d8e98d7b333986e69a58b1e: Status 404 returned error can't find the container with id 21d52318550e4c129e727cc0e13e6da67fdbf4bc6d8e98d7b333986e69a58b1e
Oct 30 21:36:35.505160 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:35.505113    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:36:35.505263 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:35.505210    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:36:35.505307 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:35.505262    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:36:35.592270 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:35.591950    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl" event={"ID":"2c9e599f-fc25-4057-b762-f2a2c53ee3fd","Type":"ContainerStarted","Data":"f66ef876b50d6edc1ce2348ab79a824ce9962c4e79c78b83c753ad3d7b08055b"}
Oct 30 21:36:35.592270 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:35.592024    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl" event={"ID":"2c9e599f-fc25-4057-b762-f2a2c53ee3fd","Type":"ContainerStarted","Data":"21d52318550e4c129e727cc0e13e6da67fdbf4bc6d8e98d7b333986e69a58b1e"}
Oct 30 21:36:35.713055 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:35.712969    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl" podStartSLOduration=1.712921283 podStartE2EDuration="1.712921283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:36:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:36:35.710084948 +0000 UTC m=+1504.655030334" watchObservedRunningTime="2026-10-30 21:36:35.712921283 +0000 UTC m=+1504.657866642"
Oct 30 21:36:36.003627 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:36.003588    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:36.005009 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:36.004983    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 21:36:36.005163 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:36.005056    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl" podUID="2c9e599f-fc25-4057-b762-f2a2c53ee3fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 21:36:37.010944 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:37.010903    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 21:36:37.011447 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:37.010968    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl" podUID="2c9e599f-fc25-4057-b762-f2a2c53ee3fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 21:36:37.511479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:37.511044    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:38.006480 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:38.005822    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 21:36:38.006480 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:38.005894    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl" podUID="2c9e599f-fc25-4057-b762-f2a2c53ee3fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 21:36:38.013742 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:36:38.013707    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:36:39.008809 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:39.007868    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 21:36:39.008809 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:39.007935    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl" podUID="2c9e599f-fc25-4057-b762-f2a2c53ee3fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 21:36:40.006482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:40.005877    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 21:36:40.006482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:40.005955    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl" podUID="2c9e599f-fc25-4057-b762-f2a2c53ee3fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 21:36:41.010504 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:41.007825    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 21:36:41.010504 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:41.007882    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl" podUID="2c9e599f-fc25-4057-b762-f2a2c53ee3fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 21:36:42.003776 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:42.003740    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 21:36:42.003955 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:42.003802    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl" podUID="2c9e599f-fc25-4057-b762-f2a2c53ee3fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 21:36:42.399937 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:42.399824    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:43.007276 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:43.007244    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:43.007571 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:43.007549    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:43.008166 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:43.008150    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:36:47.051068 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:47.051023    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:51.752754 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:51.752721    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:55.363980 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.363942    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"]
Oct 30 21:36:55.367994 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.367971    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.419141 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.419115    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6bm8h\""
Oct 30 21:36:55.424686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.424664    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a71a4dcb-4c6d-4846-a804-69032ee0c726-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.424795 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.424777    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.424835 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.424822    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.424868 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.424839    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.424924 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.424869    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.424968 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.424928    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.425086 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.425070    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.425138 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.425127    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgtmj\" (UniqueName: \"kubernetes.io/projected/a71a4dcb-4c6d-4846-a804-69032ee0c726-kube-api-access-kgtmj\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.425186 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.425147    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.526014 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.525983    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.526143 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.526051    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a71a4dcb-4c6d-4846-a804-69032ee0c726-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.526143 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.526119    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.526238 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.526158    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.526238 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.526194    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.526392 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.526241    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.526392 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.526273    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.526392 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.526321    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.526392 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.526364    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.526619 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.526433    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgtmj\" (UniqueName: \"kubernetes.io/projected/a71a4dcb-4c6d-4846-a804-69032ee0c726-kube-api-access-kgtmj\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.526619 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.526510    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.526726 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.526662    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.526805 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.526783    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.526862 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.526801    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a71a4dcb-4c6d-4846-a804-69032ee0c726-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.528480 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.528444    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.528686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.528669    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.575156 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.575130    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"]
Oct 30 21:36:55.586531 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.586504    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgtmj\" (UniqueName: \"kubernetes.io/projected/a71a4dcb-4c6d-4846-a804-69032ee0c726-kube-api-access-kgtmj\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.588731 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.588707    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vhtw\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:55.682190 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:55.682170    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:56.113303 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.113273    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"]
Oct 30 21:36:56.114923 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:36:56.114897    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda71a4dcb_4c6d_4846_a804_69032ee0c726.slice/crio-768be2cc6cb73ad77d3d367619cc650d842b63fe29c1d99773890120e80dd968 WatchSource:0}: Error finding container 768be2cc6cb73ad77d3d367619cc650d842b63fe29c1d99773890120e80dd968: Status 404 returned error can't find the container with id 768be2cc6cb73ad77d3d367619cc650d842b63fe29c1d99773890120e80dd968
Oct 30 21:36:56.117562 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.117530    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:36:56.117649 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.117591    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:36:56.117649 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.117622    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:36:56.139371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.139351    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"]
Oct 30 21:36:56.144380 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.144364    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"
Oct 30 21:36:56.195917 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.195888    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-7379f500-serving-cert\""
Oct 30 21:36:56.228500 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.226848    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"]
Oct 30 21:36:56.236179 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.236148    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58hjj\" (UniqueName: \"kubernetes.io/projected/c40713f3-8021-4fd7-a245-801cc687abf5-kube-api-access-58hjj\") pod \"maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9\" (UID: \"c40713f3-8021-4fd7-a245-801cc687abf5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"
Oct 30 21:36:56.236327 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.236306    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c40713f3-8021-4fd7-a245-801cc687abf5-metrics-certs\") pod \"maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9\" (UID: \"c40713f3-8021-4fd7-a245-801cc687abf5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"
Oct 30 21:36:56.236486 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.236442    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c40713f3-8021-4fd7-a245-801cc687abf5-maas-api-tls\") pod \"maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9\" (UID: \"c40713f3-8021-4fd7-a245-801cc687abf5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"
Oct 30 21:36:56.236556 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.236482    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c40713f3-8021-4fd7-a245-801cc687abf5-openshift-service-ca\") pod \"maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9\" (UID: \"c40713f3-8021-4fd7-a245-801cc687abf5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"
Oct 30 21:36:56.337579 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.337546    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c40713f3-8021-4fd7-a245-801cc687abf5-metrics-certs\") pod \"maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9\" (UID: \"c40713f3-8021-4fd7-a245-801cc687abf5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"
Oct 30 21:36:56.337762 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.337742    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c40713f3-8021-4fd7-a245-801cc687abf5-maas-api-tls\") pod \"maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9\" (UID: \"c40713f3-8021-4fd7-a245-801cc687abf5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"
Oct 30 21:36:56.337854 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.337773    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c40713f3-8021-4fd7-a245-801cc687abf5-openshift-service-ca\") pod \"maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9\" (UID: \"c40713f3-8021-4fd7-a245-801cc687abf5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"
Oct 30 21:36:56.337939 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.337914    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58hjj\" (UniqueName: \"kubernetes.io/projected/c40713f3-8021-4fd7-a245-801cc687abf5-kube-api-access-58hjj\") pod \"maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9\" (UID: \"c40713f3-8021-4fd7-a245-801cc687abf5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"
Oct 30 21:36:56.338243 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:36:56.338217    4522 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-serving-cert: secret "maas-api-e2e-ait-7379f500-serving-cert" not found
Oct 30 21:36:56.338376 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:36:56.338292    4522 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c40713f3-8021-4fd7-a245-801cc687abf5-maas-api-tls podName:c40713f3-8021-4fd7-a245-801cc687abf5 nodeName:}" failed. No retries permitted until 2026-10-30 21:36:56.838275639 +0000 UTC m=+1525.783220989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c40713f3-8021-4fd7-a245-801cc687abf5-maas-api-tls") pod "maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9" (UID: "c40713f3-8021-4fd7-a245-801cc687abf5") : secret "maas-api-e2e-ait-7379f500-serving-cert" not found
Oct 30 21:36:56.338713 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.338692    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c40713f3-8021-4fd7-a245-801cc687abf5-openshift-service-ca\") pod \"maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9\" (UID: \"c40713f3-8021-4fd7-a245-801cc687abf5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"
Oct 30 21:36:56.340006 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.339990    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c40713f3-8021-4fd7-a245-801cc687abf5-metrics-certs\") pod \"maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9\" (UID: \"c40713f3-8021-4fd7-a245-801cc687abf5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"
Oct 30 21:36:56.377323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.377259    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:56.396448 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.396420    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58hjj\" (UniqueName: \"kubernetes.io/projected/c40713f3-8021-4fd7-a245-801cc687abf5-kube-api-access-58hjj\") pod \"maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9\" (UID: \"c40713f3-8021-4fd7-a245-801cc687abf5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"
Oct 30 21:36:56.574291 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.574257    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:56.746004 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.745972    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw" event={"ID":"a71a4dcb-4c6d-4846-a804-69032ee0c726","Type":"ContainerStarted","Data":"60ade03221fa189a442acb5c5c8e00bdebf26eba7bacd396ba9e062437899906"}
Oct 30 21:36:56.746175 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.746026    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw" event={"ID":"a71a4dcb-4c6d-4846-a804-69032ee0c726","Type":"ContainerStarted","Data":"768be2cc6cb73ad77d3d367619cc650d842b63fe29c1d99773890120e80dd968"}
Oct 30 21:36:56.851052 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.851017    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c40713f3-8021-4fd7-a245-801cc687abf5-maas-api-tls\") pod \"maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9\" (UID: \"c40713f3-8021-4fd7-a245-801cc687abf5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"
Oct 30 21:36:56.853423 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.853398    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c40713f3-8021-4fd7-a245-801cc687abf5-maas-api-tls\") pod \"maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9\" (UID: \"c40713f3-8021-4fd7-a245-801cc687abf5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"
Oct 30 21:36:56.870009 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:56.869955    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw" podStartSLOduration=1.869937938 podStartE2EDuration="1.869937938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:36:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:36:56.868006871 +0000 UTC m=+1525.812952242" watchObservedRunningTime="2026-10-30 21:36:56.869937938 +0000 UTC m=+1525.814883300"
Oct 30 21:36:57.066014 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:57.065942    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"
Oct 30 21:36:57.472862 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:57.472837    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"]
Oct 30 21:36:57.474498 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:36:57.474470    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc40713f3_8021_4fd7_a245_801cc687abf5.slice/crio-db0003e57b4446ec8d1182d52b815c7d84928ee1dbc2f07eacea97ef9887a9f6 WatchSource:0}: Error finding container db0003e57b4446ec8d1182d52b815c7d84928ee1dbc2f07eacea97ef9887a9f6: Status 404 returned error can't find the container with id db0003e57b4446ec8d1182d52b815c7d84928ee1dbc2f07eacea97ef9887a9f6
Oct 30 21:36:57.682698 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:57.682663    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:36:57.684000 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:57.683980    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-8vhtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Oct 30 21:36:57.684058 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:57.684027    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw" podUID="a71a4dcb-4c6d-4846-a804-69032ee0c726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Oct 30 21:36:57.752927 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:57.752851    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9" event={"ID":"c40713f3-8021-4fd7-a245-801cc687abf5","Type":"ContainerStarted","Data":"db0003e57b4446ec8d1182d52b815c7d84928ee1dbc2f07eacea97ef9887a9f6"}
Oct 30 21:36:58.682796 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:58.682761    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-8vhtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Oct 30 21:36:58.683171 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:58.682806    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw" podUID="a71a4dcb-4c6d-4846-a804-69032ee0c726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Oct 30 21:36:58.760158 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:58.760119    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9" event={"ID":"c40713f3-8021-4fd7-a245-801cc687abf5","Type":"ContainerStarted","Data":"3fde65951aa6bd22633411d6d5939eb8631e39213109122a06abc8bd4a6019b1"}
Oct 30 21:36:58.760302 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:58.760266    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"
Oct 30 21:36:59.682444 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:59.682411    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-8vhtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Oct 30 21:36:59.682627 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:36:59.682506    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw" podUID="a71a4dcb-4c6d-4846-a804-69032ee0c726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Oct 30 21:37:00.682546 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:00.682504    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-8vhtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Oct 30 21:37:00.682931 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:00.682566    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw" podUID="a71a4dcb-4c6d-4846-a804-69032ee0c726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Oct 30 21:37:01.384095 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:01.384064    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:01.683384 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:01.683353    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-8vhtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Oct 30 21:37:01.683891 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:01.683411    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw" podUID="a71a4dcb-4c6d-4846-a804-69032ee0c726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Oct 30 21:37:02.683114 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:02.683082    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-8vhtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Oct 30 21:37:02.683286 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:02.683132    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw" podUID="a71a4dcb-4c6d-4846-a804-69032ee0c726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Oct 30 21:37:04.371212 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:04.371172    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:37:04.371673 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:04.371653    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:37:04.372852 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:04.372828    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 21:37:04.538416 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:04.538355    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9" podStartSLOduration=7.662097064 podStartE2EDuration="8.538338707s" totalImagesPullingTime="876.241643ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:36:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:36:58.911320067 +0000 UTC m=+1527.856265419" watchObservedRunningTime="2026-10-30 21:37:04.538338707 +0000 UTC m=+1533.483284071"
Oct 30 21:37:04.768010 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:04.767969    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9" podUID="c40713f3-8021-4fd7-a245-801cc687abf5" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.72:8443/health\": dial tcp 10.133.0.72:8443: connect: connection refused"
Oct 30 21:37:06.157352 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:06.157311    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:07.988348 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:37:07.988315    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:37:08.824061 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:08.823984    4522 generic.go:356] "Generic (PLEG): container finished" podID="c40713f3-8021-4fd7-a245-801cc687abf5" containerID="3fde65951aa6bd22633411d6d5939eb8631e39213109122a06abc8bd4a6019b1" exitCode=1
Oct 30 21:37:08.824206 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:08.824054    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9" event={"ID":"c40713f3-8021-4fd7-a245-801cc687abf5","Type":"ContainerDied","Data":"3fde65951aa6bd22633411d6d5939eb8631e39213109122a06abc8bd4a6019b1"}
Oct 30 21:37:08.824505 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:08.824490    4522 scope.go:122] "RemoveContainer" containerID="3fde65951aa6bd22633411d6d5939eb8631e39213109122a06abc8bd4a6019b1"
Oct 30 21:37:09.831432 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:09.831403    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9" event={"ID":"c40713f3-8021-4fd7-a245-801cc687abf5","Type":"ContainerStarted","Data":"b27b8ced320fdb5155d0091c69f587d89e294136a6ea3a266989ebb839916712"}
Oct 30 21:37:09.831807 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:09.831651    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"
Oct 30 21:37:10.799482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:10.797362    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:15.578616 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:15.578490    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:15.844403 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:15.844322    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"
Oct 30 21:37:20.657872 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:20.657831    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:21.513404 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:21.513374    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:24.922479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:24.922400    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:25.959329 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:25.959284    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:30.236390 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:30.236354    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w"]
Oct 30 21:37:30.538104 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:30.538019    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:30.736743 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:30.736713    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:31.150599 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:31.150571    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:35.236821 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:35.236784    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w" podUID="46c13d56-bb31-4ed5-ba61-16dc1ff17ad8" containerName="payload-pre-processing" containerID="cri-o://500cc721e07027f18cbac86d6d2cd07493bbb09c9dadaf6722ece41d24121157" gracePeriod=25
Oct 30 21:37:35.637783 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:35.637430    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w"
Oct 30 21:37:35.710214 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:35.710184    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/46c13d56-bb31-4ed5-ba61-16dc1ff17ad8-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46c13d56-bb31-4ed5-ba61-16dc1ff17ad8-plugins-config-volume\") pod \"46c13d56-bb31-4ed5-ba61-16dc1ff17ad8\" (UID: \"46c13d56-bb31-4ed5-ba61-16dc1ff17ad8\") "
Oct 30 21:37:35.710446 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:35.710422    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/46c13d56-bb31-4ed5-ba61-16dc1ff17ad8-kube-api-access-6nvk7\" (UniqueName: \"kubernetes.io/projected/46c13d56-bb31-4ed5-ba61-16dc1ff17ad8-kube-api-access-6nvk7\") pod \"46c13d56-bb31-4ed5-ba61-16dc1ff17ad8\" (UID: \"46c13d56-bb31-4ed5-ba61-16dc1ff17ad8\") "
Oct 30 21:37:35.710613 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:35.710556    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46c13d56-bb31-4ed5-ba61-16dc1ff17ad8-plugins-config-volume" pod "46c13d56-bb31-4ed5-ba61-16dc1ff17ad8" (UID: "46c13d56-bb31-4ed5-ba61-16dc1ff17ad8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:35.711101 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:35.711071    4522 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46c13d56-bb31-4ed5-ba61-16dc1ff17ad8-plugins-config-volume\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:35.712594 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:35.712573    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46c13d56-bb31-4ed5-ba61-16dc1ff17ad8-kube-api-access-6nvk7" pod "46c13d56-bb31-4ed5-ba61-16dc1ff17ad8" (UID: "46c13d56-bb31-4ed5-ba61-16dc1ff17ad8"). InnerVolumeSpecName "kube-api-access-6nvk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:37:35.812290 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:35.812253    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nvk7\" (UniqueName: \"kubernetes.io/projected/46c13d56-bb31-4ed5-ba61-16dc1ff17ad8-kube-api-access-6nvk7\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:35.994471 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:35.994433    4522 generic.go:356] "Generic (PLEG): container finished" podID="46c13d56-bb31-4ed5-ba61-16dc1ff17ad8" containerID="500cc721e07027f18cbac86d6d2cd07493bbb09c9dadaf6722ece41d24121157" exitCode=0
Oct 30 21:37:35.994631 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:35.994493    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w"
Oct 30 21:37:35.994631 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:35.994506    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w" event={"ID":"46c13d56-bb31-4ed5-ba61-16dc1ff17ad8","Type":"ContainerDied","Data":"500cc721e07027f18cbac86d6d2cd07493bbb09c9dadaf6722ece41d24121157"}
Oct 30 21:37:35.994631 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:35.994547    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w" event={"ID":"46c13d56-bb31-4ed5-ba61-16dc1ff17ad8","Type":"ContainerDied","Data":"bdac43f117d93cde8d8002132dab0b2fab7a1443628843c80e7483e77ef8115d"}
Oct 30 21:37:35.994631 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:35.994567    4522 scope.go:122] "RemoveContainer" containerID="500cc721e07027f18cbac86d6d2cd07493bbb09c9dadaf6722ece41d24121157"
Oct 30 21:37:36.004787 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:36.004768    4522 scope.go:122] "RemoveContainer" containerID="500cc721e07027f18cbac86d6d2cd07493bbb09c9dadaf6722ece41d24121157"
Oct 30 21:37:36.005060 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:37:36.005039    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"500cc721e07027f18cbac86d6d2cd07493bbb09c9dadaf6722ece41d24121157\": container with ID starting with 500cc721e07027f18cbac86d6d2cd07493bbb09c9dadaf6722ece41d24121157 not found: ID does not exist" containerID="500cc721e07027f18cbac86d6d2cd07493bbb09c9dadaf6722ece41d24121157"
Oct 30 21:37:36.005118 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:36.005072    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"500cc721e07027f18cbac86d6d2cd07493bbb09c9dadaf6722ece41d24121157"} err="failed to get container status \"500cc721e07027f18cbac86d6d2cd07493bbb09c9dadaf6722ece41d24121157\": rpc error: code = NotFound desc = could not find container \"500cc721e07027f18cbac86d6d2cd07493bbb09c9dadaf6722ece41d24121157\": container with ID starting with 500cc721e07027f18cbac86d6d2cd07493bbb09c9dadaf6722ece41d24121157 not found: ID does not exist"
Oct 30 21:37:36.156568 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:36.156536    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w"]
Oct 30 21:37:36.205512 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:36.205479    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b25d536b-7494ffc8c-f629w"]
Oct 30 21:37:36.396657 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:36.396628    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:37.193260 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:37.193215    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="46c13d56-bb31-4ed5-ba61-16dc1ff17ad8" path="/var/lib/kubelet/pods/46c13d56-bb31-4ed5-ba61-16dc1ff17ad8/volumes"
Oct 30 21:37:37.996375 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:37:37.996336    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:37:41.516201 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:41.516064    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:41.707026 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:41.706991    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:46.441833 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:46.441574    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:49.981533 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:49.981502    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:50.174412 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:50.174380    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:51.110230 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:51.110197    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:52.198953 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:52.198916    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb"]
Oct 30 21:37:52.597619 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:52.597547    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:52.785737 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:52.785630    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:55.821659 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:55.821627    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:56.395051 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:56.395013    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:57.199295 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:57.199259    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb" podUID="6ac2109a-ba6d-43f3-bc03-676e5decaf0c" containerName="payload-processing" containerID="cri-o://2ec9eae9745f309fc82331f195b892a4dc860362468fc34226fa0efb95e9c20f" gracePeriod=25
Oct 30 21:37:57.461526 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:57.461450    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb"
Oct 30 21:37:57.590230 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:57.590195    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6ac2109a-ba6d-43f3-bc03-676e5decaf0c-kube-api-access-bzdgc\" (UniqueName: \"kubernetes.io/projected/6ac2109a-ba6d-43f3-bc03-676e5decaf0c-kube-api-access-bzdgc\") pod \"6ac2109a-ba6d-43f3-bc03-676e5decaf0c\" (UID: \"6ac2109a-ba6d-43f3-bc03-676e5decaf0c\") "
Oct 30 21:37:57.590375 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:57.590335    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6ac2109a-ba6d-43f3-bc03-676e5decaf0c-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ac2109a-ba6d-43f3-bc03-676e5decaf0c-plugins-config-volume\") pod \"6ac2109a-ba6d-43f3-bc03-676e5decaf0c\" (UID: \"6ac2109a-ba6d-43f3-bc03-676e5decaf0c\") "
Oct 30 21:37:57.590791 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:57.590763    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ac2109a-ba6d-43f3-bc03-676e5decaf0c-plugins-config-volume" pod "6ac2109a-ba6d-43f3-bc03-676e5decaf0c" (UID: "6ac2109a-ba6d-43f3-bc03-676e5decaf0c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:57.591149 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:57.591128    4522 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ac2109a-ba6d-43f3-bc03-676e5decaf0c-plugins-config-volume\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:57.592409 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:57.592382    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ac2109a-ba6d-43f3-bc03-676e5decaf0c-kube-api-access-bzdgc" pod "6ac2109a-ba6d-43f3-bc03-676e5decaf0c" (UID: "6ac2109a-ba6d-43f3-bc03-676e5decaf0c"). InnerVolumeSpecName "kube-api-access-bzdgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:37:57.692124 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:57.692102    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzdgc\" (UniqueName: \"kubernetes.io/projected/6ac2109a-ba6d-43f3-bc03-676e5decaf0c-kube-api-access-bzdgc\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:58.127797 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:58.127768    4522 generic.go:356] "Generic (PLEG): container finished" podID="6ac2109a-ba6d-43f3-bc03-676e5decaf0c" containerID="2ec9eae9745f309fc82331f195b892a4dc860362468fc34226fa0efb95e9c20f" exitCode=0
Oct 30 21:37:58.127976 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:58.127815    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb"
Oct 30 21:37:58.127976 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:58.127852    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb" event={"ID":"6ac2109a-ba6d-43f3-bc03-676e5decaf0c","Type":"ContainerDied","Data":"2ec9eae9745f309fc82331f195b892a4dc860362468fc34226fa0efb95e9c20f"}
Oct 30 21:37:58.127976 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:58.127905    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb" event={"ID":"6ac2109a-ba6d-43f3-bc03-676e5decaf0c","Type":"ContainerDied","Data":"2ef51d91e306cbd581c2ef97778ff8cbbac99f061a271f5e7bbfbe85c7e87039"}
Oct 30 21:37:58.127976 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:58.127928    4522 scope.go:122] "RemoveContainer" containerID="2ec9eae9745f309fc82331f195b892a4dc860362468fc34226fa0efb95e9c20f"
Oct 30 21:37:58.140296 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:58.140274    4522 scope.go:122] "RemoveContainer" containerID="2ec9eae9745f309fc82331f195b892a4dc860362468fc34226fa0efb95e9c20f"
Oct 30 21:37:58.140650 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:37:58.140626    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ec9eae9745f309fc82331f195b892a4dc860362468fc34226fa0efb95e9c20f\": container with ID starting with 2ec9eae9745f309fc82331f195b892a4dc860362468fc34226fa0efb95e9c20f not found: ID does not exist" containerID="2ec9eae9745f309fc82331f195b892a4dc860362468fc34226fa0efb95e9c20f"
Oct 30 21:37:58.140746 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:58.140659    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ec9eae9745f309fc82331f195b892a4dc860362468fc34226fa0efb95e9c20f"} err="failed to get container status \"2ec9eae9745f309fc82331f195b892a4dc860362468fc34226fa0efb95e9c20f\": rpc error: code = NotFound desc = could not find container \"2ec9eae9745f309fc82331f195b892a4dc860362468fc34226fa0efb95e9c20f\": container with ID starting with 2ec9eae9745f309fc82331f195b892a4dc860362468fc34226fa0efb95e9c20f not found: ID does not exist"
Oct 30 21:37:58.290573 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:58.290541    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb"]
Oct 30 21:37:58.339273 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:58.339244    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-6f787654-8869d578f-4qclb"]
Oct 30 21:37:59.192493 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:37:59.192445    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6ac2109a-ba6d-43f3-bc03-676e5decaf0c" path="/var/lib/kubelet/pods/6ac2109a-ba6d-43f3-bc03-676e5decaf0c/volumes"
Oct 30 21:38:00.542232 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:00.542195    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:05.511266 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:05.511036    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:07.537013 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:07.536980    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:38:07.988500 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:38:07.988437    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:38:09.629528 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:09.629488    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:11.132224 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:11.132192    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:11.346689 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:11.346652    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:11.535444 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:11.535414    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:11.855749 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:11.855672    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:12.602139 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:12.602106    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:12.797652 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:12.797615    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:12.986939 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:12.986906    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:14.113193 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:14.113164    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:14.307655 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:14.307624    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:15.905778 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:15.905739    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:17.467979 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:17.467948    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:17.675415 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:17.675382    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:17.866514 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:17.866384    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:19.473577 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:19.473545    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:20.112138 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:20.112096    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:20.300102 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:20.300065    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:20.530029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:20.529992    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:22.089884 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:22.089843    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:22.628822 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:22.628793    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:22.820917 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:22.820883    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:23.805524 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:23.805494    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:24.060597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:24.060525    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:24.281490 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:24.281447    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:24.490320 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:24.490286    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:25.226059 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:25.226027    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:25.413246 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:25.413209    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:25.741821 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:25.741794    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:26.137137 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.137067    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"]
Oct 30 21:38:26.137629 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.137613    4522 cpu_manager.go:414] "containerMap: removing container" podUID="6ac2109a-ba6d-43f3-bc03-676e5decaf0c" containerName="payload-processing"
Oct 30 21:38:26.137680 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.137630    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6ac2109a-ba6d-43f3-bc03-676e5decaf0c" containerName="payload-processing"
Oct 30 21:38:26.137680 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.137656    4522 cpu_manager.go:414] "containerMap: removing container" podUID="46c13d56-bb31-4ed5-ba61-16dc1ff17ad8" containerName="payload-pre-processing"
Oct 30 21:38:26.137680 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.137660    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="46c13d56-bb31-4ed5-ba61-16dc1ff17ad8" containerName="payload-pre-processing"
Oct 30 21:38:26.137778 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.137733    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="46c13d56-bb31-4ed5-ba61-16dc1ff17ad8" containerName="payload-pre-processing"
Oct 30 21:38:26.137778 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.137743    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="6ac2109a-ba6d-43f3-bc03-676e5decaf0c" containerName="payload-processing"
Oct 30 21:38:26.140951 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.140936    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.236146 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.236108    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.236671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.236183    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.236671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.236214    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdnzd\" (UniqueName: \"kubernetes.io/projected/174c4004-d6e9-46c8-a05a-ec295d4eff67-kube-api-access-kdnzd\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.236671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.236327    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.236671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.236358    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.236671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.236442    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/174c4004-d6e9-46c8-a05a-ec295d4eff67-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.236671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.236491    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.236671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.236517    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.236671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.236545    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.246585 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.246559    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"]
Oct 30 21:38:26.307406 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.307380    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:26.337986 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.337961    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.338093 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.338007    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.338093 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.338029    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdnzd\" (UniqueName: \"kubernetes.io/projected/174c4004-d6e9-46c8-a05a-ec295d4eff67-kube-api-access-kdnzd\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.338163 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.338110    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.338163 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.338140    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.338239 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.338216    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/174c4004-d6e9-46c8-a05a-ec295d4eff67-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.338288 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.338249    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.338288 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.338273    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.338392 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.338296    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.338392 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.338377    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.338619 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.338589    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.338731 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.338696    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.338731 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.338709    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.338992 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.338969    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/174c4004-d6e9-46c8-a05a-ec295d4eff67-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.340442 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.340420    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.340641 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.340623    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.394143 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.394094    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdnzd\" (UniqueName: \"kubernetes.io/projected/174c4004-d6e9-46c8-a05a-ec295d4eff67-kube-api-access-kdnzd\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.394143 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.394099    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-cl7nj\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.454525 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.454503    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:26.880390 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.880364    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"]
Oct 30 21:38:26.881728 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:38:26.881701    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod174c4004_d6e9_46c8_a05a_ec295d4eff67.slice/crio-30e8fc5d7d9b08808d6a10b9356e7c33ad96215a57ae462ce6dc4bebb964e43c WatchSource:0}: Error finding container 30e8fc5d7d9b08808d6a10b9356e7c33ad96215a57ae462ce6dc4bebb964e43c: Status 404 returned error can't find the container with id 30e8fc5d7d9b08808d6a10b9356e7c33ad96215a57ae462ce6dc4bebb964e43c
Oct 30 21:38:26.884293 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.884262    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:38:26.884361 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.884328    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:38:26.884396 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:26.884359    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:38:27.372266 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:27.372225    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj" event={"ID":"174c4004-d6e9-46c8-a05a-ec295d4eff67","Type":"ContainerStarted","Data":"0278ffddfa2069ed2536bdd8bd7310b6ea3923f0c8bbb982be93e505525a1d33"}
Oct 30 21:38:27.372756 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:27.372324    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj" event={"ID":"174c4004-d6e9-46c8-a05a-ec295d4eff67","Type":"ContainerStarted","Data":"30e8fc5d7d9b08808d6a10b9356e7c33ad96215a57ae462ce6dc4bebb964e43c"}
Oct 30 21:38:27.455078 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:27.455050    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:27.456598 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:27.456575    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-cl7nj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:38:27.456719 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:27.456629    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj" podUID="174c4004-d6e9-46c8-a05a-ec295d4eff67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Oct 30 21:38:27.492188 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:27.492137    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj" podStartSLOduration=1.492120285 podStartE2EDuration="1.492120285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:38:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:38:27.489162452 +0000 UTC m=+1616.434107811" watchObservedRunningTime="2026-10-30 21:38:27.492120285 +0000 UTC m=+1616.437065646"
Oct 30 21:38:28.112607 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:28.112504    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:28.455802 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:28.455771    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-cl7nj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:38:28.456183 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:28.455830    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj" podUID="174c4004-d6e9-46c8-a05a-ec295d4eff67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Oct 30 21:38:29.205482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:29.205317    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:29.455368 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:29.455332    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-cl7nj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:38:29.455595 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:29.455384    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj" podUID="174c4004-d6e9-46c8-a05a-ec295d4eff67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Oct 30 21:38:30.212794 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:30.212758    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:30.403132 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:30.403066    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:30.454940 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:30.454907    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-cl7nj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:38:30.455111 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:30.454960    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj" podUID="174c4004-d6e9-46c8-a05a-ec295d4eff67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Oct 30 21:38:31.413971 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:31.413934    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:31.467262 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:31.467209    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-cl7nj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:38:31.467589 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:31.467556    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj" podUID="174c4004-d6e9-46c8-a05a-ec295d4eff67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Oct 30 21:38:32.455084 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:32.455055    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-cl7nj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:38:32.455496 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:32.455104    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj" podUID="174c4004-d6e9-46c8-a05a-ec295d4eff67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Oct 30 21:38:33.455722 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:33.455689    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-cl7nj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:38:33.456091 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:33.455739    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj" podUID="174c4004-d6e9-46c8-a05a-ec295d4eff67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Oct 30 21:38:33.948949 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:33.948917    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:35.179343 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:35.179312    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:35.179850 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:35.179700    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:35.180678 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:35.180660    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:38:37.990106 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:38:37.990067    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:38:38.657202 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:38.657086    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:39.415991 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:39.415959    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:41.217413 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.217380    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"]
Oct 30 21:38:41.223030 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.223009    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.320195 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.320160    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.320367 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.320229    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.320442 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.320429    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.320513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.320497    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.320579 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.320565    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.320672 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.320655    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.320706 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.320692    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.320867 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.320846    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.320942 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.320921    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdrt2\" (UniqueName: \"kubernetes.io/projected/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-kube-api-access-xdrt2\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.326624 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.326596    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"]
Oct 30 21:38:41.421932 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.421898    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.422117 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.421967    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.422117 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.421996    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.422117 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.422037    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.422117 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.422083    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.422327 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.422153    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.422327 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.422191    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.422327 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.422303    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.422327 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.422312    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.422555 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.422398    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.422555 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.422408    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdrt2\" (UniqueName: \"kubernetes.io/projected/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-kube-api-access-xdrt2\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.422555 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.422531    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.422720 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.422668    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.423004 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.422979    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.424518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.424496    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.424650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.424636    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.478410 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.478351    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdrt2\" (UniqueName: \"kubernetes.io/projected/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-kube-api-access-xdrt2\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.478582 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.478564    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-hdwzw\" (UID: \"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.536309 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.536285    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:41.966397 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.966372    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"]
Oct 30 21:38:41.967322 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:38:41.967290    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1cfc868_9ea4_4c20_8b8b_d9311f2f0e5d.slice/crio-6204b8a04d4df559e40fb86d66923835947079ac545b06edd95a98d4cff5fbcc WatchSource:0}: Error finding container 6204b8a04d4df559e40fb86d66923835947079ac545b06edd95a98d4cff5fbcc: Status 404 returned error can't find the container with id 6204b8a04d4df559e40fb86d66923835947079ac545b06edd95a98d4cff5fbcc
Oct 30 21:38:41.969540 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.969503    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:38:41.969619 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.969568    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:38:41.969619 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:41.969598    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:38:42.518787 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:42.518746    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw" event={"ID":"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d","Type":"ContainerStarted","Data":"ff4de05fb0552e8c795b79c521726b23afcf9cad7314e611ac92e9a2a675cbd6"}
Oct 30 21:38:42.519350 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:42.518802    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw" event={"ID":"e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d","Type":"ContainerStarted","Data":"6204b8a04d4df559e40fb86d66923835947079ac545b06edd95a98d4cff5fbcc"}
Oct 30 21:38:42.536836 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:42.536807    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:42.622923 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:42.622888    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"]
Oct 30 21:38:42.623099 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:42.623079    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9" podUID="c40713f3-8021-4fd7-a245-801cc687abf5" containerName="maas-api" containerID="cri-o://b27b8ced320fdb5155d0091c69f587d89e294136a6ea3a266989ebb839916712" gracePeriod=30
Oct 30 21:38:42.652279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:42.652237    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw" podStartSLOduration=1.6522238329999999 podStartE2EDuration="1.652223833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:38:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:38:42.651596574 +0000 UTC m=+1631.596541933" watchObservedRunningTime="2026-10-30 21:38:42.652223833 +0000 UTC m=+1631.597169199"
Oct 30 21:38:42.817442 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:42.817322    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:43.307488 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.307015    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"
Oct 30 21:38:43.476747 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.476658    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c40713f3-8021-4fd7-a245-801cc687abf5-metrics-certs\" (UniqueName: \"kubernetes.io/secret/c40713f3-8021-4fd7-a245-801cc687abf5-metrics-certs\") pod \"c40713f3-8021-4fd7-a245-801cc687abf5\" (UID: \"c40713f3-8021-4fd7-a245-801cc687abf5\") "
Oct 30 21:38:43.476924 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.476827    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c40713f3-8021-4fd7-a245-801cc687abf5-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c40713f3-8021-4fd7-a245-801cc687abf5-openshift-service-ca\") pod \"c40713f3-8021-4fd7-a245-801cc687abf5\" (UID: \"c40713f3-8021-4fd7-a245-801cc687abf5\") "
Oct 30 21:38:43.476924 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.476919    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c40713f3-8021-4fd7-a245-801cc687abf5-kube-api-access-58hjj\" (UniqueName: \"kubernetes.io/projected/c40713f3-8021-4fd7-a245-801cc687abf5-kube-api-access-58hjj\") pod \"c40713f3-8021-4fd7-a245-801cc687abf5\" (UID: \"c40713f3-8021-4fd7-a245-801cc687abf5\") "
Oct 30 21:38:43.477034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.476973    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c40713f3-8021-4fd7-a245-801cc687abf5-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c40713f3-8021-4fd7-a245-801cc687abf5-maas-api-tls\") pod \"c40713f3-8021-4fd7-a245-801cc687abf5\" (UID: \"c40713f3-8021-4fd7-a245-801cc687abf5\") "
Oct 30 21:38:43.477442 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.477410    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c40713f3-8021-4fd7-a245-801cc687abf5-openshift-service-ca" pod "c40713f3-8021-4fd7-a245-801cc687abf5" (UID: "c40713f3-8021-4fd7-a245-801cc687abf5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:38:43.477970 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.477751    4522 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c40713f3-8021-4fd7-a245-801cc687abf5-openshift-service-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:43.479836 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.479802    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c40713f3-8021-4fd7-a245-801cc687abf5-kube-api-access-58hjj" pod "c40713f3-8021-4fd7-a245-801cc687abf5" (UID: "c40713f3-8021-4fd7-a245-801cc687abf5"). InnerVolumeSpecName "kube-api-access-58hjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:38:43.480011 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.479993    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c40713f3-8021-4fd7-a245-801cc687abf5-maas-api-tls" pod "c40713f3-8021-4fd7-a245-801cc687abf5" (UID: "c40713f3-8021-4fd7-a245-801cc687abf5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:38:43.481827 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.481803    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c40713f3-8021-4fd7-a245-801cc687abf5-metrics-certs" pod "c40713f3-8021-4fd7-a245-801cc687abf5" (UID: "c40713f3-8021-4fd7-a245-801cc687abf5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:38:43.527613 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.527583    4522 generic.go:356] "Generic (PLEG): container finished" podID="c40713f3-8021-4fd7-a245-801cc687abf5" containerID="b27b8ced320fdb5155d0091c69f587d89e294136a6ea3a266989ebb839916712" exitCode=0
Oct 30 21:38:43.527613 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.527619    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"
Oct 30 21:38:43.528661 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.527658    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9" event={"ID":"c40713f3-8021-4fd7-a245-801cc687abf5","Type":"ContainerDied","Data":"b27b8ced320fdb5155d0091c69f587d89e294136a6ea3a266989ebb839916712"}
Oct 30 21:38:43.528661 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.527725    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9" event={"ID":"c40713f3-8021-4fd7-a245-801cc687abf5","Type":"ContainerDied","Data":"db0003e57b4446ec8d1182d52b815c7d84928ee1dbc2f07eacea97ef9887a9f6"}
Oct 30 21:38:43.528661 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.527756    4522 scope.go:122] "RemoveContainer" containerID="b27b8ced320fdb5155d0091c69f587d89e294136a6ea3a266989ebb839916712"
Oct 30 21:38:43.538032 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.538016    4522 scope.go:122] "RemoveContainer" containerID="3fde65951aa6bd22633411d6d5939eb8631e39213109122a06abc8bd4a6019b1"
Oct 30 21:38:43.539006 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.538895    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-hdwzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Oct 30 21:38:43.539006 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.538940    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw" podUID="e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Oct 30 21:38:43.546200 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.546184    4522 scope.go:122] "RemoveContainer" containerID="b27b8ced320fdb5155d0091c69f587d89e294136a6ea3a266989ebb839916712"
Oct 30 21:38:43.546474 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:38:43.546438    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b27b8ced320fdb5155d0091c69f587d89e294136a6ea3a266989ebb839916712\": container with ID starting with b27b8ced320fdb5155d0091c69f587d89e294136a6ea3a266989ebb839916712 not found: ID does not exist" containerID="b27b8ced320fdb5155d0091c69f587d89e294136a6ea3a266989ebb839916712"
Oct 30 21:38:43.546540 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.546481    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b27b8ced320fdb5155d0091c69f587d89e294136a6ea3a266989ebb839916712"} err="failed to get container status \"b27b8ced320fdb5155d0091c69f587d89e294136a6ea3a266989ebb839916712\": rpc error: code = NotFound desc = could not find container \"b27b8ced320fdb5155d0091c69f587d89e294136a6ea3a266989ebb839916712\": container with ID starting with b27b8ced320fdb5155d0091c69f587d89e294136a6ea3a266989ebb839916712 not found: ID does not exist"
Oct 30 21:38:43.546540 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.546498    4522 scope.go:122] "RemoveContainer" containerID="3fde65951aa6bd22633411d6d5939eb8631e39213109122a06abc8bd4a6019b1"
Oct 30 21:38:43.546745 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:38:43.546725    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fde65951aa6bd22633411d6d5939eb8631e39213109122a06abc8bd4a6019b1\": container with ID starting with 3fde65951aa6bd22633411d6d5939eb8631e39213109122a06abc8bd4a6019b1 not found: ID does not exist" containerID="3fde65951aa6bd22633411d6d5939eb8631e39213109122a06abc8bd4a6019b1"
Oct 30 21:38:43.546801 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.546754    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fde65951aa6bd22633411d6d5939eb8631e39213109122a06abc8bd4a6019b1"} err="failed to get container status \"3fde65951aa6bd22633411d6d5939eb8631e39213109122a06abc8bd4a6019b1\": rpc error: code = NotFound desc = could not find container \"3fde65951aa6bd22633411d6d5939eb8631e39213109122a06abc8bd4a6019b1\": container with ID starting with 3fde65951aa6bd22633411d6d5939eb8631e39213109122a06abc8bd4a6019b1 not found: ID does not exist"
Oct 30 21:38:43.579573 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.579544    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58hjj\" (UniqueName: \"kubernetes.io/projected/c40713f3-8021-4fd7-a245-801cc687abf5-kube-api-access-58hjj\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:43.579669 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.579573    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c40713f3-8021-4fd7-a245-801cc687abf5-maas-api-tls\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:43.579669 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.579589    4522 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c40713f3-8021-4fd7-a245-801cc687abf5-metrics-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:43.725482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.725161    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"]
Oct 30 21:38:43.753576 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:43.749064    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7379f500-7797c7dc7d-5r9n9"]
Oct 30 21:38:44.370591 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:44.370552    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:44.536743 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:44.536707    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-hdwzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Oct 30 21:38:44.537234 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:44.536759    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw" podUID="e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Oct 30 21:38:44.657856 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:44.655138    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:44.846811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:44.846774    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:45.199006 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:45.198392    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c40713f3-8021-4fd7-a245-801cc687abf5" path="/var/lib/kubelet/pods/c40713f3-8021-4fd7-a245-801cc687abf5/volumes"
Oct 30 21:38:45.475753 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:45.475668    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:45.546596 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:45.546563    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-hdwzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Oct 30 21:38:45.547176 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:45.547149    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw" podUID="e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Oct 30 21:38:46.536860 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:46.536829    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-hdwzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Oct 30 21:38:46.537032 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:46.536892    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw" podUID="e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Oct 30 21:38:47.537593 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:47.537554    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-hdwzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Oct 30 21:38:47.537975 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:47.537632    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw" podUID="e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Oct 30 21:38:48.537433 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:48.537397    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-hdwzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Oct 30 21:38:48.537637 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:48.537484    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw" podUID="e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Oct 30 21:38:49.844114 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:49.844064    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:50.150982 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:50.150894    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:50.151302 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:50.151284    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:50.152188 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:50.152168    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw"
Oct 30 21:38:52.777295 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:52.777263    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:54.588387 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:54.587447    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:56.423604 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:56.423573    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:56.617971 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:56.617944    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:56.859638 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:56.859571    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:59.193489 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:59.193420    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:59.392682 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:59.392651    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:59.588177 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:59.588109    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:59.781975 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:38:59.781948    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:03.417593 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:03.417561    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:03.612861 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:03.612833    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:03.849721 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:03.849279    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:07.989575 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:39:07.989539    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:39:08.671181 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:08.671098    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:09.654519 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:09.654451    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:09.845577 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:09.845543    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:13.360655 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:13.360597    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:18.070225 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:18.070185    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:22.770110 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:22.770066    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:24.230173 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:24.230137    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:39:25.577490 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:25.577446    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:27.454483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:27.452133    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:30.499765 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:30.499700    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:31.199687 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:31.199070    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:31.779809 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:31.779778    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:32.274524 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:32.273793    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:37.174152 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:37.174049    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:37.989432 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:39:37.989400    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:39:39.182052 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:39.182009    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:41.868798 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:41.868709    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:46.061814 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:46.061780    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:46.348531 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:46.343039    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:51.593675 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:51.593641    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:54.696032 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:54.695998    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:54.949766 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:54.949692    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:56.765770 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:56.765733    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:59.320518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:59.320482    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:59.535500 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:39:59.535453    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:01.074305 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:01.074275    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:01.301029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:01.300998    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:01.986835 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:01.986799    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:03.284277 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:03.284202    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:03.486515 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:03.486472    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:06.858609 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:06.858573    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:07.988672 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:40:07.988631    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:40:11.610826 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:11.610790    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:16.383693 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:16.383656    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:21.202621 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:21.202571    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-hdwzw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:40:21.203140 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:21.202653    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw" podUID="e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:21.222639 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:21.222589    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-cl7nj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:40:21.222915 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:21.222884    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj" podUID="174c4004-d6e9-46c8-a05a-ec295d4eff67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:21.298586 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:21.298551    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:23.725678 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:23.725640    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:24.404335 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:24.404306    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:24.798158 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:24.798111    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:25.425211 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:25.425181    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:25.944017 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:25.943987    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:26.954349 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:26.954302    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:28.716612 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:28.716579    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:29.437875 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:29.437833    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:29.682268 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:29.682221    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:29.874125 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:29.874003    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:32.376654 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:32.376595    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:32.680944 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:32.680903    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:32.895032 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:32.894997    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:33.285904 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:33.285870    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:33.928944 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:33.928912    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:34.158964 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:34.158932    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:37.218419 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:37.218386    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:37.435114 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:37.435060    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:37.630669 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:37.630590    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:37.991651 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:40:37.991616    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:40:38.312637 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:38.312555    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:38.946322 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:38.946283    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:39.218649 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:39.218571    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:39.515425 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:39.515344    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:43.076246 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:43.076208    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:43.285107 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:43.285058    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:43.485541 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:43.485446    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:45.267952 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:45.267897    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:45.456197 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:45.456162    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:45.647386 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:45.647301    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:48.187408 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:48.187379    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:49.591650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:49.591609    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:50.539496 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:50.532951    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:50.634398 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:50.634370    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:40:50.742714 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:50.742676    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:53.072130 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:53.072056    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:57.761793 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:40:57.761706    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:02.570693 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:02.570660    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:07.246271 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:07.246238    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:07.988511 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:41:07.988478    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:41:09.397565 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:09.397532    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:09.668312 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:09.668284    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:11.944484 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:11.943563    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:16.616264 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:16.616224    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:16.812846 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:16.812811    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:17.022132 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:17.022104    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:19.973786 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:19.973750    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:21.990392 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:21.990350    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:26.305455 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:26.305424    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:26.727277 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:26.726056    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:26.953749 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:26.953717    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:27.188731 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:27.188694    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:27.377173 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:27.377142    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"]
Oct 30 21:41:27.377644 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:27.377398    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw" podUID="4f516f9b-32d2-4823-87f0-39d5967eee9c" containerName="istio-proxy" containerID="cri-o://4f86ee57c1da10708593d138f8eeec35a3e78ccaf056efca6ae2e62551db3d49" gracePeriod=30
Oct 30 21:41:27.422414 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:27.422382    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:31.726479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:31.725693    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:31.784991 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:31.784960    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:41:31.785344 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:31.785068    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:41:32.235251 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.235218    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"]
Oct 30 21:41:32.423186 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.423159    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:32.636150 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.636129    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:41:32.746700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.746618    4522 generic.go:356] "Generic (PLEG): container finished" podID="4f516f9b-32d2-4823-87f0-39d5967eee9c" containerID="4f86ee57c1da10708593d138f8eeec35a3e78ccaf056efca6ae2e62551db3d49" exitCode=0
Oct 30 21:41:32.746700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.746668    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"
Oct 30 21:41:32.747105 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.746696    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw" event={"ID":"4f516f9b-32d2-4823-87f0-39d5967eee9c","Type":"ContainerDied","Data":"4f86ee57c1da10708593d138f8eeec35a3e78ccaf056efca6ae2e62551db3d49"}
Oct 30 21:41:32.747105 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.746774    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw" event={"ID":"4f516f9b-32d2-4823-87f0-39d5967eee9c","Type":"ContainerDied","Data":"cadc4049e4a4e780e5636c95b756ee051ab56f21beeb018c50e6e0817e8a0be3"}
Oct 30 21:41:32.747105 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.746797    4522 scope.go:122] "RemoveContainer" containerID="4f86ee57c1da10708593d138f8eeec35a3e78ccaf056efca6ae2e62551db3d49"
Oct 30 21:41:32.753326 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.753304    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-envoy\") pod \"4f516f9b-32d2-4823-87f0-39d5967eee9c\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") "
Oct 30 21:41:32.753326 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.753346    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-workload-certs\") pod \"4f516f9b-32d2-4823-87f0-39d5967eee9c\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") "
Oct 30 21:41:32.753575 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.753397    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4f516f9b-32d2-4823-87f0-39d5967eee9c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f516f9b-32d2-4823-87f0-39d5967eee9c-istiod-ca-cert\") pod \"4f516f9b-32d2-4823-87f0-39d5967eee9c\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") "
Oct 30 21:41:32.753575 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.753430    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-data\") pod \"4f516f9b-32d2-4823-87f0-39d5967eee9c\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") "
Oct 30 21:41:32.753575 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.753503    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-workload-socket\") pod \"4f516f9b-32d2-4823-87f0-39d5967eee9c\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") "
Oct 30 21:41:32.753575 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.753555    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f516f9b-32d2-4823-87f0-39d5967eee9c-kube-api-access-j5z7z\" (UniqueName: \"kubernetes.io/projected/4f516f9b-32d2-4823-87f0-39d5967eee9c-kube-api-access-j5z7z\") pod \"4f516f9b-32d2-4823-87f0-39d5967eee9c\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") "
Oct 30 21:41:32.753782 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.753626    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-token\" (UniqueName: \"kubernetes.io/projected/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-token\") pod \"4f516f9b-32d2-4823-87f0-39d5967eee9c\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") "
Oct 30 21:41:32.753782 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.753661    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-workload-certs" pod "4f516f9b-32d2-4823-87f0-39d5967eee9c" (UID: "4f516f9b-32d2-4823-87f0-39d5967eee9c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:41:32.753782 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.753669    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-credential-socket\") pod \"4f516f9b-32d2-4823-87f0-39d5967eee9c\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") "
Oct 30 21:41:32.753933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.753843    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-podinfo\") pod \"4f516f9b-32d2-4823-87f0-39d5967eee9c\" (UID: \"4f516f9b-32d2-4823-87f0-39d5967eee9c\") "
Oct 30 21:41:32.753990 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.753948    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-credential-socket" pod "4f516f9b-32d2-4823-87f0-39d5967eee9c" (UID: "4f516f9b-32d2-4823-87f0-39d5967eee9c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:41:32.754125 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.754092    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-workload-socket" pod "4f516f9b-32d2-4823-87f0-39d5967eee9c" (UID: "4f516f9b-32d2-4823-87f0-39d5967eee9c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:41:32.754621 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.754513    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f516f9b-32d2-4823-87f0-39d5967eee9c-istiod-ca-cert" pod "4f516f9b-32d2-4823-87f0-39d5967eee9c" (UID: "4f516f9b-32d2-4823-87f0-39d5967eee9c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:41:32.754841 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.754817    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-data" pod "4f516f9b-32d2-4823-87f0-39d5967eee9c" (UID: "4f516f9b-32d2-4823-87f0-39d5967eee9c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:41:32.755029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.754938    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:32.755029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.754957    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:32.755029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.754971    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f516f9b-32d2-4823-87f0-39d5967eee9c-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:32.755029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.754985    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:32.755029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.754999    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:32.758277 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.758255    4522 scope.go:122] "RemoveContainer" containerID="4f86ee57c1da10708593d138f8eeec35a3e78ccaf056efca6ae2e62551db3d49"
Oct 30 21:41:32.758406 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.758386    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f516f9b-32d2-4823-87f0-39d5967eee9c-kube-api-access-j5z7z" pod "4f516f9b-32d2-4823-87f0-39d5967eee9c" (UID: "4f516f9b-32d2-4823-87f0-39d5967eee9c"). InnerVolumeSpecName "kube-api-access-j5z7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:41:32.758671 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:41:32.758604    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f86ee57c1da10708593d138f8eeec35a3e78ccaf056efca6ae2e62551db3d49\": container with ID starting with 4f86ee57c1da10708593d138f8eeec35a3e78ccaf056efca6ae2e62551db3d49 not found: ID does not exist" containerID="4f86ee57c1da10708593d138f8eeec35a3e78ccaf056efca6ae2e62551db3d49"
Oct 30 21:41:32.758671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.758640    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f86ee57c1da10708593d138f8eeec35a3e78ccaf056efca6ae2e62551db3d49"} err="failed to get container status \"4f86ee57c1da10708593d138f8eeec35a3e78ccaf056efca6ae2e62551db3d49\": rpc error: code = NotFound desc = could not find container \"4f86ee57c1da10708593d138f8eeec35a3e78ccaf056efca6ae2e62551db3d49\": container with ID starting with 4f86ee57c1da10708593d138f8eeec35a3e78ccaf056efca6ae2e62551db3d49 not found: ID does not exist"
Oct 30 21:41:32.758839 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.758670    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-podinfo" pod "4f516f9b-32d2-4823-87f0-39d5967eee9c" (UID: "4f516f9b-32d2-4823-87f0-39d5967eee9c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:41:32.760503 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.760445    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-token" pod "4f516f9b-32d2-4823-87f0-39d5967eee9c" (UID: "4f516f9b-32d2-4823-87f0-39d5967eee9c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:41:32.761154 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.761131    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-envoy" pod "4f516f9b-32d2-4823-87f0-39d5967eee9c" (UID: "4f516f9b-32d2-4823-87f0-39d5967eee9c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:41:32.857125 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.857091    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:32.857125 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.857127    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:32.857359 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.857142    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5z7z\" (UniqueName: \"kubernetes.io/projected/4f516f9b-32d2-4823-87f0-39d5967eee9c-kube-api-access-j5z7z\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:32.857359 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:32.857157    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f516f9b-32d2-4823-87f0-39d5967eee9c-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:33.168269 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:33.168237    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"]
Oct 30 21:41:33.219401 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:33.219366    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-kh7dw"]
Oct 30 21:41:35.193646 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:35.193616    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4f516f9b-32d2-4823-87f0-39d5967eee9c" path="/var/lib/kubelet/pods/4f516f9b-32d2-4823-87f0-39d5967eee9c/volumes"
Oct 30 21:41:36.520024 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:36.519791    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:36.717862 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:36.717824    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:36.988932 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:36.988898    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:37.995920 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:41:37.995876    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:41:40.938829 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:40.938801    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:41.813589 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:41.813560    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:42.044171 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:42.044104    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:42.276484 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:42.276439    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:42.536952 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:42.536871    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:47.014180 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.014085    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:47.254835 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.254798    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5" podUID="336f0a2d-1023-411d-9ff4-33dad5c413d5" containerName="main" containerID="cri-o://fc1a8e5bfb6f93352746d8f9c4b249c4c5a50c395294221f4331efd401a4826d" gracePeriod=45
Oct 30 21:41:47.526871 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.526816    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:41:47.698653 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.698605    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-home\" (UniqueName: \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-home\") pod \"336f0a2d-1023-411d-9ff4-33dad5c413d5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") "
Oct 30 21:41:47.698853 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.698677    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-model-cache\") pod \"336f0a2d-1023-411d-9ff4-33dad5c413d5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") "
Oct 30 21:41:47.698853 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.698699    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-dshm\" (UniqueName: \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-dshm\") pod \"336f0a2d-1023-411d-9ff4-33dad5c413d5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") "
Oct 30 21:41:47.698853 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.698782    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/336f0a2d-1023-411d-9ff4-33dad5c413d5-kube-api-access-2gsc4\" (UniqueName: \"kubernetes.io/projected/336f0a2d-1023-411d-9ff4-33dad5c413d5-kube-api-access-2gsc4\") pod \"336f0a2d-1023-411d-9ff4-33dad5c413d5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") "
Oct 30 21:41:47.699024 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.698858    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-tmp-dir\") pod \"336f0a2d-1023-411d-9ff4-33dad5c413d5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") "
Oct 30 21:41:47.699024 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.698906    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-home" pod "336f0a2d-1023-411d-9ff4-33dad5c413d5" (UID: "336f0a2d-1023-411d-9ff4-33dad5c413d5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:41:47.699024 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.698945    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-model-cache" pod "336f0a2d-1023-411d-9ff4-33dad5c413d5" (UID: "336f0a2d-1023-411d-9ff4-33dad5c413d5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:41:47.699174 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.699028    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/336f0a2d-1023-411d-9ff4-33dad5c413d5-tls-certs\" (UniqueName: \"kubernetes.io/secret/336f0a2d-1023-411d-9ff4-33dad5c413d5-tls-certs\") pod \"336f0a2d-1023-411d-9ff4-33dad5c413d5\" (UID: \"336f0a2d-1023-411d-9ff4-33dad5c413d5\") "
Oct 30 21:41:47.699593 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.699328    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-tmp-dir" pod "336f0a2d-1023-411d-9ff4-33dad5c413d5" (UID: "336f0a2d-1023-411d-9ff4-33dad5c413d5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:41:47.699718 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.699698    4522 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-home\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:47.699781 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.699718    4522 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-model-cache\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:47.699781 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.699733    4522 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-tmp-dir\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:47.701740 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.701690    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/336f0a2d-1023-411d-9ff4-33dad5c413d5-tls-certs" pod "336f0a2d-1023-411d-9ff4-33dad5c413d5" (UID: "336f0a2d-1023-411d-9ff4-33dad5c413d5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:47.701740 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.701718    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/336f0a2d-1023-411d-9ff4-33dad5c413d5-kube-api-access-2gsc4" pod "336f0a2d-1023-411d-9ff4-33dad5c413d5" (UID: "336f0a2d-1023-411d-9ff4-33dad5c413d5"). InnerVolumeSpecName "kube-api-access-2gsc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:41:47.701947 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.701932    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-dshm" pod "336f0a2d-1023-411d-9ff4-33dad5c413d5" (UID: "336f0a2d-1023-411d-9ff4-33dad5c413d5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:41:47.801308 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.801233    4522 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/336f0a2d-1023-411d-9ff4-33dad5c413d5-dshm\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:47.801308 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.801266    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gsc4\" (UniqueName: \"kubernetes.io/projected/336f0a2d-1023-411d-9ff4-33dad5c413d5-kube-api-access-2gsc4\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:47.801308 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.801281    4522 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/336f0a2d-1023-411d-9ff4-33dad5c413d5-tls-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:47.842985 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.842954    4522 generic.go:356] "Generic (PLEG): container finished" podID="336f0a2d-1023-411d-9ff4-33dad5c413d5" containerID="fc1a8e5bfb6f93352746d8f9c4b249c4c5a50c395294221f4331efd401a4826d" exitCode=0
Oct 30 21:41:47.843126 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.842997    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"
Oct 30 21:41:47.843126 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.843036    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5" event={"ID":"336f0a2d-1023-411d-9ff4-33dad5c413d5","Type":"ContainerDied","Data":"fc1a8e5bfb6f93352746d8f9c4b249c4c5a50c395294221f4331efd401a4826d"}
Oct 30 21:41:47.843126 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.843077    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5" event={"ID":"336f0a2d-1023-411d-9ff4-33dad5c413d5","Type":"ContainerDied","Data":"dba867410fbf72a9beaaed5082dd352fce1f01eb0dd86a5156a79fff7b32867c"}
Oct 30 21:41:47.843126 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.843096    4522 scope.go:122] "RemoveContainer" containerID="fc1a8e5bfb6f93352746d8f9c4b249c4c5a50c395294221f4331efd401a4826d"
Oct 30 21:41:47.861897 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.861852    4522 scope.go:122] "RemoveContainer" containerID="fc1a8e5bfb6f93352746d8f9c4b249c4c5a50c395294221f4331efd401a4826d"
Oct 30 21:41:47.862642 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:41:47.862608    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc1a8e5bfb6f93352746d8f9c4b249c4c5a50c395294221f4331efd401a4826d\": container with ID starting with fc1a8e5bfb6f93352746d8f9c4b249c4c5a50c395294221f4331efd401a4826d not found: ID does not exist" containerID="fc1a8e5bfb6f93352746d8f9c4b249c4c5a50c395294221f4331efd401a4826d"
Oct 30 21:41:47.862803 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:47.862651    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc1a8e5bfb6f93352746d8f9c4b249c4c5a50c395294221f4331efd401a4826d"} err="failed to get container status \"fc1a8e5bfb6f93352746d8f9c4b249c4c5a50c395294221f4331efd401a4826d\": rpc error: code = NotFound desc = could not find container \"fc1a8e5bfb6f93352746d8f9c4b249c4c5a50c395294221f4331efd401a4826d\": container with ID starting with fc1a8e5bfb6f93352746d8f9c4b249c4c5a50c395294221f4331efd401a4826d not found: ID does not exist"
Oct 30 21:41:48.005449 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:48.005417    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"]
Oct 30 21:41:48.056312 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:48.056249    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-9ac5c5/distinct-2-w6-9ac5c5-kserve-6d785f66b6-pmnk5"]
Oct 30 21:41:49.192622 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:49.192588    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="336f0a2d-1023-411d-9ff4-33dad5c413d5" path="/var/lib/kubelet/pods/336f0a2d-1023-411d-9ff4-33dad5c413d5/volumes"
Oct 30 21:41:49.916506 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:49.916450    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:50.126343 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:50.125347    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:51.787583 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:51.785597    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:52.169467 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:52.169436    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:56.474541 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:56.467564    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:57.307839 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:57.307807    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"]
Oct 30 21:41:57.308056 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:57.308032    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr" podUID="0c90b3ce-f6a1-4ce6-a690-7831b4638d29" containerName="istio-proxy" containerID="cri-o://b5f623651728fc1860fa5f6826d04bfe39bdfddb14229e6c87ce6ed63defb605" gracePeriod=30
Oct 30 21:41:57.357180 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:57.357152    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"]
Oct 30 21:41:57.357376 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:57.357355    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn" podUID="8d537bd9-741d-448c-83ac-a0300dcc94a6" containerName="istio-proxy" containerID="cri-o://7486a0c8737f1101fe05e95f918ebc171d9a0e5f2e30f027dc6211c9da1de026" gracePeriod=30
Oct 30 21:41:59.311202 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:41:59.311170    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:01.224355 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:01.224310    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:02.624905 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.624873    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:42:02.671173 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.671152    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:42:02.713525 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.713501    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-workload-socket\") pod \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") "
Oct 30 21:42:02.713684 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.713668    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-envoy\") pod \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") "
Oct 30 21:42:02.713740 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.713725    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-kube-api-access-2k2h7\" (UniqueName: \"kubernetes.io/projected/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-kube-api-access-2k2h7\") pod \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") "
Oct 30 21:42:02.713775 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.713759    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-workload-socket" pod "0c90b3ce-f6a1-4ce6-a690-7831b4638d29" (UID: "0c90b3ce-f6a1-4ce6-a690-7831b4638d29"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:02.713840 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.713827    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-data\") pod \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") "
Oct 30 21:42:02.713877 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.713860    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-podinfo\") pod \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") "
Oct 30 21:42:02.713913 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.713898    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-workload-certs\") pod \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") "
Oct 30 21:42:02.714044 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.714004    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istiod-ca-cert\") pod \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") "
Oct 30 21:42:02.714125 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.714054    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-token\" (UniqueName: \"kubernetes.io/projected/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-token\") pod \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") "
Oct 30 21:42:02.714125 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.714078    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-data" pod "0c90b3ce-f6a1-4ce6-a690-7831b4638d29" (UID: "0c90b3ce-f6a1-4ce6-a690-7831b4638d29"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:02.714125 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.714099    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-workload-certs" pod "0c90b3ce-f6a1-4ce6-a690-7831b4638d29" (UID: "0c90b3ce-f6a1-4ce6-a690-7831b4638d29"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:02.714125 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.714119    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-credential-socket\") pod \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\" (UID: \"0c90b3ce-f6a1-4ce6-a690-7831b4638d29\") "
Oct 30 21:42:02.714443 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.714387    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istiod-ca-cert" pod "0c90b3ce-f6a1-4ce6-a690-7831b4638d29" (UID: "0c90b3ce-f6a1-4ce6-a690-7831b4638d29"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:42:02.714443 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.714397    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-credential-socket" pod "0c90b3ce-f6a1-4ce6-a690-7831b4638d29" (UID: "0c90b3ce-f6a1-4ce6-a690-7831b4638d29"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:02.714874 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.714853    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:02.714917 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.714882    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:02.714917 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.714898    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:02.714979 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.714915    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:02.714979 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.714929    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:02.715814 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.715792    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-envoy" pod "0c90b3ce-f6a1-4ce6-a690-7831b4638d29" (UID: "0c90b3ce-f6a1-4ce6-a690-7831b4638d29"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:02.716031 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.716017    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-token" pod "0c90b3ce-f6a1-4ce6-a690-7831b4638d29" (UID: "0c90b3ce-f6a1-4ce6-a690-7831b4638d29"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:42:02.716246 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.716219    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-podinfo" pod "0c90b3ce-f6a1-4ce6-a690-7831b4638d29" (UID: "0c90b3ce-f6a1-4ce6-a690-7831b4638d29"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:42:02.716322 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.716241    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-kube-api-access-2k2h7" pod "0c90b3ce-f6a1-4ce6-a690-7831b4638d29" (UID: "0c90b3ce-f6a1-4ce6-a690-7831b4638d29"). InnerVolumeSpecName "kube-api-access-2k2h7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:42:02.815840 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.815809    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8d537bd9-741d-448c-83ac-a0300dcc94a6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d537bd9-741d-448c-83ac-a0300dcc94a6-istiod-ca-cert\") pod \"8d537bd9-741d-448c-83ac-a0300dcc94a6\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") "
Oct 30 21:42:02.815985 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.815957    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-workload-socket\") pod \"8d537bd9-741d-448c-83ac-a0300dcc94a6\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") "
Oct 30 21:42:02.816042 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.816020    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8d537bd9-741d-448c-83ac-a0300dcc94a6-kube-api-access-xkjpf\" (UniqueName: \"kubernetes.io/projected/8d537bd9-741d-448c-83ac-a0300dcc94a6-kube-api-access-xkjpf\") pod \"8d537bd9-741d-448c-83ac-a0300dcc94a6\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") "
Oct 30 21:42:02.816125 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.816107    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-envoy\") pod \"8d537bd9-741d-448c-83ac-a0300dcc94a6\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") "
Oct 30 21:42:02.816202 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.816133    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d537bd9-741d-448c-83ac-a0300dcc94a6-istiod-ca-cert" pod "8d537bd9-741d-448c-83ac-a0300dcc94a6" (UID: "8d537bd9-741d-448c-83ac-a0300dcc94a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:42:02.816202 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.816175    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-podinfo\") pod \"8d537bd9-741d-448c-83ac-a0300dcc94a6\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") "
Oct 30 21:42:02.816312 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.816201    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-data\") pod \"8d537bd9-741d-448c-83ac-a0300dcc94a6\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") "
Oct 30 21:42:02.816312 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.816252    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-token\" (UniqueName: \"kubernetes.io/projected/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-token\") pod \"8d537bd9-741d-448c-83ac-a0300dcc94a6\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") "
Oct 30 21:42:02.816312 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.816274    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-workload-socket" pod "8d537bd9-741d-448c-83ac-a0300dcc94a6" (UID: "8d537bd9-741d-448c-83ac-a0300dcc94a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:02.816312 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.816297    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-credential-socket\") pod \"8d537bd9-741d-448c-83ac-a0300dcc94a6\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") "
Oct 30 21:42:02.817241 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.816356    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-workload-certs\") pod \"8d537bd9-741d-448c-83ac-a0300dcc94a6\" (UID: \"8d537bd9-741d-448c-83ac-a0300dcc94a6\") "
Oct 30 21:42:02.817241 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.816529    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-data" pod "8d537bd9-741d-448c-83ac-a0300dcc94a6" (UID: "8d537bd9-741d-448c-83ac-a0300dcc94a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:02.817241 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.816759    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-workload-certs" pod "8d537bd9-741d-448c-83ac-a0300dcc94a6" (UID: "8d537bd9-741d-448c-83ac-a0300dcc94a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:02.817241 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.816850    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-credential-socket" pod "8d537bd9-741d-448c-83ac-a0300dcc94a6" (UID: "8d537bd9-741d-448c-83ac-a0300dcc94a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:02.817241 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.816957    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:02.817241 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.816970    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d537bd9-741d-448c-83ac-a0300dcc94a6-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:02.817241 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.816979    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:02.817241 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.816987    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2k2h7\" (UniqueName: \"kubernetes.io/projected/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-kube-api-access-2k2h7\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:02.817241 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.816996    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:02.817241 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.817005    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:02.817241 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.817013    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c90b3ce-f6a1-4ce6-a690-7831b4638d29-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:02.817241 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.817020    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:02.817241 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.817029    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:02.818574 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.818547    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d537bd9-741d-448c-83ac-a0300dcc94a6-kube-api-access-xkjpf" pod "8d537bd9-741d-448c-83ac-a0300dcc94a6" (UID: "8d537bd9-741d-448c-83ac-a0300dcc94a6"). InnerVolumeSpecName "kube-api-access-xkjpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:42:02.818917 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.818880    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-token" pod "8d537bd9-741d-448c-83ac-a0300dcc94a6" (UID: "8d537bd9-741d-448c-83ac-a0300dcc94a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:42:02.819159 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.819137    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-podinfo" pod "8d537bd9-741d-448c-83ac-a0300dcc94a6" (UID: "8d537bd9-741d-448c-83ac-a0300dcc94a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:42:02.819705 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.819687    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-envoy" pod "8d537bd9-741d-448c-83ac-a0300dcc94a6" (UID: "8d537bd9-741d-448c-83ac-a0300dcc94a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:02.918709 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.918681    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkjpf\" (UniqueName: \"kubernetes.io/projected/8d537bd9-741d-448c-83ac-a0300dcc94a6-kube-api-access-xkjpf\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:02.918709 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.918708    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:02.918709 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.918722    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:02.918956 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.918736    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d537bd9-741d-448c-83ac-a0300dcc94a6-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:02.932342 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.932309    4522 generic.go:356] "Generic (PLEG): container finished" podID="0c90b3ce-f6a1-4ce6-a690-7831b4638d29" containerID="b5f623651728fc1860fa5f6826d04bfe39bdfddb14229e6c87ce6ed63defb605" exitCode=0
Oct 30 21:42:02.932496 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.932373    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"
Oct 30 21:42:02.932496 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.932390    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr" event={"ID":"0c90b3ce-f6a1-4ce6-a690-7831b4638d29","Type":"ContainerDied","Data":"b5f623651728fc1860fa5f6826d04bfe39bdfddb14229e6c87ce6ed63defb605"}
Oct 30 21:42:02.932496 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.932485    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr" event={"ID":"0c90b3ce-f6a1-4ce6-a690-7831b4638d29","Type":"ContainerDied","Data":"b05b25d94b08af011f34504b0f1937bc1946cb7975ba05e65b501e07c3a965ce"}
Oct 30 21:42:02.932719 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.932541    4522 scope.go:122] "RemoveContainer" containerID="b5f623651728fc1860fa5f6826d04bfe39bdfddb14229e6c87ce6ed63defb605"
Oct 30 21:42:02.934015 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.933995    4522 generic.go:356] "Generic (PLEG): container finished" podID="8d537bd9-741d-448c-83ac-a0300dcc94a6" containerID="7486a0c8737f1101fe05e95f918ebc171d9a0e5f2e30f027dc6211c9da1de026" exitCode=0
Oct 30 21:42:02.934129 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.934107    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn" event={"ID":"8d537bd9-741d-448c-83ac-a0300dcc94a6","Type":"ContainerDied","Data":"7486a0c8737f1101fe05e95f918ebc171d9a0e5f2e30f027dc6211c9da1de026"}
Oct 30 21:42:02.934194 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.934141    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn" event={"ID":"8d537bd9-741d-448c-83ac-a0300dcc94a6","Type":"ContainerDied","Data":"2f2c246aa0caaeaa4db9fadd26f46796bb5a7f20ecf8be54a5bdec85e19bb87c"}
Oct 30 21:42:02.934251 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.934212    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"
Oct 30 21:42:02.944954 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.944938    4522 scope.go:122] "RemoveContainer" containerID="b5f623651728fc1860fa5f6826d04bfe39bdfddb14229e6c87ce6ed63defb605"
Oct 30 21:42:02.945273 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:42:02.945255    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5f623651728fc1860fa5f6826d04bfe39bdfddb14229e6c87ce6ed63defb605\": container with ID starting with b5f623651728fc1860fa5f6826d04bfe39bdfddb14229e6c87ce6ed63defb605 not found: ID does not exist" containerID="b5f623651728fc1860fa5f6826d04bfe39bdfddb14229e6c87ce6ed63defb605"
Oct 30 21:42:02.945355 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.945281    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5f623651728fc1860fa5f6826d04bfe39bdfddb14229e6c87ce6ed63defb605"} err="failed to get container status \"b5f623651728fc1860fa5f6826d04bfe39bdfddb14229e6c87ce6ed63defb605\": rpc error: code = NotFound desc = could not find container \"b5f623651728fc1860fa5f6826d04bfe39bdfddb14229e6c87ce6ed63defb605\": container with ID starting with b5f623651728fc1860fa5f6826d04bfe39bdfddb14229e6c87ce6ed63defb605 not found: ID does not exist"
Oct 30 21:42:02.945355 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.945297    4522 scope.go:122] "RemoveContainer" containerID="7486a0c8737f1101fe05e95f918ebc171d9a0e5f2e30f027dc6211c9da1de026"
Oct 30 21:42:02.957145 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.957108    4522 scope.go:122] "RemoveContainer" containerID="7486a0c8737f1101fe05e95f918ebc171d9a0e5f2e30f027dc6211c9da1de026"
Oct 30 21:42:02.957569 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:42:02.957536    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7486a0c8737f1101fe05e95f918ebc171d9a0e5f2e30f027dc6211c9da1de026\": container with ID starting with 7486a0c8737f1101fe05e95f918ebc171d9a0e5f2e30f027dc6211c9da1de026 not found: ID does not exist" containerID="7486a0c8737f1101fe05e95f918ebc171d9a0e5f2e30f027dc6211c9da1de026"
Oct 30 21:42:02.957653 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:02.957577    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7486a0c8737f1101fe05e95f918ebc171d9a0e5f2e30f027dc6211c9da1de026"} err="failed to get container status \"7486a0c8737f1101fe05e95f918ebc171d9a0e5f2e30f027dc6211c9da1de026\": rpc error: code = NotFound desc = could not find container \"7486a0c8737f1101fe05e95f918ebc171d9a0e5f2e30f027dc6211c9da1de026\": container with ID starting with 7486a0c8737f1101fe05e95f918ebc171d9a0e5f2e30f027dc6211c9da1de026 not found: ID does not exist"
Oct 30 21:42:03.096807 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:03.096736    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"]
Oct 30 21:42:03.100787 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:03.100761    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr"]
Oct 30 21:42:03.196303 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:03.196217    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0c90b3ce-f6a1-4ce6-a690-7831b4638d29" path="/var/lib/kubelet/pods/0c90b3ce-f6a1-4ce6-a690-7831b4638d29/volumes"
Oct 30 21:42:03.207541 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:03.207510    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"]
Oct 30 21:42:03.213896 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:03.213862    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-k8lnn"]
Oct 30 21:42:03.548604 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:03.548520    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:42:03.548766 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:03.548596    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-d6qfr" podUID="0c90b3ce-f6a1-4ce6-a690-7831b4638d29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:42:03.570058 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:03.570034    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:04.270060 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:04.270030    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:05.193656 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:05.193616    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8d537bd9-741d-448c-83ac-a0300dcc94a6" path="/var/lib/kubelet/pods/8d537bd9-741d-448c-83ac-a0300dcc94a6/volumes"
Oct 30 21:42:05.981876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:05.981842    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:07.988403 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:42:07.988370    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:42:09.070425 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:09.070394    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:42:10.781069 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:10.781028    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:13.956650 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:13.956566    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:15.787452 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:15.787408    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:18.972752 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:18.972719    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"]
Oct 30 21:42:19.021854 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:19.021822    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"]
Oct 30 21:42:19.255794 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:19.255715    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:19.976214 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:19.976182    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:20.259979 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:20.259894    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:21.343433 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:21.343399    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:22.083695 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:22.083660    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:25.632719 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:25.632685    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:25.862513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:25.862444    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:26.524702 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:26.524668    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:26.778711 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:26.778628    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:27.018885 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:27.018859    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:27.338255 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:27.338218    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:28.895386 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:28.895355    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:29.182414 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:29.182384    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:29.478868 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:29.478786    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:29.951385 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:29.951352    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:31.383217 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:31.382630    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:33.992831 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:33.992775    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk" podUID="58f59123-9a14-4cd0-8c9e-17448eae2bca" containerName="main" containerID="cri-o://0e325845bb794a6cc9eab62c9b5c18d940af7e848989bfb3d427506b77ebf7e9" gracePeriod=45
Oct 30 21:42:34.044878 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.044802    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7" podUID="504b9039-7a53-4f4d-bf60-20eceb9f6d3c" containerName="main" containerID="cri-o://125f5ee81a409355bd31286820b47dab761a2cc3fd2f89894cae7d40f173c208" gracePeriod=45
Oct 30 21:42:34.103185 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.101792    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk" podUID="58f59123-9a14-4cd0-8c9e-17448eae2bca" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": dial tcp 10.133.0.44:8000: connect: connection refused"
Oct 30 21:42:34.182330 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.182175    4522 generic.go:356] "Generic (PLEG): container finished" podID="58f59123-9a14-4cd0-8c9e-17448eae2bca" containerID="0e325845bb794a6cc9eab62c9b5c18d940af7e848989bfb3d427506b77ebf7e9" exitCode=0
Oct 30 21:42:34.182330 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.182244    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk" event={"ID":"58f59123-9a14-4cd0-8c9e-17448eae2bca","Type":"ContainerDied","Data":"0e325845bb794a6cc9eab62c9b5c18d940af7e848989bfb3d427506b77ebf7e9"}
Oct 30 21:42:34.794859 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.794836    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:42:34.798657 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.798630    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:42:34.887672 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.887645    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-home\" (UniqueName: \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-home\") pod \"58f59123-9a14-4cd0-8c9e-17448eae2bca\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") "
Oct 30 21:42:34.887807 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.887714    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-home\" (UniqueName: \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-home\") pod \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") "
Oct 30 21:42:34.887807 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.887746    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-kube-api-access-qj89t\" (UniqueName: \"kubernetes.io/projected/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-kube-api-access-qj89t\") pod \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") "
Oct 30 21:42:34.887807 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.887796    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-tmp-dir\") pod \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") "
Oct 30 21:42:34.888034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.887841    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58f59123-9a14-4cd0-8c9e-17448eae2bca-tls-certs\" (UniqueName: \"kubernetes.io/secret/58f59123-9a14-4cd0-8c9e-17448eae2bca-tls-certs\") pod \"58f59123-9a14-4cd0-8c9e-17448eae2bca\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") "
Oct 30 21:42:34.888034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.887918    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-home" pod "58f59123-9a14-4cd0-8c9e-17448eae2bca" (UID: "58f59123-9a14-4cd0-8c9e-17448eae2bca"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:34.888034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.887988    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-model-cache\") pod \"58f59123-9a14-4cd0-8c9e-17448eae2bca\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") "
Oct 30 21:42:34.888034 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.888015    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-model-cache\") pod \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") "
Oct 30 21:42:34.888245 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.888028    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-home" pod "504b9039-7a53-4f4d-bf60-20eceb9f6d3c" (UID: "504b9039-7a53-4f4d-bf60-20eceb9f6d3c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:34.888245 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.888041    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-tmp-dir" pod "504b9039-7a53-4f4d-bf60-20eceb9f6d3c" (UID: "504b9039-7a53-4f4d-bf60-20eceb9f6d3c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:34.888245 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.888056    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/58f59123-9a14-4cd0-8c9e-17448eae2bca-kube-api-access-zh49b\" (UniqueName: \"kubernetes.io/projected/58f59123-9a14-4cd0-8c9e-17448eae2bca-kube-api-access-zh49b\") pod \"58f59123-9a14-4cd0-8c9e-17448eae2bca\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") "
Oct 30 21:42:34.888245 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.888079    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-dshm\") pod \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") "
Oct 30 21:42:34.888245 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.888107    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-tls-certs\" (UniqueName: \"kubernetes.io/secret/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-tls-certs\") pod \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\" (UID: \"504b9039-7a53-4f4d-bf60-20eceb9f6d3c\") "
Oct 30 21:42:34.888245 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.888188    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-tmp-dir\") pod \"58f59123-9a14-4cd0-8c9e-17448eae2bca\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") "
Oct 30 21:42:34.888245 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.888235    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-dshm\" (UniqueName: \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-dshm\") pod \"58f59123-9a14-4cd0-8c9e-17448eae2bca\" (UID: \"58f59123-9a14-4cd0-8c9e-17448eae2bca\") "
Oct 30 21:42:34.888245 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.888244    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-model-cache" pod "504b9039-7a53-4f4d-bf60-20eceb9f6d3c" (UID: "504b9039-7a53-4f4d-bf60-20eceb9f6d3c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:34.888665 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.888471    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-tmp-dir" pod "58f59123-9a14-4cd0-8c9e-17448eae2bca" (UID: "58f59123-9a14-4cd0-8c9e-17448eae2bca"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:34.888665 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.888573    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-model-cache" pod "58f59123-9a14-4cd0-8c9e-17448eae2bca" (UID: "58f59123-9a14-4cd0-8c9e-17448eae2bca"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:34.888833 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.888816    4522 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-home\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:34.888894 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.888838    4522 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-home\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:34.888894 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.888853    4522 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-tmp-dir\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:34.888894 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.888866    4522 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-model-cache\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:34.888894 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.888881    4522 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-model-cache\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:34.889072 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.888896    4522 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-tmp-dir\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:34.890606 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.890581    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58f59123-9a14-4cd0-8c9e-17448eae2bca-tls-certs" pod "58f59123-9a14-4cd0-8c9e-17448eae2bca" (UID: "58f59123-9a14-4cd0-8c9e-17448eae2bca"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:42:34.890695 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.890600    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-kube-api-access-qj89t" pod "504b9039-7a53-4f4d-bf60-20eceb9f6d3c" (UID: "504b9039-7a53-4f4d-bf60-20eceb9f6d3c"). InnerVolumeSpecName "kube-api-access-qj89t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:42:34.890695 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.890688    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-dshm" pod "504b9039-7a53-4f4d-bf60-20eceb9f6d3c" (UID: "504b9039-7a53-4f4d-bf60-20eceb9f6d3c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:34.890795 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.890716    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58f59123-9a14-4cd0-8c9e-17448eae2bca-kube-api-access-zh49b" pod "58f59123-9a14-4cd0-8c9e-17448eae2bca" (UID: "58f59123-9a14-4cd0-8c9e-17448eae2bca"). InnerVolumeSpecName "kube-api-access-zh49b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:42:34.890865 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.890847    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-dshm" pod "58f59123-9a14-4cd0-8c9e-17448eae2bca" (UID: "58f59123-9a14-4cd0-8c9e-17448eae2bca"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:34.890865 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.890856    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-tls-certs" pod "504b9039-7a53-4f4d-bf60-20eceb9f6d3c" (UID: "504b9039-7a53-4f4d-bf60-20eceb9f6d3c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:42:34.990913 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.990848    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zh49b\" (UniqueName: \"kubernetes.io/projected/58f59123-9a14-4cd0-8c9e-17448eae2bca-kube-api-access-zh49b\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:34.990913 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.990883    4522 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-dshm\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:34.990913 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.990899    4522 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-tls-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:34.990913 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.990912    4522 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58f59123-9a14-4cd0-8c9e-17448eae2bca-dshm\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:34.991124 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.990925    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj89t\" (UniqueName: \"kubernetes.io/projected/504b9039-7a53-4f4d-bf60-20eceb9f6d3c-kube-api-access-qj89t\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:34.991124 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:34.990938    4522 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58f59123-9a14-4cd0-8c9e-17448eae2bca-tls-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:35.190243 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:35.190209    4522 generic.go:356] "Generic (PLEG): container finished" podID="504b9039-7a53-4f4d-bf60-20eceb9f6d3c" containerID="125f5ee81a409355bd31286820b47dab761a2cc3fd2f89894cae7d40f173c208" exitCode=0
Oct 30 21:42:35.190753 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:35.190311    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"
Oct 30 21:42:35.191830 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:35.191807    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:42:35.192740 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:35.192709    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7" event={"ID":"504b9039-7a53-4f4d-bf60-20eceb9f6d3c","Type":"ContainerDied","Data":"125f5ee81a409355bd31286820b47dab761a2cc3fd2f89894cae7d40f173c208"}
Oct 30 21:42:35.192815 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:35.192757    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7" event={"ID":"504b9039-7a53-4f4d-bf60-20eceb9f6d3c","Type":"ContainerDied","Data":"feda00e5d1e6033a69bd0e87f11d84f109012072d511550824675d2dc57f265a"}
Oct 30 21:42:35.192815 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:35.192774    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk" event={"ID":"58f59123-9a14-4cd0-8c9e-17448eae2bca","Type":"ContainerDied","Data":"48c46335a13822b034cce06001253d34a99279f544e20fbab82c58156667b8f8"}
Oct 30 21:42:35.192815 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:35.192798    4522 scope.go:122] "RemoveContainer" containerID="125f5ee81a409355bd31286820b47dab761a2cc3fd2f89894cae7d40f173c208"
Oct 30 21:42:35.206858 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:35.206843    4522 scope.go:122] "RemoveContainer" containerID="125f5ee81a409355bd31286820b47dab761a2cc3fd2f89894cae7d40f173c208"
Oct 30 21:42:35.207084 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:42:35.207068    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"125f5ee81a409355bd31286820b47dab761a2cc3fd2f89894cae7d40f173c208\": container with ID starting with 125f5ee81a409355bd31286820b47dab761a2cc3fd2f89894cae7d40f173c208 not found: ID does not exist" containerID="125f5ee81a409355bd31286820b47dab761a2cc3fd2f89894cae7d40f173c208"
Oct 30 21:42:35.207142 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:35.207091    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"125f5ee81a409355bd31286820b47dab761a2cc3fd2f89894cae7d40f173c208"} err="failed to get container status \"125f5ee81a409355bd31286820b47dab761a2cc3fd2f89894cae7d40f173c208\": rpc error: code = NotFound desc = could not find container \"125f5ee81a409355bd31286820b47dab761a2cc3fd2f89894cae7d40f173c208\": container with ID starting with 125f5ee81a409355bd31286820b47dab761a2cc3fd2f89894cae7d40f173c208 not found: ID does not exist"
Oct 30 21:42:35.207142 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:35.207109    4522 scope.go:122] "RemoveContainer" containerID="0e325845bb794a6cc9eab62c9b5c18d940af7e848989bfb3d427506b77ebf7e9"
Oct 30 21:42:35.357023 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:35.356944    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"]
Oct 30 21:42:35.361562 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:35.361536    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7"]
Oct 30 21:42:35.620056 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:35.619957    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-847c62/simulator-w4-847c62-kserve-79945b54f7-jnwz7" podUID="504b9039-7a53-4f4d-bf60-20eceb9f6d3c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:42:36.830074 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:36.828368    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:37.197080 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:37.197052    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="504b9039-7a53-4f4d-bf60-20eceb9f6d3c" path="/var/lib/kubelet/pods/504b9039-7a53-4f4d-bf60-20eceb9f6d3c/volumes"
Oct 30 21:42:38.084674 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:42:38.084587    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:42:38.109508 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:38.109393    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:38.559759 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:38.559722    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:42.571910 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:42.571881    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:43.049394 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:43.049358    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:43.379683 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:43.379578    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:45.712773 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:45.712745    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:45.962919 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:45.962826    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:46.249571 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:46.249478    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:46.562609 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:46.562484    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:46.931872 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:46.931838    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:47.584539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:47.584503    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:47.864700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:47.864613    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:48.604181 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:48.603401    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:48.922973 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:48.922915    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:49.204493 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:49.204387    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:51.189338 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:51.189292    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:51.573804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:51.573714    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:52.296771 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:52.296735    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:52.613143 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:52.613074    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:54.819380 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:54.819321    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:55.302400 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:55.302363    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:55.657630 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:42:55.657538    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:00.095582 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:00.095547    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:00.615702 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:00.615668    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:00.874571 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:00.872769    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:01.137598 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:01.137514    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:05.013908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:05.013873    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:43:05.205059 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:05.205020    4522 pod_container_manager_linux.go:218] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod58f59123-9a14-4cd0-8c9e-17448eae2bca"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod58f59123-9a14-4cd0-8c9e-17448eae2bca] : Timed out while waiting for systemd to remove kubepods-besteffort-pod58f59123_9a14_4cd0_8c9e_17448eae2bca.slice"
Oct 30 21:43:05.205230 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:43:05.205060    4522 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod58f59123-9a14-4cd0-8c9e-17448eae2bca] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod58f59123-9a14-4cd0-8c9e-17448eae2bca] : Timed out while waiting for systemd to remove kubepods-besteffort-pod58f59123_9a14_4cd0_8c9e_17448eae2bca.slice" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk" podUID="58f59123-9a14-4cd0-8c9e-17448eae2bca"
Oct 30 21:43:05.392986 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:05.392917    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"
Oct 30 21:43:05.578479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:05.577718    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"]
Oct 30 21:43:05.596815 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:05.592153    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-847c62/premium-w4-847c62-kserve-6597cd59bd-2zkkk"]
Oct 30 21:43:06.609614 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:06.609568    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:07.193085 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:07.193052    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="58f59123-9a14-4cd0-8c9e-17448eae2bca" path="/var/lib/kubelet/pods/58f59123-9a14-4cd0-8c9e-17448eae2bca/volumes"
Oct 30 21:43:07.989852 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:43:07.989820    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:43:11.790637 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:11.790600    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:12.332342 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:12.332298    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:12.569165 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:12.569133    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:13.879686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:13.879655    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:18.045447 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:18.045405    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:21.499046 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:21.499011    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:22.674268 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:22.674230    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:23.328399 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:23.328371    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:23.831598 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:23.831561    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:24.091064 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:24.090944    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:25.388947 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:25.388915    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:25.607376 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:25.607336    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:27.093415 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:27.093387    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:28.597922 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:28.597840    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:28.928103 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:28.928071    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:29.170403 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:29.170358    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:30.322010 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:30.321978    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:30.554610 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:30.554567    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:30.798856 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:30.798814    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:31.424802 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:31.424774    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:33.197584 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:33.182234    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:33.404820 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:33.404786    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:36.480823 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:36.480787    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:36.704767 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:36.704732    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:36.926916 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:36.926886    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:37.988734 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:43:37.988699    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:43:40.155613 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:40.155573    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:40.392846 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:40.392812    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:40.669881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:40.669837    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:41.227763 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:41.227732    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:42.118289 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:42.117186    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:43.952637 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:43.952563    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:43:46.116994 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:46.116962    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"]
Oct 30 21:43:46.166365 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:46.166331    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"]
Oct 30 21:43:46.330171 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:46.330140    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:46.647173 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:46.647145    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:48.240641 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:48.240603    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:48.455470 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:48.455440    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:48.655748 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:48.655667    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:49.203889 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:49.203854    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:53.701258 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:53.701224    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:53.906375 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:53.906347    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:56.933970 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:56.933934    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:57.160672 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:57.160642    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:57.250414 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:57.250332    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"]
Oct 30 21:43:57.250631 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:57.250604    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5" podUID="76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" containerName="istio-proxy" containerID="cri-o://cdf77882b0291bdaeb297649d3a6e752df70ceb1c98d0f44d39b46a68e637c27" gracePeriod=30
Oct 30 21:43:57.256385 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:57.256360    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"]
Oct 30 21:43:57.256567 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:57.256547    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l" podUID="3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" containerName="istio-proxy" containerID="cri-o://d11a6680b1fe6310dd2fb3b26670bfcfe559876c543a9f465ff3f38f89811097" gracePeriod=30
Oct 30 21:43:57.283509 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:57.283481    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"]
Oct 30 21:43:57.283673 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:57.283654    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl" podUID="2c9e599f-fc25-4057-b762-f2a2c53ee3fd" containerName="istio-proxy" containerID="cri-o://f66ef876b50d6edc1ce2348ab79a824ce9962c4e79c78b83c753ad3d7b08055b" gracePeriod=30
Oct 30 21:43:57.419483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:57.405409    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:57.515073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:57.514988    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:43:57.515073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:57.515058    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5" podUID="76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:43:57.966705 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:57.966670    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:43:57.967077 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:57.966725    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l" podUID="3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:43:58.009766 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:58.009728    4522 patch_prober.go:29] interesting pod/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:43:58.009902 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:58.009785    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl" podUID="2c9e599f-fc25-4057-b762-f2a2c53ee3fd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:43:59.012729 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:59.012686    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:59.236538 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:59.234926    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:59.481807 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:43:59.481776    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:01.137152 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.137105    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n" podUID="5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15" containerName="main" containerID="cri-o://f2e91e7972de439ba20afbed8a8312db2567c19e437018bb657b73a83337cf68" gracePeriod=45
Oct 30 21:44:01.186091 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.186032    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n" podUID="d9eadf71-d6c7-400f-9c6f-bea93e8a3750" containerName="main" containerID="cri-o://0a911e7459a0a1da287b0b804186da6f3a50ea97871fa988c5278387e9f267be" gracePeriod=45
Oct 30 21:44:01.505114 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.505088    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:44:01.508850 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.508828    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:44:01.588946 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.588922    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-tmp-dir\") pod \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") "
Oct 30 21:44:01.589059 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.588970    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-tls-certs\" (UniqueName: \"kubernetes.io/secret/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-tls-certs\") pod \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") "
Oct 30 21:44:01.589059 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.589032    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-home\" (UniqueName: \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-home\") pod \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") "
Oct 30 21:44:01.589165 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.589061    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-kube-api-access-h5wxn\" (UniqueName: \"kubernetes.io/projected/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-kube-api-access-h5wxn\") pod \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") "
Oct 30 21:44:01.589165 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.589081    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-model-cache\") pod \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") "
Oct 30 21:44:01.589165 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.589106    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-home\" (UniqueName: \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-home\") pod \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") "
Oct 30 21:44:01.589336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.589161    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-tmp-dir" pod "5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15" (UID: "5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:01.589336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.589214    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-model-cache\") pod \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") "
Oct 30 21:44:01.589336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.589279    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-tls-certs\" (UniqueName: \"kubernetes.io/secret/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-tls-certs\") pod \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") "
Oct 30 21:44:01.589336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.589323    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-home" pod "d9eadf71-d6c7-400f-9c6f-bea93e8a3750" (UID: "d9eadf71-d6c7-400f-9c6f-bea93e8a3750"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:01.589547 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.589329    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-home" pod "5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15" (UID: "5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:01.589547 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.589352    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-kube-api-access-7g8kg\" (UniqueName: \"kubernetes.io/projected/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-kube-api-access-7g8kg\") pod \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") "
Oct 30 21:44:01.589547 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.589349    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-model-cache" pod "5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15" (UID: "5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:01.589547 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.589413    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-dshm\" (UniqueName: \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-dshm\") pod \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\" (UID: \"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15\") "
Oct 30 21:44:01.589547 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.589470    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-dshm\") pod \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") "
Oct 30 21:44:01.589811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.589576    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-tmp-dir\") pod \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\" (UID: \"d9eadf71-d6c7-400f-9c6f-bea93e8a3750\") "
Oct 30 21:44:01.589811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.589775    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-model-cache" pod "d9eadf71-d6c7-400f-9c6f-bea93e8a3750" (UID: "d9eadf71-d6c7-400f-9c6f-bea93e8a3750"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:01.590321 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.590296    4522 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-tmp-dir\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:01.590430 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.590324    4522 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-home\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:01.590430 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.590340    4522 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-model-cache\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:01.590651 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.590614    4522 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-home\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:01.590651 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.590635    4522 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-model-cache\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:01.591743 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.591200    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-tmp-dir" pod "d9eadf71-d6c7-400f-9c6f-bea93e8a3750" (UID: "d9eadf71-d6c7-400f-9c6f-bea93e8a3750"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:01.591967 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.591935    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-kube-api-access-h5wxn" pod "5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15" (UID: "5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15"). InnerVolumeSpecName "kube-api-access-h5wxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:01.592990 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.592957    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-tls-certs" pod "5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15" (UID: "5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:01.593258 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.593222    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-tls-certs" pod "d9eadf71-d6c7-400f-9c6f-bea93e8a3750" (UID: "d9eadf71-d6c7-400f-9c6f-bea93e8a3750"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:01.593520 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.593400    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-dshm" pod "5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15" (UID: "5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:01.593671 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.593643    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-kube-api-access-7g8kg" pod "d9eadf71-d6c7-400f-9c6f-bea93e8a3750" (UID: "d9eadf71-d6c7-400f-9c6f-bea93e8a3750"). InnerVolumeSpecName "kube-api-access-7g8kg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:01.593778 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.593684    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-dshm" pod "d9eadf71-d6c7-400f-9c6f-bea93e8a3750" (UID: "d9eadf71-d6c7-400f-9c6f-bea93e8a3750"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:01.691634 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.691605    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5wxn\" (UniqueName: \"kubernetes.io/projected/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-kube-api-access-h5wxn\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:01.691634 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.691632    4522 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-tls-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:01.691634 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.691641    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7g8kg\" (UniqueName: \"kubernetes.io/projected/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-kube-api-access-7g8kg\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:01.691847 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.691652    4522 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15-dshm\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:01.691847 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.691660    4522 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-dshm\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:01.691847 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.691668    4522 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-tmp-dir\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:01.691847 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.691675    4522 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9eadf71-d6c7-400f-9c6f-bea93e8a3750-tls-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:01.794949 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.794861    4522 generic.go:356] "Generic (PLEG): container finished" podID="d9eadf71-d6c7-400f-9c6f-bea93e8a3750" containerID="0a911e7459a0a1da287b0b804186da6f3a50ea97871fa988c5278387e9f267be" exitCode=0
Oct 30 21:44:01.794949 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.794901    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"
Oct 30 21:44:01.795606 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.794942    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n" event={"ID":"d9eadf71-d6c7-400f-9c6f-bea93e8a3750","Type":"ContainerDied","Data":"0a911e7459a0a1da287b0b804186da6f3a50ea97871fa988c5278387e9f267be"}
Oct 30 21:44:01.795606 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.794988    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n" event={"ID":"d9eadf71-d6c7-400f-9c6f-bea93e8a3750","Type":"ContainerDied","Data":"660f8b22c1072ca0e83f9e05208c1c1df8499e8313b2bc79f7c43f06fd48074f"}
Oct 30 21:44:01.795606 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.795005    4522 scope.go:122] "RemoveContainer" containerID="0a911e7459a0a1da287b0b804186da6f3a50ea97871fa988c5278387e9f267be"
Oct 30 21:44:01.796626 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.796596    4522 generic.go:356] "Generic (PLEG): container finished" podID="5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15" containerID="f2e91e7972de439ba20afbed8a8312db2567c19e437018bb657b73a83337cf68" exitCode=0
Oct 30 21:44:01.796720 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.796626    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n" event={"ID":"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15","Type":"ContainerDied","Data":"f2e91e7972de439ba20afbed8a8312db2567c19e437018bb657b73a83337cf68"}
Oct 30 21:44:01.796720 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.796649    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"
Oct 30 21:44:01.796720 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.796665    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n" event={"ID":"5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15","Type":"ContainerDied","Data":"75751fb4c1aaab27c7e1e452e2ed3b1288acb78a513850b08216a214fd85bb29"}
Oct 30 21:44:01.804357 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.804340    4522 scope.go:122] "RemoveContainer" containerID="0a911e7459a0a1da287b0b804186da6f3a50ea97871fa988c5278387e9f267be"
Oct 30 21:44:01.804718 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:44:01.804694    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a911e7459a0a1da287b0b804186da6f3a50ea97871fa988c5278387e9f267be\": container with ID starting with 0a911e7459a0a1da287b0b804186da6f3a50ea97871fa988c5278387e9f267be not found: ID does not exist" containerID="0a911e7459a0a1da287b0b804186da6f3a50ea97871fa988c5278387e9f267be"
Oct 30 21:44:01.804787 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.804730    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a911e7459a0a1da287b0b804186da6f3a50ea97871fa988c5278387e9f267be"} err="failed to get container status \"0a911e7459a0a1da287b0b804186da6f3a50ea97871fa988c5278387e9f267be\": rpc error: code = NotFound desc = could not find container \"0a911e7459a0a1da287b0b804186da6f3a50ea97871fa988c5278387e9f267be\": container with ID starting with 0a911e7459a0a1da287b0b804186da6f3a50ea97871fa988c5278387e9f267be not found: ID does not exist"
Oct 30 21:44:01.804787 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.804752    4522 scope.go:122] "RemoveContainer" containerID="f2e91e7972de439ba20afbed8a8312db2567c19e437018bb657b73a83337cf68"
Oct 30 21:44:01.814017 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.813997    4522 scope.go:122] "RemoveContainer" containerID="f2e91e7972de439ba20afbed8a8312db2567c19e437018bb657b73a83337cf68"
Oct 30 21:44:01.814255 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:44:01.814236    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2e91e7972de439ba20afbed8a8312db2567c19e437018bb657b73a83337cf68\": container with ID starting with f2e91e7972de439ba20afbed8a8312db2567c19e437018bb657b73a83337cf68 not found: ID does not exist" containerID="f2e91e7972de439ba20afbed8a8312db2567c19e437018bb657b73a83337cf68"
Oct 30 21:44:01.814313 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.814260    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2e91e7972de439ba20afbed8a8312db2567c19e437018bb657b73a83337cf68"} err="failed to get container status \"f2e91e7972de439ba20afbed8a8312db2567c19e437018bb657b73a83337cf68\": rpc error: code = NotFound desc = could not find container \"f2e91e7972de439ba20afbed8a8312db2567c19e437018bb657b73a83337cf68\": container with ID starting with f2e91e7972de439ba20afbed8a8312db2567c19e437018bb657b73a83337cf68 not found: ID does not exist"
Oct 30 21:44:01.961141 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.961107    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"]
Oct 30 21:44:01.967602 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:01.967573    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-0a4eab/premium-w5-0a4eab-kserve-6b9565bdd4-nqs6n"]
Oct 30 21:44:02.079979 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.079897    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"]
Oct 30 21:44:02.086507 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.085528    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-0a4eab/distinct-2-w5-0a4eab-kserve-6c5d758588-sf55n"]
Oct 30 21:44:02.550796 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.550769    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:44:02.563956 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.563931    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:44:02.618525 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.618495    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istiod-ca-cert\") pod \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") "
Oct 30 21:44:02.618788 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.618768    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-podinfo\") pod \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") "
Oct 30 21:44:02.619003 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.618988    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-workload-socket\") pod \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") "
Oct 30 21:44:02.619129 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.619115    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-kube-api-access-twc4b\" (UniqueName: \"kubernetes.io/projected/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-kube-api-access-twc4b\") pod \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") "
Oct 30 21:44:02.619282 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.619268    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-data\") pod \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") "
Oct 30 21:44:02.619438 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.619424    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-credential-socket\") pod \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") "
Oct 30 21:44:02.619571 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.619557    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-workload-certs\") pod \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") "
Oct 30 21:44:02.619741 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.619728    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-envoy\") pod \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") "
Oct 30 21:44:02.619843 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.619832    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-token\" (UniqueName: \"kubernetes.io/projected/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-token\") pod \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") "
Oct 30 21:44:02.619977 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.619963    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-podinfo\") pod \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") "
Oct 30 21:44:02.620089 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.620076    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-workload-socket\") pod \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") "
Oct 30 21:44:02.620203 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.620191    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-workload-certs\") pod \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") "
Oct 30 21:44:02.620360 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.620346    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-data\") pod \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") "
Oct 30 21:44:02.620492 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.620478    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-kube-api-access-j6qtc\" (UniqueName: \"kubernetes.io/projected/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-kube-api-access-j6qtc\") pod \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") "
Oct 30 21:44:02.620624 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.620612    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-credential-socket\") pod \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") "
Oct 30 21:44:02.620721 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.620709    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-envoy\") pod \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") "
Oct 30 21:44:02.620825 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.620813    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-token\" (UniqueName: \"kubernetes.io/projected/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-token\") pod \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\" (UID: \"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9\") "
Oct 30 21:44:02.620920 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.620906    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istiod-ca-cert\") pod \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\" (UID: \"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd\") "
Oct 30 21:44:02.621886 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.620924    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-workload-certs" pod "76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" (UID: "76e3b1d2-3569-45a7-a6f1-26bd831bc9cd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:02.622019 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.621162    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-credential-socket" pod "3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" (UID: "3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:02.622155 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.621169    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-workload-socket" pod "76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" (UID: "76e3b1d2-3569-45a7-a6f1-26bd831bc9cd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:02.622232 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.621179    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-workload-certs" pod "3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" (UID: "3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:02.622318 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.621188    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-data" pod "3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" (UID: "3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:02.622395 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.621370    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-credential-socket" pod "76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" (UID: "76e3b1d2-3569-45a7-a6f1-26bd831bc9cd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:02.622501 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.621604    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-data" pod "76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" (UID: "76e3b1d2-3569-45a7-a6f1-26bd831bc9cd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:02.622598 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.621640    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istiod-ca-cert" pod "3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" (UID: "3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:02.622986 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.622962    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-workload-socket" pod "3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" (UID: "3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:02.623127 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.623098    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istiod-ca-cert" pod "76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" (UID: "76e3b1d2-3569-45a7-a6f1-26bd831bc9cd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:02.623943 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.623883    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-envoy" pod "3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" (UID: "3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:02.623943 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.623894    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-kube-api-access-twc4b" pod "76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" (UID: "76e3b1d2-3569-45a7-a6f1-26bd831bc9cd"). InnerVolumeSpecName "kube-api-access-twc4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:02.623943 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.623920    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-podinfo" pod "3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" (UID: "3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:44:02.624490 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.624167    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-kube-api-access-j6qtc" pod "3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" (UID: "3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9"). InnerVolumeSpecName "kube-api-access-j6qtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:02.625601 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.625577    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-podinfo" pod "76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" (UID: "76e3b1d2-3569-45a7-a6f1-26bd831bc9cd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:44:02.626239 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.626202    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-token" pod "76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" (UID: "76e3b1d2-3569-45a7-a6f1-26bd831bc9cd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:02.626239 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.626205    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-envoy" pod "76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" (UID: "76e3b1d2-3569-45a7-a6f1-26bd831bc9cd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:02.626239 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.626219    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-token" pod "3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" (UID: "3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:02.630119 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.630103    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:44:02.722674 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.722646    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-token\" (UniqueName: \"kubernetes.io/projected/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-token\") pod \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") "
Oct 30 21:44:02.722809 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.722683    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-envoy\") pod \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") "
Oct 30 21:44:02.722809 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.722744    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istiod-ca-cert\") pod \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") "
Oct 30 21:44:02.722809 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.722772    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-podinfo\") pod \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") "
Oct 30 21:44:02.722809 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.722790    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-workload-socket\") pod \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") "
Oct 30 21:44:02.723019 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.722834    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-kube-api-access-8dws5\" (UniqueName: \"kubernetes.io/projected/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-kube-api-access-8dws5\") pod \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") "
Oct 30 21:44:02.723019 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.722899    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-workload-certs\") pod \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") "
Oct 30 21:44:02.723019 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.722965    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-data\") pod \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") "
Oct 30 21:44:02.723173 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723090    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-credential-socket\") pod \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\" (UID: \"2c9e599f-fc25-4057-b762-f2a2c53ee3fd\") "
Oct 30 21:44:02.723173 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723154    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istiod-ca-cert" pod "2c9e599f-fc25-4057-b762-f2a2c53ee3fd" (UID: "2c9e599f-fc25-4057-b762-f2a2c53ee3fd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:02.723711 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723603    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.723711 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723627    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.723711 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723640    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.723711 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723652    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.723711 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723665    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6qtc\" (UniqueName: \"kubernetes.io/projected/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-kube-api-access-j6qtc\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.723711 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723661    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-workload-certs" pod "2c9e599f-fc25-4057-b762-f2a2c53ee3fd" (UID: "2c9e599f-fc25-4057-b762-f2a2c53ee3fd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:02.723711 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723670    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-data" pod "2c9e599f-fc25-4057-b762-f2a2c53ee3fd" (UID: "2c9e599f-fc25-4057-b762-f2a2c53ee3fd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:02.723711 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723678    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.723711 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723686    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-workload-socket" pod "2c9e599f-fc25-4057-b762-f2a2c53ee3fd" (UID: "2c9e599f-fc25-4057-b762-f2a2c53ee3fd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:02.723711 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723709    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.724357 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723727    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.724357 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723741    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.724357 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723754    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.724357 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723767    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.724357 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723780    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.724357 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723793    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twc4b\" (UniqueName: \"kubernetes.io/projected/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-kube-api-access-twc4b\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.724357 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723837    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.724357 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723849    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.724357 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723862    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.724357 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723868    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-credential-socket" pod "2c9e599f-fc25-4057-b762-f2a2c53ee3fd" (UID: "2c9e599f-fc25-4057-b762-f2a2c53ee3fd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:02.724357 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723875    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.724357 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723902    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.724357 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.723926    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.725291 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.725265    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-token" pod "2c9e599f-fc25-4057-b762-f2a2c53ee3fd" (UID: "2c9e599f-fc25-4057-b762-f2a2c53ee3fd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:02.725401 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.725366    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-envoy" pod "2c9e599f-fc25-4057-b762-f2a2c53ee3fd" (UID: "2c9e599f-fc25-4057-b762-f2a2c53ee3fd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:02.725795 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.725775    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-kube-api-access-8dws5" pod "2c9e599f-fc25-4057-b762-f2a2c53ee3fd" (UID: "2c9e599f-fc25-4057-b762-f2a2c53ee3fd"). InnerVolumeSpecName "kube-api-access-8dws5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:02.725867 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.725800    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-podinfo" pod "2c9e599f-fc25-4057-b762-f2a2c53ee3fd" (UID: "2c9e599f-fc25-4057-b762-f2a2c53ee3fd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:44:02.804649 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.804620    4522 generic.go:356] "Generic (PLEG): container finished" podID="2c9e599f-fc25-4057-b762-f2a2c53ee3fd" containerID="f66ef876b50d6edc1ce2348ab79a824ce9962c4e79c78b83c753ad3d7b08055b" exitCode=0
Oct 30 21:44:02.804819 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.804691    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"
Oct 30 21:44:02.804819 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.804723    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl" event={"ID":"2c9e599f-fc25-4057-b762-f2a2c53ee3fd","Type":"ContainerDied","Data":"f66ef876b50d6edc1ce2348ab79a824ce9962c4e79c78b83c753ad3d7b08055b"}
Oct 30 21:44:02.804933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.804821    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl" event={"ID":"2c9e599f-fc25-4057-b762-f2a2c53ee3fd","Type":"ContainerDied","Data":"21d52318550e4c129e727cc0e13e6da67fdbf4bc6d8e98d7b333986e69a58b1e"}
Oct 30 21:44:02.804933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.804859    4522 scope.go:122] "RemoveContainer" containerID="f66ef876b50d6edc1ce2348ab79a824ce9962c4e79c78b83c753ad3d7b08055b"
Oct 30 21:44:02.812417 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.812297    4522 generic.go:356] "Generic (PLEG): container finished" podID="76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" containerID="cdf77882b0291bdaeb297649d3a6e752df70ceb1c98d0f44d39b46a68e637c27" exitCode=0
Oct 30 21:44:02.812417 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.812350    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5" event={"ID":"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd","Type":"ContainerDied","Data":"cdf77882b0291bdaeb297649d3a6e752df70ceb1c98d0f44d39b46a68e637c27"}
Oct 30 21:44:02.812417 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.812378    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"
Oct 30 21:44:02.812417 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.812404    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5" event={"ID":"76e3b1d2-3569-45a7-a6f1-26bd831bc9cd","Type":"ContainerDied","Data":"9083b439980a2a16f6111fc0bb73e224976f8bcb26a39da9145d6b45a760e45e"}
Oct 30 21:44:02.817568 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.814013    4522 generic.go:356] "Generic (PLEG): container finished" podID="3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" containerID="d11a6680b1fe6310dd2fb3b26670bfcfe559876c543a9f465ff3f38f89811097" exitCode=0
Oct 30 21:44:02.817568 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.814100    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l" event={"ID":"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9","Type":"ContainerDied","Data":"d11a6680b1fe6310dd2fb3b26670bfcfe559876c543a9f465ff3f38f89811097"}
Oct 30 21:44:02.817568 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.814142    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l" event={"ID":"3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9","Type":"ContainerDied","Data":"479ec21993f0a28510963a3224487342a0be5fa069008dce380d0cca97d81a08"}
Oct 30 21:44:02.817568 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.814227    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"
Oct 30 21:44:02.825078 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.825058    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.825078 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.825079    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.825194 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.825090    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.825194 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.825099    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.825194 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.825107    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.825194 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.825115    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dws5\" (UniqueName: \"kubernetes.io/projected/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-kube-api-access-8dws5\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.825194 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.825124    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.825194 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.825132    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c9e599f-fc25-4057-b762-f2a2c53ee3fd-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:02.830500 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.830449    4522 scope.go:122] "RemoveContainer" containerID="f66ef876b50d6edc1ce2348ab79a824ce9962c4e79c78b83c753ad3d7b08055b"
Oct 30 21:44:02.832603 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:44:02.832575    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f66ef876b50d6edc1ce2348ab79a824ce9962c4e79c78b83c753ad3d7b08055b\": container with ID starting with f66ef876b50d6edc1ce2348ab79a824ce9962c4e79c78b83c753ad3d7b08055b not found: ID does not exist" containerID="f66ef876b50d6edc1ce2348ab79a824ce9962c4e79c78b83c753ad3d7b08055b"
Oct 30 21:44:02.832699 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.832605    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f66ef876b50d6edc1ce2348ab79a824ce9962c4e79c78b83c753ad3d7b08055b"} err="failed to get container status \"f66ef876b50d6edc1ce2348ab79a824ce9962c4e79c78b83c753ad3d7b08055b\": rpc error: code = NotFound desc = could not find container \"f66ef876b50d6edc1ce2348ab79a824ce9962c4e79c78b83c753ad3d7b08055b\": container with ID starting with f66ef876b50d6edc1ce2348ab79a824ce9962c4e79c78b83c753ad3d7b08055b not found: ID does not exist"
Oct 30 21:44:02.832699 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.832621    4522 scope.go:122] "RemoveContainer" containerID="cdf77882b0291bdaeb297649d3a6e752df70ceb1c98d0f44d39b46a68e637c27"
Oct 30 21:44:02.841577 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.841561    4522 scope.go:122] "RemoveContainer" containerID="cdf77882b0291bdaeb297649d3a6e752df70ceb1c98d0f44d39b46a68e637c27"
Oct 30 21:44:02.841800 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:44:02.841782    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdf77882b0291bdaeb297649d3a6e752df70ceb1c98d0f44d39b46a68e637c27\": container with ID starting with cdf77882b0291bdaeb297649d3a6e752df70ceb1c98d0f44d39b46a68e637c27 not found: ID does not exist" containerID="cdf77882b0291bdaeb297649d3a6e752df70ceb1c98d0f44d39b46a68e637c27"
Oct 30 21:44:02.841851 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.841806    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdf77882b0291bdaeb297649d3a6e752df70ceb1c98d0f44d39b46a68e637c27"} err="failed to get container status \"cdf77882b0291bdaeb297649d3a6e752df70ceb1c98d0f44d39b46a68e637c27\": rpc error: code = NotFound desc = could not find container \"cdf77882b0291bdaeb297649d3a6e752df70ceb1c98d0f44d39b46a68e637c27\": container with ID starting with cdf77882b0291bdaeb297649d3a6e752df70ceb1c98d0f44d39b46a68e637c27 not found: ID does not exist"
Oct 30 21:44:02.841851 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.841821    4522 scope.go:122] "RemoveContainer" containerID="d11a6680b1fe6310dd2fb3b26670bfcfe559876c543a9f465ff3f38f89811097"
Oct 30 21:44:02.849631 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.849614    4522 scope.go:122] "RemoveContainer" containerID="d11a6680b1fe6310dd2fb3b26670bfcfe559876c543a9f465ff3f38f89811097"
Oct 30 21:44:02.849880 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:44:02.849864    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d11a6680b1fe6310dd2fb3b26670bfcfe559876c543a9f465ff3f38f89811097\": container with ID starting with d11a6680b1fe6310dd2fb3b26670bfcfe559876c543a9f465ff3f38f89811097 not found: ID does not exist" containerID="d11a6680b1fe6310dd2fb3b26670bfcfe559876c543a9f465ff3f38f89811097"
Oct 30 21:44:02.849947 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:02.849882    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d11a6680b1fe6310dd2fb3b26670bfcfe559876c543a9f465ff3f38f89811097"} err="failed to get container status \"d11a6680b1fe6310dd2fb3b26670bfcfe559876c543a9f465ff3f38f89811097\": rpc error: code = NotFound desc = could not find container \"d11a6680b1fe6310dd2fb3b26670bfcfe559876c543a9f465ff3f38f89811097\": container with ID starting with d11a6680b1fe6310dd2fb3b26670bfcfe559876c543a9f465ff3f38f89811097 not found: ID does not exist"
Oct 30 21:44:03.029968 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:03.029937    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"]
Oct 30 21:44:03.037808 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:03.037781    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dfp4l"]
Oct 30 21:44:03.149468 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:03.149400    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"]
Oct 30 21:44:03.154215 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:03.154190    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-dtswl"]
Oct 30 21:44:03.191717 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:03.191692    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2c9e599f-fc25-4057-b762-f2a2c53ee3fd" path="/var/lib/kubelet/pods/2c9e599f-fc25-4057-b762-f2a2c53ee3fd/volumes"
Oct 30 21:44:03.192160 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:03.192147    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" path="/var/lib/kubelet/pods/3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9/volumes"
Oct 30 21:44:03.192554 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:03.192540    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15" path="/var/lib/kubelet/pods/5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15/volumes"
Oct 30 21:44:03.193229 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:03.193215    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d9eadf71-d6c7-400f-9c6f-bea93e8a3750" path="/var/lib/kubelet/pods/d9eadf71-d6c7-400f-9c6f-bea93e8a3750/volumes"
Oct 30 21:44:03.264386 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:03.263972    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"]
Oct 30 21:44:03.293786 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:03.293682    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-9ac5c5-openshift-default-5f9f955bc7-lv5w5"]
Oct 30 21:44:03.494408 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:03.492379    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:03.726951 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:03.726918    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:04.301482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:04.298279    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:04.561536 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:04.559774    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:05.192665 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:05.192625    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" path="/var/lib/kubelet/pods/76e3b1d2-3569-45a7-a6f1-26bd831bc9cd/volumes"
Oct 30 21:44:07.989267 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:44:07.989220    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:44:09.294835 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:09.289994    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:14.159126 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:14.159058    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:19.067668 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:19.067601    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:24.244235 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:24.244205    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:25.066740 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:25.066694    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:25.316790 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:25.316708    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:26.093663 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:26.093633    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:27.447584 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:27.447555    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:29.024096 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:29.024061    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:33.046058 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:33.046012    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:33.260609 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:33.260576    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:33.747705 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:33.747665    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:33.992371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:33.992336    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:34.262708 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:34.262670    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:36.775897 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:36.775866    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:36.976029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:36.976001    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:37.881366 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:37.881338    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"]
Oct 30 21:44:37.881839 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:37.881547    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j" podUID="59d1c023-02be-4bfa-b3ac-ca4ac231062d" containerName="maas-api" containerID="cri-o://4d1701a357eda3a04fa81c6e8713cf01b31cdca0ca52db35a2aa676fafae12ac" gracePeriod=30
Oct 30 21:44:37.991394 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:44:37.991357    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:44:38.078551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:38.078508    4522 generic.go:356] "Generic (PLEG): container finished" podID="59d1c023-02be-4bfa-b3ac-ca4ac231062d" containerID="4d1701a357eda3a04fa81c6e8713cf01b31cdca0ca52db35a2aa676fafae12ac" exitCode=0
Oct 30 21:44:38.078714 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:38.078590    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j" event={"ID":"59d1c023-02be-4bfa-b3ac-ca4ac231062d","Type":"ContainerDied","Data":"4d1701a357eda3a04fa81c6e8713cf01b31cdca0ca52db35a2aa676fafae12ac"}
Oct 30 21:44:38.168174 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:38.168141    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:38.197537 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:38.197512    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"
Oct 30 21:44:38.262254 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:38.262224    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/59d1c023-02be-4bfa-b3ac-ca4ac231062d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59d1c023-02be-4bfa-b3ac-ca4ac231062d-maas-api-tls\") pod \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\" (UID: \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\") "
Oct 30 21:44:38.262472 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:38.262442    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/59d1c023-02be-4bfa-b3ac-ca4ac231062d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/59d1c023-02be-4bfa-b3ac-ca4ac231062d-metrics-certs\") pod \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\" (UID: \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\") "
Oct 30 21:44:38.262552 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:38.262535    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/59d1c023-02be-4bfa-b3ac-ca4ac231062d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59d1c023-02be-4bfa-b3ac-ca4ac231062d-openshift-service-ca\") pod \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\" (UID: \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\") "
Oct 30 21:44:38.262614 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:38.262570    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59d1c023-02be-4bfa-b3ac-ca4ac231062d-kube-api-access-j4tmg\" (UniqueName: \"kubernetes.io/projected/59d1c023-02be-4bfa-b3ac-ca4ac231062d-kube-api-access-j4tmg\") pod \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\" (UID: \"59d1c023-02be-4bfa-b3ac-ca4ac231062d\") "
Oct 30 21:44:38.262959 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:38.262920    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59d1c023-02be-4bfa-b3ac-ca4ac231062d-openshift-service-ca" pod "59d1c023-02be-4bfa-b3ac-ca4ac231062d" (UID: "59d1c023-02be-4bfa-b3ac-ca4ac231062d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:38.263343 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:38.263320    4522 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59d1c023-02be-4bfa-b3ac-ca4ac231062d-openshift-service-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:38.264577 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:38.264554    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59d1c023-02be-4bfa-b3ac-ca4ac231062d-maas-api-tls" pod "59d1c023-02be-4bfa-b3ac-ca4ac231062d" (UID: "59d1c023-02be-4bfa-b3ac-ca4ac231062d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:38.264686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:38.264667    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59d1c023-02be-4bfa-b3ac-ca4ac231062d-metrics-certs" pod "59d1c023-02be-4bfa-b3ac-ca4ac231062d" (UID: "59d1c023-02be-4bfa-b3ac-ca4ac231062d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:38.265530 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:38.265499    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59d1c023-02be-4bfa-b3ac-ca4ac231062d-kube-api-access-j4tmg" pod "59d1c023-02be-4bfa-b3ac-ca4ac231062d" (UID: "59d1c023-02be-4bfa-b3ac-ca4ac231062d"). InnerVolumeSpecName "kube-api-access-j4tmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:38.372990 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:38.372881    4522 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59d1c023-02be-4bfa-b3ac-ca4ac231062d-metrics-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:38.373228 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:38.373208    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4tmg\" (UniqueName: \"kubernetes.io/projected/59d1c023-02be-4bfa-b3ac-ca4ac231062d-kube-api-access-j4tmg\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:38.373353 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:38.373341    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59d1c023-02be-4bfa-b3ac-ca4ac231062d-maas-api-tls\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:39.085144 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:39.085115    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"
Oct 30 21:44:39.085579 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:39.085116    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j" event={"ID":"59d1c023-02be-4bfa-b3ac-ca4ac231062d","Type":"ContainerDied","Data":"3760e7017af47471ca52db044bda78e97100cb9d192d9ea5e65ed653337d0578"}
Oct 30 21:44:39.085579 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:39.085334    4522 scope.go:122] "RemoveContainer" containerID="4d1701a357eda3a04fa81c6e8713cf01b31cdca0ca52db35a2aa676fafae12ac"
Oct 30 21:44:39.220641 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:39.220612    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:44:39.258867 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:39.258839    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"]
Oct 30 21:44:39.261064 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:39.261042    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-847c62-7499845f67-sg65j"]
Oct 30 21:44:39.587439 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:39.587400    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:39.800287 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:39.800235    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:40.057242 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:40.057172    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:40.513747 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:40.513719    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:41.192174 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:41.192144    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="59d1c023-02be-4bfa-b3ac-ca4ac231062d" path="/var/lib/kubelet/pods/59d1c023-02be-4bfa-b3ac-ca4ac231062d/volumes"
Oct 30 21:44:45.016843 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:45.016809    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:47.856713 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:47.856644    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:48.068695 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:48.068661    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:48.181390 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:48.181353    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"]
Oct 30 21:44:48.181636 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:48.181605    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf" podUID="d524ef3a-e3da-481e-842b-5c8980edb670" containerName="istio-proxy" containerID="cri-o://b840272e7fed5e8c4d336d5fc9714038d91a43f19c83f450a816db803571bbae" gracePeriod=30
Oct 30 21:44:48.295771 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:48.295699    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:50.288720 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:50.288686    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:53.451961 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.451899    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:44:53.571203 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.571167    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-credential-socket\") pod \"d524ef3a-e3da-481e-842b-5c8980edb670\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") "
Oct 30 21:44:53.571377 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.571256    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d524ef3a-e3da-481e-842b-5c8980edb670-kube-api-access-8m42n\" (UniqueName: \"kubernetes.io/projected/d524ef3a-e3da-481e-842b-5c8980edb670-kube-api-access-8m42n\") pod \"d524ef3a-e3da-481e-842b-5c8980edb670\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") "
Oct 30 21:44:53.571377 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.571275    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d524ef3a-e3da-481e-842b-5c8980edb670-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d524ef3a-e3da-481e-842b-5c8980edb670-istio-podinfo\") pod \"d524ef3a-e3da-481e-842b-5c8980edb670\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") "
Oct 30 21:44:53.571377 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.571330    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d524ef3a-e3da-481e-842b-5c8980edb670-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d524ef3a-e3da-481e-842b-5c8980edb670-istiod-ca-cert\") pod \"d524ef3a-e3da-481e-842b-5c8980edb670\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") "
Oct 30 21:44:53.571597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.571400    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-workload-certs\") pod \"d524ef3a-e3da-481e-842b-5c8980edb670\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") "
Oct 30 21:44:53.571597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.571503    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-credential-socket" pod "d524ef3a-e3da-481e-842b-5c8980edb670" (UID: "d524ef3a-e3da-481e-842b-5c8980edb670"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:53.571597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.571519    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-istio-data\") pod \"d524ef3a-e3da-481e-842b-5c8980edb670\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") "
Oct 30 21:44:53.571747 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.571639    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-workload-socket\") pod \"d524ef3a-e3da-481e-842b-5c8980edb670\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") "
Oct 30 21:44:53.571747 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.571667    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-istio-envoy\") pod \"d524ef3a-e3da-481e-842b-5c8980edb670\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") "
Oct 30 21:44:53.571747 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.571695    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d524ef3a-e3da-481e-842b-5c8980edb670-istio-token\" (UniqueName: \"kubernetes.io/projected/d524ef3a-e3da-481e-842b-5c8980edb670-istio-token\") pod \"d524ef3a-e3da-481e-842b-5c8980edb670\" (UID: \"d524ef3a-e3da-481e-842b-5c8980edb670\") "
Oct 30 21:44:53.571899 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.571832    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-workload-certs" pod "d524ef3a-e3da-481e-842b-5c8980edb670" (UID: "d524ef3a-e3da-481e-842b-5c8980edb670"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:53.571952 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.571909    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-istio-data" pod "d524ef3a-e3da-481e-842b-5c8980edb670" (UID: "d524ef3a-e3da-481e-842b-5c8980edb670"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:53.572003 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.571970    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-workload-socket" pod "d524ef3a-e3da-481e-842b-5c8980edb670" (UID: "d524ef3a-e3da-481e-842b-5c8980edb670"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:53.572309 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.572279    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:53.572424 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.572310    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:53.572424 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.572326    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:53.572424 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.572338    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:53.572616 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.572507    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d524ef3a-e3da-481e-842b-5c8980edb670-istiod-ca-cert" pod "d524ef3a-e3da-481e-842b-5c8980edb670" (UID: "d524ef3a-e3da-481e-842b-5c8980edb670"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:53.574211 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.574172    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d524ef3a-e3da-481e-842b-5c8980edb670-kube-api-access-8m42n" pod "d524ef3a-e3da-481e-842b-5c8980edb670" (UID: "d524ef3a-e3da-481e-842b-5c8980edb670"). InnerVolumeSpecName "kube-api-access-8m42n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:53.574333 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.574311    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d524ef3a-e3da-481e-842b-5c8980edb670-istio-token" pod "d524ef3a-e3da-481e-842b-5c8980edb670" (UID: "d524ef3a-e3da-481e-842b-5c8980edb670"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:53.574873 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.574842    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d524ef3a-e3da-481e-842b-5c8980edb670-istio-podinfo" pod "d524ef3a-e3da-481e-842b-5c8980edb670" (UID: "d524ef3a-e3da-481e-842b-5c8980edb670"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:44:53.574961 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.574866    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-istio-envoy" pod "d524ef3a-e3da-481e-842b-5c8980edb670" (UID: "d524ef3a-e3da-481e-842b-5c8980edb670"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:53.674008 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.673982    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d524ef3a-e3da-481e-842b-5c8980edb670-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:53.674008 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.674006    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d524ef3a-e3da-481e-842b-5c8980edb670-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:53.674197 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.674016    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8m42n\" (UniqueName: \"kubernetes.io/projected/d524ef3a-e3da-481e-842b-5c8980edb670-kube-api-access-8m42n\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:53.674197 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.674026    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d524ef3a-e3da-481e-842b-5c8980edb670-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:53.674197 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:53.674036    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d524ef3a-e3da-481e-842b-5c8980edb670-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:54.197960 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:54.197932    4522 generic.go:356] "Generic (PLEG): container finished" podID="d524ef3a-e3da-481e-842b-5c8980edb670" containerID="b840272e7fed5e8c4d336d5fc9714038d91a43f19c83f450a816db803571bbae" exitCode=0
Oct 30 21:44:54.198127 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:54.197968    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf" event={"ID":"d524ef3a-e3da-481e-842b-5c8980edb670","Type":"ContainerDied","Data":"b840272e7fed5e8c4d336d5fc9714038d91a43f19c83f450a816db803571bbae"}
Oct 30 21:44:54.198127 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:54.197974    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"
Oct 30 21:44:54.198127 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:54.198009    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf" event={"ID":"d524ef3a-e3da-481e-842b-5c8980edb670","Type":"ContainerDied","Data":"a96d0cf0d169824b9e71e4d91f463036027322aede3b4fb8038f1ea085bf189b"}
Oct 30 21:44:54.198127 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:54.198031    4522 scope.go:122] "RemoveContainer" containerID="b840272e7fed5e8c4d336d5fc9714038d91a43f19c83f450a816db803571bbae"
Oct 30 21:44:54.211468 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:54.211440    4522 scope.go:122] "RemoveContainer" containerID="b840272e7fed5e8c4d336d5fc9714038d91a43f19c83f450a816db803571bbae"
Oct 30 21:44:54.211728 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:44:54.211710    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b840272e7fed5e8c4d336d5fc9714038d91a43f19c83f450a816db803571bbae\": container with ID starting with b840272e7fed5e8c4d336d5fc9714038d91a43f19c83f450a816db803571bbae not found: ID does not exist" containerID="b840272e7fed5e8c4d336d5fc9714038d91a43f19c83f450a816db803571bbae"
Oct 30 21:44:54.211780 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:54.211737    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b840272e7fed5e8c4d336d5fc9714038d91a43f19c83f450a816db803571bbae"} err="failed to get container status \"b840272e7fed5e8c4d336d5fc9714038d91a43f19c83f450a816db803571bbae\": rpc error: code = NotFound desc = could not find container \"b840272e7fed5e8c4d336d5fc9714038d91a43f19c83f450a816db803571bbae\": container with ID starting with b840272e7fed5e8c4d336d5fc9714038d91a43f19c83f450a816db803571bbae not found: ID does not exist"
Oct 30 21:44:54.409587 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:54.409561    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"]
Oct 30 21:44:54.458760 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:54.458711    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-847c62-openshift-default-6bc5bf44df-78lnf"]
Oct 30 21:44:55.193184 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:55.193151    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d524ef3a-e3da-481e-842b-5c8980edb670" path="/var/lib/kubelet/pods/d524ef3a-e3da-481e-842b-5c8980edb670/volumes"
Oct 30 21:44:55.377476 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:44:55.377433    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:00.171983 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.171953    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6"]
Oct 30 21:45:00.173576 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.173549    4522 cpu_manager.go:414] "containerMap: removing container" podUID="504b9039-7a53-4f4d-bf60-20eceb9f6d3c" containerName="main"
Oct 30 21:45:00.173747 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.173731    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="504b9039-7a53-4f4d-bf60-20eceb9f6d3c" containerName="main"
Oct 30 21:45:00.173840 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.173830    4522 cpu_manager.go:414] "containerMap: removing container" podUID="3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" containerName="istio-proxy"
Oct 30 21:45:00.173916 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.173907    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" containerName="istio-proxy"
Oct 30 21:45:00.174002 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.173993    4522 cpu_manager.go:414] "containerMap: removing container" podUID="76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" containerName="istio-proxy"
Oct 30 21:45:00.174069 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174060    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" containerName="istio-proxy"
Oct 30 21:45:00.174180 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174159    4522 cpu_manager.go:414] "containerMap: removing container" podUID="336f0a2d-1023-411d-9ff4-33dad5c413d5" containerName="main"
Oct 30 21:45:00.174180 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174174    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="336f0a2d-1023-411d-9ff4-33dad5c413d5" containerName="main"
Oct 30 21:45:00.174336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174201    4522 cpu_manager.go:414] "containerMap: removing container" podUID="5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15" containerName="main"
Oct 30 21:45:00.174336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174208    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15" containerName="main"
Oct 30 21:45:00.174336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174219    4522 cpu_manager.go:414] "containerMap: removing container" podUID="8d537bd9-741d-448c-83ac-a0300dcc94a6" containerName="istio-proxy"
Oct 30 21:45:00.174336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174226    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8d537bd9-741d-448c-83ac-a0300dcc94a6" containerName="istio-proxy"
Oct 30 21:45:00.174336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174242    4522 cpu_manager.go:414] "containerMap: removing container" podUID="59d1c023-02be-4bfa-b3ac-ca4ac231062d" containerName="maas-api"
Oct 30 21:45:00.174336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174252    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59d1c023-02be-4bfa-b3ac-ca4ac231062d" containerName="maas-api"
Oct 30 21:45:00.174336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174264    4522 cpu_manager.go:414] "containerMap: removing container" podUID="d9eadf71-d6c7-400f-9c6f-bea93e8a3750" containerName="main"
Oct 30 21:45:00.174336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174272    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d9eadf71-d6c7-400f-9c6f-bea93e8a3750" containerName="main"
Oct 30 21:45:00.174336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174289    4522 cpu_manager.go:414] "containerMap: removing container" podUID="4f516f9b-32d2-4823-87f0-39d5967eee9c" containerName="istio-proxy"
Oct 30 21:45:00.174336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174296    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f516f9b-32d2-4823-87f0-39d5967eee9c" containerName="istio-proxy"
Oct 30 21:45:00.174336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174305    4522 cpu_manager.go:414] "containerMap: removing container" podUID="2c9e599f-fc25-4057-b762-f2a2c53ee3fd" containerName="istio-proxy"
Oct 30 21:45:00.174336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174312    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2c9e599f-fc25-4057-b762-f2a2c53ee3fd" containerName="istio-proxy"
Oct 30 21:45:00.174336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174322    4522 cpu_manager.go:414] "containerMap: removing container" podUID="c40713f3-8021-4fd7-a245-801cc687abf5" containerName="maas-api"
Oct 30 21:45:00.174336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174329    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c40713f3-8021-4fd7-a245-801cc687abf5" containerName="maas-api"
Oct 30 21:45:00.174336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174338    4522 cpu_manager.go:414] "containerMap: removing container" podUID="c40713f3-8021-4fd7-a245-801cc687abf5" containerName="maas-api"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174345    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c40713f3-8021-4fd7-a245-801cc687abf5" containerName="maas-api"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174358    4522 cpu_manager.go:414] "containerMap: removing container" podUID="0c90b3ce-f6a1-4ce6-a690-7831b4638d29" containerName="istio-proxy"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174364    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0c90b3ce-f6a1-4ce6-a690-7831b4638d29" containerName="istio-proxy"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174386    4522 cpu_manager.go:414] "containerMap: removing container" podUID="58f59123-9a14-4cd0-8c9e-17448eae2bca" containerName="main"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174392    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58f59123-9a14-4cd0-8c9e-17448eae2bca" containerName="main"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174406    4522 cpu_manager.go:414] "containerMap: removing container" podUID="d524ef3a-e3da-481e-842b-5c8980edb670" containerName="istio-proxy"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174412    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d524ef3a-e3da-481e-842b-5c8980edb670" containerName="istio-proxy"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174542    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="c40713f3-8021-4fd7-a245-801cc687abf5" containerName="maas-api"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174554    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="c40713f3-8021-4fd7-a245-801cc687abf5" containerName="maas-api"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174564    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="0c90b3ce-f6a1-4ce6-a690-7831b4638d29" containerName="istio-proxy"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174575    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="58f59123-9a14-4cd0-8c9e-17448eae2bca" containerName="main"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174585    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="d524ef3a-e3da-481e-842b-5c8980edb670" containerName="istio-proxy"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174594    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="3ffe736d-1fe7-4ad2-8ddc-6868f6531ba9" containerName="istio-proxy"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174602    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="504b9039-7a53-4f4d-bf60-20eceb9f6d3c" containerName="main"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174611    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="76e3b1d2-3569-45a7-a6f1-26bd831bc9cd" containerName="istio-proxy"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174621    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="336f0a2d-1023-411d-9ff4-33dad5c413d5" containerName="main"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174630    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="5782d3ab-29c5-44a1-abc5-c8f8dbc0ad15" containerName="main"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174637    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="8d537bd9-741d-448c-83ac-a0300dcc94a6" containerName="istio-proxy"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174645    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="59d1c023-02be-4bfa-b3ac-ca4ac231062d" containerName="maas-api"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174654    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="d9eadf71-d6c7-400f-9c6f-bea93e8a3750" containerName="main"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174661    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f516f9b-32d2-4823-87f0-39d5967eee9c" containerName="istio-proxy"
Oct 30 21:45:00.174876 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.174669    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="2c9e599f-fc25-4057-b762-f2a2c53ee3fd" containerName="istio-proxy"
Oct 30 21:45:00.178163 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.178138    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:00.178511 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.178496    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6"
Oct 30 21:45:00.182755 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.182728    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k"]
Oct 30 21:45:00.187702 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.187682    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k"
Oct 30 21:45:00.189472 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.189436    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z"]
Oct 30 21:45:00.197318 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.197262    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z"
Oct 30 21:45:00.217699 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.217677    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj"]
Oct 30 21:45:00.221161 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.221139    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj"
Oct 30 21:45:00.230153 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.230131    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vmmz2\""
Oct 30 21:45:00.272289 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.272257    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6"]
Oct 30 21:45:00.272441 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.272359    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f50a977-8e9c-4610-84be-789a2e4fdb03-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6\" (UID: \"1f50a977-8e9c-4610-84be-789a2e4fdb03\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6"
Oct 30 21:45:00.272441 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.272395    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgkk4\" (UniqueName: \"kubernetes.io/projected/1f50a977-8e9c-4610-84be-789a2e4fdb03-kube-api-access-dgkk4\") pod \"maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6\" (UID: \"1f50a977-8e9c-4610-84be-789a2e4fdb03\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6"
Oct 30 21:45:00.325241 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.322931    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z"]
Oct 30 21:45:00.327855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.327822    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k"]
Oct 30 21:45:00.373741 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.373700    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a48fde8b-4dfd-4158-aee9-261aa7c61eda-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z\" (UID: \"a48fde8b-4dfd-4158-aee9-261aa7c61eda\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z"
Oct 30 21:45:00.373928 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.373764    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11373bdd-90b7-49b0-8d30-fcd3aecc457d-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj\" (UID: \"11373bdd-90b7-49b0-8d30-fcd3aecc457d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj"
Oct 30 21:45:00.374004 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.373961    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5df6\" (UniqueName: \"kubernetes.io/projected/11373bdd-90b7-49b0-8d30-fcd3aecc457d-kube-api-access-p5df6\") pod \"maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj\" (UID: \"11373bdd-90b7-49b0-8d30-fcd3aecc457d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj"
Oct 30 21:45:00.374073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.374053    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f50a977-8e9c-4610-84be-789a2e4fdb03-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6\" (UID: \"1f50a977-8e9c-4610-84be-789a2e4fdb03\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6"
Oct 30 21:45:00.374130 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.374104    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgkk4\" (UniqueName: \"kubernetes.io/projected/1f50a977-8e9c-4610-84be-789a2e4fdb03-kube-api-access-dgkk4\") pod \"maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6\" (UID: \"1f50a977-8e9c-4610-84be-789a2e4fdb03\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6"
Oct 30 21:45:00.374195 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.374151    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2630c3d-f938-4b16-8d1e-ab7959a8243f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k\" (UID: \"b2630c3d-f938-4b16-8d1e-ab7959a8243f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k"
Oct 30 21:45:00.374250 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.374236    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcdfh\" (UniqueName: \"kubernetes.io/projected/b2630c3d-f938-4b16-8d1e-ab7959a8243f-kube-api-access-fcdfh\") pod \"maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k\" (UID: \"b2630c3d-f938-4b16-8d1e-ab7959a8243f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k"
Oct 30 21:45:00.374302 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.374268    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldbq5\" (UniqueName: \"kubernetes.io/projected/a48fde8b-4dfd-4158-aee9-261aa7c61eda-kube-api-access-ldbq5\") pod \"maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z\" (UID: \"a48fde8b-4dfd-4158-aee9-261aa7c61eda\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z"
Oct 30 21:45:00.374931 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.374910    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f50a977-8e9c-4610-84be-789a2e4fdb03-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6\" (UID: \"1f50a977-8e9c-4610-84be-789a2e4fdb03\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6"
Oct 30 21:45:00.390949 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.390921    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj"]
Oct 30 21:45:00.430660 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.430591    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgkk4\" (UniqueName: \"kubernetes.io/projected/1f50a977-8e9c-4610-84be-789a2e4fdb03-kube-api-access-dgkk4\") pod \"maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6\" (UID: \"1f50a977-8e9c-4610-84be-789a2e4fdb03\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6"
Oct 30 21:45:00.475371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.475331    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2630c3d-f938-4b16-8d1e-ab7959a8243f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k\" (UID: \"b2630c3d-f938-4b16-8d1e-ab7959a8243f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k"
Oct 30 21:45:00.475569 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.475398    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcdfh\" (UniqueName: \"kubernetes.io/projected/b2630c3d-f938-4b16-8d1e-ab7959a8243f-kube-api-access-fcdfh\") pod \"maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k\" (UID: \"b2630c3d-f938-4b16-8d1e-ab7959a8243f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k"
Oct 30 21:45:00.475569 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.475426    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldbq5\" (UniqueName: \"kubernetes.io/projected/a48fde8b-4dfd-4158-aee9-261aa7c61eda-kube-api-access-ldbq5\") pod \"maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z\" (UID: \"a48fde8b-4dfd-4158-aee9-261aa7c61eda\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z"
Oct 30 21:45:00.475569 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.475542    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a48fde8b-4dfd-4158-aee9-261aa7c61eda-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z\" (UID: \"a48fde8b-4dfd-4158-aee9-261aa7c61eda\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z"
Oct 30 21:45:00.475737 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.475596    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11373bdd-90b7-49b0-8d30-fcd3aecc457d-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj\" (UID: \"11373bdd-90b7-49b0-8d30-fcd3aecc457d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj"
Oct 30 21:45:00.475737 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.475693    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5df6\" (UniqueName: \"kubernetes.io/projected/11373bdd-90b7-49b0-8d30-fcd3aecc457d-kube-api-access-p5df6\") pod \"maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj\" (UID: \"11373bdd-90b7-49b0-8d30-fcd3aecc457d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj"
Oct 30 21:45:00.476121 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.476094    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2630c3d-f938-4b16-8d1e-ab7959a8243f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k\" (UID: \"b2630c3d-f938-4b16-8d1e-ab7959a8243f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k"
Oct 30 21:45:00.476227 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.476207    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a48fde8b-4dfd-4158-aee9-261aa7c61eda-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z\" (UID: \"a48fde8b-4dfd-4158-aee9-261aa7c61eda\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z"
Oct 30 21:45:00.476291 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.476275    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11373bdd-90b7-49b0-8d30-fcd3aecc457d-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj\" (UID: \"11373bdd-90b7-49b0-8d30-fcd3aecc457d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj"
Oct 30 21:45:00.499689 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.499667    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6"
Oct 30 21:45:00.531887 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.531855    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5df6\" (UniqueName: \"kubernetes.io/projected/11373bdd-90b7-49b0-8d30-fcd3aecc457d-kube-api-access-p5df6\") pod \"maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj\" (UID: \"11373bdd-90b7-49b0-8d30-fcd3aecc457d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj"
Oct 30 21:45:00.532483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.532421    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcdfh\" (UniqueName: \"kubernetes.io/projected/b2630c3d-f938-4b16-8d1e-ab7959a8243f-kube-api-access-fcdfh\") pod \"maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k\" (UID: \"b2630c3d-f938-4b16-8d1e-ab7959a8243f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k"
Oct 30 21:45:00.532640 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.532620    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldbq5\" (UniqueName: \"kubernetes.io/projected/a48fde8b-4dfd-4158-aee9-261aa7c61eda-kube-api-access-ldbq5\") pod \"maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z\" (UID: \"a48fde8b-4dfd-4158-aee9-261aa7c61eda\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z"
Oct 30 21:45:00.536401 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.536381    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj"
Oct 30 21:45:00.812087 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.812018    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k"
Oct 30 21:45:00.820127 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.820107    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z"
Oct 30 21:45:00.878922 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.878895    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6"]
Oct 30 21:45:00.894552 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.893541    4522 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:45:00.934039 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:00.934012    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj"]
Oct 30 21:45:00.936835 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:45:00.936811    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11373bdd_90b7_49b0_8d30_fcd3aecc457d.slice/crio-cf669e7664ffe85713c53484a5af82e96b6bb23712e0f8fb737256d5e732ce31 WatchSource:0}: Error finding container cf669e7664ffe85713c53484a5af82e96b6bb23712e0f8fb737256d5e732ce31: Status 404 returned error can't find the container with id cf669e7664ffe85713c53484a5af82e96b6bb23712e0f8fb737256d5e732ce31
Oct 30 21:45:01.188953 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:45:01.188918    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2630c3d_f938_4b16_8d1e_ab7959a8243f.slice/crio-9e16667d6706693e6e38baa05efa548989e944cdadb9b2d70d89c2a47692d976 WatchSource:0}: Error finding container 9e16667d6706693e6e38baa05efa548989e944cdadb9b2d70d89c2a47692d976: Status 404 returned error can't find the container with id 9e16667d6706693e6e38baa05efa548989e944cdadb9b2d70d89c2a47692d976
Oct 30 21:45:01.193045 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:01.193020    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k"]
Oct 30 21:45:01.197835 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:01.197817    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z"]
Oct 30 21:45:01.198853 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:45:01.198832    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda48fde8b_4dfd_4158_aee9_261aa7c61eda.slice/crio-7791137c4907146e2e165a39712e8895b8a177da7cd991c75ba4c5378071d817 WatchSource:0}: Error finding container 7791137c4907146e2e165a39712e8895b8a177da7cd991c75ba4c5378071d817: Status 404 returned error can't find the container with id 7791137c4907146e2e165a39712e8895b8a177da7cd991c75ba4c5378071d817
Oct 30 21:45:01.245155 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:01.245128    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z" event={"ID":"a48fde8b-4dfd-4158-aee9-261aa7c61eda","Type":"ContainerStarted","Data":"7791137c4907146e2e165a39712e8895b8a177da7cd991c75ba4c5378071d817"}
Oct 30 21:45:01.246414 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:01.246383    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6" event={"ID":"1f50a977-8e9c-4610-84be-789a2e4fdb03","Type":"ContainerStarted","Data":"dc1b4cca7cdc1f3633c30b85ef0b57c753a67cc9584d6cd88f631c3a57efe419"}
Oct 30 21:45:01.247673 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:01.247650    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k" event={"ID":"b2630c3d-f938-4b16-8d1e-ab7959a8243f","Type":"ContainerStarted","Data":"9e16667d6706693e6e38baa05efa548989e944cdadb9b2d70d89c2a47692d976"}
Oct 30 21:45:01.248813 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:01.248787    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj" event={"ID":"11373bdd-90b7-49b0-8d30-fcd3aecc457d","Type":"ContainerStarted","Data":"cf669e7664ffe85713c53484a5af82e96b6bb23712e0f8fb737256d5e732ce31"}
Oct 30 21:45:03.704382 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:03.704330    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:04.995970 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:04.995935    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:05.507472 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:05.507398    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:05.919975 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:05.919935    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b"]
Oct 30 21:45:05.925336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:05.925311    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b"
Oct 30 21:45:05.983517 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:05.983425    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b"]
Oct 30 21:45:05.995199 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:05.994730    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d5901957-464a-4ded-8a1c-529f2fbc5913-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b\" (UID: \"d5901957-464a-4ded-8a1c-529f2fbc5913\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b"
Oct 30 21:45:05.995199 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:05.994796    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d5901957-464a-4ded-8a1c-529f2fbc5913-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b\" (UID: \"d5901957-464a-4ded-8a1c-529f2fbc5913\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b"
Oct 30 21:45:05.995199 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:05.994840    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbbdw\" (UniqueName: \"kubernetes.io/projected/d5901957-464a-4ded-8a1c-529f2fbc5913-kube-api-access-mbbdw\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b\" (UID: \"d5901957-464a-4ded-8a1c-529f2fbc5913\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b"
Oct 30 21:45:06.051529 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:06.051490    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:45:06.096300 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:06.096271    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d5901957-464a-4ded-8a1c-529f2fbc5913-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b\" (UID: \"d5901957-464a-4ded-8a1c-529f2fbc5913\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b"
Oct 30 21:45:06.096485 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:06.096330    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d5901957-464a-4ded-8a1c-529f2fbc5913-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b\" (UID: \"d5901957-464a-4ded-8a1c-529f2fbc5913\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b"
Oct 30 21:45:06.096485 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:06.096369    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbbdw\" (UniqueName: \"kubernetes.io/projected/d5901957-464a-4ded-8a1c-529f2fbc5913-kube-api-access-mbbdw\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b\" (UID: \"d5901957-464a-4ded-8a1c-529f2fbc5913\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b"
Oct 30 21:45:06.096961 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:06.096934    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d5901957-464a-4ded-8a1c-529f2fbc5913-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b\" (UID: \"d5901957-464a-4ded-8a1c-529f2fbc5913\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b"
Oct 30 21:45:06.186539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:06.186500    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d5901957-464a-4ded-8a1c-529f2fbc5913-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b\" (UID: \"d5901957-464a-4ded-8a1c-529f2fbc5913\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b"
Oct 30 21:45:06.187177 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:06.187139    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbbdw\" (UniqueName: \"kubernetes.io/projected/d5901957-464a-4ded-8a1c-529f2fbc5913-kube-api-access-mbbdw\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b\" (UID: \"d5901957-464a-4ded-8a1c-529f2fbc5913\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b"
Oct 30 21:45:06.241633 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:06.241608    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b"
Oct 30 21:45:06.280569 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:06.280531    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k" event={"ID":"b2630c3d-f938-4b16-8d1e-ab7959a8243f","Type":"ContainerStarted","Data":"088891fafa4ee7bcab99edbe87ea1211baf8d3f7803fd5ab84452bf50f8e39b3"}
Oct 30 21:45:06.394550 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:06.394506    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k" podStartSLOduration=1.7631217970000002 podStartE2EDuration="6.39449308s" totalImagesPullingTime="4.631371283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:06.39214454 +0000 UTC m=+2015.337089901" watchObservedRunningTime="2026-10-30 21:45:06.39449308 +0000 UTC m=+2015.339438436"
Oct 30 21:45:06.622904 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:06.622878    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b"]
Oct 30 21:45:06.624781 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:45:06.624756    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5901957_464a_4ded_8a1c_529f2fbc5913.slice/crio-e5c1c079cf14ea863193237edf9f400360751e205bdb766f233257b45a054d49 WatchSource:0}: Error finding container e5c1c079cf14ea863193237edf9f400360751e205bdb766f233257b45a054d49: Status 404 returned error can't find the container with id e5c1c079cf14ea863193237edf9f400360751e205bdb766f233257b45a054d49
Oct 30 21:45:07.288249 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:07.288220    4522 generic.go:356] "Generic (PLEG): container finished" podID="a48fde8b-4dfd-4158-aee9-261aa7c61eda" containerID="d897823809f7639483874509a59dda8eba431d1694fd1222645216815adc22dc" exitCode=60
Oct 30 21:45:07.288664 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:07.288284    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z" event={"ID":"a48fde8b-4dfd-4158-aee9-261aa7c61eda","Type":"ContainerDied","Data":"d897823809f7639483874509a59dda8eba431d1694fd1222645216815adc22dc"}
Oct 30 21:45:07.288664 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:07.288570    4522 scope.go:122] "RemoveContainer" containerID="d897823809f7639483874509a59dda8eba431d1694fd1222645216815adc22dc"
Oct 30 21:45:07.289988 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:07.289964    4522 generic.go:356] "Generic (PLEG): container finished" podID="1f50a977-8e9c-4610-84be-789a2e4fdb03" containerID="3ea525f06425e4527551a7069d6c8776ba5f5eeb3a2c71e74d1981aed8ccb302" exitCode=60
Oct 30 21:45:07.290076 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:07.290065    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6" event={"ID":"1f50a977-8e9c-4610-84be-789a2e4fdb03","Type":"ContainerDied","Data":"3ea525f06425e4527551a7069d6c8776ba5f5eeb3a2c71e74d1981aed8ccb302"}
Oct 30 21:45:07.290289 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:07.290267    4522 scope.go:122] "RemoveContainer" containerID="3ea525f06425e4527551a7069d6c8776ba5f5eeb3a2c71e74d1981aed8ccb302"
Oct 30 21:45:07.292044 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:07.292024    4522 generic.go:356] "Generic (PLEG): container finished" podID="b2630c3d-f938-4b16-8d1e-ab7959a8243f" containerID="088891fafa4ee7bcab99edbe87ea1211baf8d3f7803fd5ab84452bf50f8e39b3" exitCode=60
Oct 30 21:45:07.292156 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:07.292105    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k" event={"ID":"b2630c3d-f938-4b16-8d1e-ab7959a8243f","Type":"ContainerDied","Data":"088891fafa4ee7bcab99edbe87ea1211baf8d3f7803fd5ab84452bf50f8e39b3"}
Oct 30 21:45:07.292397 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:07.292379    4522 scope.go:122] "RemoveContainer" containerID="088891fafa4ee7bcab99edbe87ea1211baf8d3f7803fd5ab84452bf50f8e39b3"
Oct 30 21:45:07.293927 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:07.293903    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b" event={"ID":"d5901957-464a-4ded-8a1c-529f2fbc5913","Type":"ContainerStarted","Data":"b9dff4d51714cda183f087ddc8ab5b099e71a7cf725f68ddaee1f6b2bd0d9c60"}
Oct 30 21:45:07.294064 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:07.294041    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b" event={"ID":"d5901957-464a-4ded-8a1c-529f2fbc5913","Type":"ContainerStarted","Data":"e5c1c079cf14ea863193237edf9f400360751e205bdb766f233257b45a054d49"}
Oct 30 21:45:07.295868 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:07.295846    4522 generic.go:356] "Generic (PLEG): container finished" podID="11373bdd-90b7-49b0-8d30-fcd3aecc457d" containerID="2eb609c82b46af44f6e2c737f5c6cb06736c9986efbc819496f43ba2e9583db3" exitCode=60
Oct 30 21:45:07.295951 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:07.295896    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj" event={"ID":"11373bdd-90b7-49b0-8d30-fcd3aecc457d","Type":"ContainerDied","Data":"2eb609c82b46af44f6e2c737f5c6cb06736c9986efbc819496f43ba2e9583db3"}
Oct 30 21:45:07.296051 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:07.296035    4522 scope.go:122] "RemoveContainer" containerID="2eb609c82b46af44f6e2c737f5c6cb06736c9986efbc819496f43ba2e9583db3"
Oct 30 21:45:07.871586 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:07.871486    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b" podStartSLOduration=2.871468482 podStartE2EDuration="2.871468482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:07.869132819 +0000 UTC m=+2016.814078178" watchObservedRunningTime="2026-10-30 21:45:07.871468482 +0000 UTC m=+2016.816413836"
Oct 30 21:45:07.989015 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:45:07.988973    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:45:08.304683 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:08.304654    4522 generic.go:356] "Generic (PLEG): container finished" podID="b2630c3d-f938-4b16-8d1e-ab7959a8243f" containerID="374cd49ef40e091da1cff827bd64ac2fd10312aefd7a17c021999c8475874150" exitCode=60
Oct 30 21:45:08.305103 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:08.304736    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k" event={"ID":"b2630c3d-f938-4b16-8d1e-ab7959a8243f","Type":"ContainerDied","Data":"374cd49ef40e091da1cff827bd64ac2fd10312aefd7a17c021999c8475874150"}
Oct 30 21:45:08.305103 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:08.304809    4522 scope.go:122] "RemoveContainer" containerID="088891fafa4ee7bcab99edbe87ea1211baf8d3f7803fd5ab84452bf50f8e39b3"
Oct 30 21:45:08.305201 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:08.305102    4522 scope.go:122] "RemoveContainer" containerID="374cd49ef40e091da1cff827bd64ac2fd10312aefd7a17c021999c8475874150"
Oct 30 21:45:08.305584 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:45:08.305557    4522 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k_odh-ai-gateway-infra(b2630c3d-f938-4b16-8d1e-ab7959a8243f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k" podUID="b2630c3d-f938-4b16-8d1e-ab7959a8243f"
Oct 30 21:45:08.306316 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:08.306293    4522 generic.go:356] "Generic (PLEG): container finished" podID="d5901957-464a-4ded-8a1c-529f2fbc5913" containerID="b9dff4d51714cda183f087ddc8ab5b099e71a7cf725f68ddaee1f6b2bd0d9c60" exitCode=0
Oct 30 21:45:08.306405 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:08.306339    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b" event={"ID":"d5901957-464a-4ded-8a1c-529f2fbc5913","Type":"ContainerDied","Data":"b9dff4d51714cda183f087ddc8ab5b099e71a7cf725f68ddaee1f6b2bd0d9c60"}
Oct 30 21:45:08.308245 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:08.308223    4522 generic.go:356] "Generic (PLEG): container finished" podID="11373bdd-90b7-49b0-8d30-fcd3aecc457d" containerID="54e229371f7b9fbd4cb8fee26aa3bc9a6324052b22f329464945172c1ff5a96d" exitCode=60
Oct 30 21:45:08.308325 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:08.308296    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj" event={"ID":"11373bdd-90b7-49b0-8d30-fcd3aecc457d","Type":"ContainerDied","Data":"54e229371f7b9fbd4cb8fee26aa3bc9a6324052b22f329464945172c1ff5a96d"}
Oct 30 21:45:08.308575 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:08.308556    4522 scope.go:122] "RemoveContainer" containerID="54e229371f7b9fbd4cb8fee26aa3bc9a6324052b22f329464945172c1ff5a96d"
Oct 30 21:45:08.308866 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:45:08.308840    4522 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj_odh-ai-gateway-infra(11373bdd-90b7-49b0-8d30-fcd3aecc457d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj" podUID="11373bdd-90b7-49b0-8d30-fcd3aecc457d"
Oct 30 21:45:08.310373 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:08.310350    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z" event={"ID":"a48fde8b-4dfd-4158-aee9-261aa7c61eda","Type":"ContainerStarted","Data":"c623ee45391b250d96a3ce77452f138120a2e4bac448f1253065d042db3473e5"}
Oct 30 21:45:08.310670 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:08.310653    4522 scope.go:122] "RemoveContainer" containerID="c623ee45391b250d96a3ce77452f138120a2e4bac448f1253065d042db3473e5"
Oct 30 21:45:08.310945 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:45:08.310918    4522 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z_odh-ai-gateway-infra(a48fde8b-4dfd-4158-aee9-261aa7c61eda)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z" podUID="a48fde8b-4dfd-4158-aee9-261aa7c61eda"
Oct 30 21:45:08.312234 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:08.312214    4522 generic.go:356] "Generic (PLEG): container finished" podID="1f50a977-8e9c-4610-84be-789a2e4fdb03" containerID="e35c9e81efdd28eccfadc80e086941aac5409961317985b7ea8e6a177e295259" exitCode=60
Oct 30 21:45:08.312302 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:08.312259    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6" event={"ID":"1f50a977-8e9c-4610-84be-789a2e4fdb03","Type":"ContainerDied","Data":"e35c9e81efdd28eccfadc80e086941aac5409961317985b7ea8e6a177e295259"}
Oct 30 21:45:08.312507 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:08.312490    4522 scope.go:122] "RemoveContainer" containerID="e35c9e81efdd28eccfadc80e086941aac5409961317985b7ea8e6a177e295259"
Oct 30 21:45:08.312719 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:45:08.312704    4522 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6_odh-ai-gateway-infra(1f50a977-8e9c-4610-84be-789a2e4fdb03)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6" podUID="1f50a977-8e9c-4610-84be-789a2e4fdb03"
Oct 30 21:45:08.411511 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:08.411489    4522 scope.go:122] "RemoveContainer" containerID="2eb609c82b46af44f6e2c737f5c6cb06736c9986efbc819496f43ba2e9583db3"
Oct 30 21:45:08.423841 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:08.423820    4522 scope.go:122] "RemoveContainer" containerID="3ea525f06425e4527551a7069d6c8776ba5f5eeb3a2c71e74d1981aed8ccb302"
Oct 30 21:45:09.319559 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:09.319529    4522 scope.go:122] "RemoveContainer" containerID="54e229371f7b9fbd4cb8fee26aa3bc9a6324052b22f329464945172c1ff5a96d"
Oct 30 21:45:09.320037 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:45:09.319818    4522 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj_odh-ai-gateway-infra(11373bdd-90b7-49b0-8d30-fcd3aecc457d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj" podUID="11373bdd-90b7-49b0-8d30-fcd3aecc457d"
Oct 30 21:45:09.321099 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:09.321072    4522 generic.go:356] "Generic (PLEG): container finished" podID="a48fde8b-4dfd-4158-aee9-261aa7c61eda" containerID="c623ee45391b250d96a3ce77452f138120a2e4bac448f1253065d042db3473e5" exitCode=60
Oct 30 21:45:09.321227 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:09.321149    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z" event={"ID":"a48fde8b-4dfd-4158-aee9-261aa7c61eda","Type":"ContainerDied","Data":"c623ee45391b250d96a3ce77452f138120a2e4bac448f1253065d042db3473e5"}
Oct 30 21:45:09.321227 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:09.321194    4522 scope.go:122] "RemoveContainer" containerID="d897823809f7639483874509a59dda8eba431d1694fd1222645216815adc22dc"
Oct 30 21:45:09.321382 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:09.321360    4522 scope.go:122] "RemoveContainer" containerID="c623ee45391b250d96a3ce77452f138120a2e4bac448f1253065d042db3473e5"
Oct 30 21:45:09.321667 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:45:09.321643    4522 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z_odh-ai-gateway-infra(a48fde8b-4dfd-4158-aee9-261aa7c61eda)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z" podUID="a48fde8b-4dfd-4158-aee9-261aa7c61eda"
Oct 30 21:45:09.323043 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:09.323025    4522 scope.go:122] "RemoveContainer" containerID="e35c9e81efdd28eccfadc80e086941aac5409961317985b7ea8e6a177e295259"
Oct 30 21:45:09.323298 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:45:09.323272    4522 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6_odh-ai-gateway-infra(1f50a977-8e9c-4610-84be-789a2e4fdb03)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6" podUID="1f50a977-8e9c-4610-84be-789a2e4fdb03"
Oct 30 21:45:09.324500 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:09.324485    4522 scope.go:122] "RemoveContainer" containerID="374cd49ef40e091da1cff827bd64ac2fd10312aefd7a17c021999c8475874150"
Oct 30 21:45:09.324712 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:45:09.324692    4522 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k_odh-ai-gateway-infra(b2630c3d-f938-4b16-8d1e-ab7959a8243f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k" podUID="b2630c3d-f938-4b16-8d1e-ab7959a8243f"
Oct 30 21:45:09.481722 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:09.481696    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b"
Oct 30 21:45:09.546057 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:09.546019    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d5901957-464a-4ded-8a1c-529f2fbc5913-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d5901957-464a-4ded-8a1c-529f2fbc5913-maas-api-openshift-ca\") pod \"d5901957-464a-4ded-8a1c-529f2fbc5913\" (UID: \"d5901957-464a-4ded-8a1c-529f2fbc5913\") "
Oct 30 21:45:09.546217 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:09.546195    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d5901957-464a-4ded-8a1c-529f2fbc5913-kube-api-access-mbbdw\" (UniqueName: \"kubernetes.io/projected/d5901957-464a-4ded-8a1c-529f2fbc5913-kube-api-access-mbbdw\") pod \"d5901957-464a-4ded-8a1c-529f2fbc5913\" (UID: \"d5901957-464a-4ded-8a1c-529f2fbc5913\") "
Oct 30 21:45:09.546288 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:09.546267    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d5901957-464a-4ded-8a1c-529f2fbc5913-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d5901957-464a-4ded-8a1c-529f2fbc5913-maas-api-xks-ca\") pod \"d5901957-464a-4ded-8a1c-529f2fbc5913\" (UID: \"d5901957-464a-4ded-8a1c-529f2fbc5913\") "
Oct 30 21:45:09.546356 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:09.546305    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5901957-464a-4ded-8a1c-529f2fbc5913-maas-api-openshift-ca" pod "d5901957-464a-4ded-8a1c-529f2fbc5913" (UID: "d5901957-464a-4ded-8a1c-529f2fbc5913"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:09.546828 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:09.546805    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d5901957-464a-4ded-8a1c-529f2fbc5913-maas-api-openshift-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:09.548898 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:09.548871    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5901957-464a-4ded-8a1c-529f2fbc5913-maas-api-xks-ca" pod "d5901957-464a-4ded-8a1c-529f2fbc5913" (UID: "d5901957-464a-4ded-8a1c-529f2fbc5913"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:09.549029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:09.548902    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5901957-464a-4ded-8a1c-529f2fbc5913-kube-api-access-mbbdw" pod "d5901957-464a-4ded-8a1c-529f2fbc5913" (UID: "d5901957-464a-4ded-8a1c-529f2fbc5913"). InnerVolumeSpecName "kube-api-access-mbbdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:09.648553 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:09.648490    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbbdw\" (UniqueName: \"kubernetes.io/projected/d5901957-464a-4ded-8a1c-529f2fbc5913-kube-api-access-mbbdw\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:09.648553 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:09.648512    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d5901957-464a-4ded-8a1c-529f2fbc5913-maas-api-xks-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:10.331490 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:10.331448    4522 scope.go:122] "RemoveContainer" containerID="c623ee45391b250d96a3ce77452f138120a2e4bac448f1253065d042db3473e5"
Oct 30 21:45:10.331928 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:45:10.331803    4522 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z_odh-ai-gateway-infra(a48fde8b-4dfd-4158-aee9-261aa7c61eda)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z" podUID="a48fde8b-4dfd-4158-aee9-261aa7c61eda"
Oct 30 21:45:10.332508 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:10.332489    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b"
Oct 30 21:45:10.332508 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:10.332489    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b" event={"ID":"d5901957-464a-4ded-8a1c-529f2fbc5913","Type":"ContainerDied","Data":"e5c1c079cf14ea863193237edf9f400360751e205bdb766f233257b45a054d49"}
Oct 30 21:45:10.332647 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:10.332535    4522 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5c1c079cf14ea863193237edf9f400360751e205bdb766f233257b45a054d49"
Oct 30 21:45:10.805783 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:10.804721    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:15.801029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:15.800943    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:16.634804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:16.634760    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:17.259488 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:17.259004    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:17.767694 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:17.767666    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:18.008568 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:18.008224    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:18.409274 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:18.409229    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:19.975261 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:19.975219    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:20.185971 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:20.185946    4522 scope.go:122] "RemoveContainer" containerID="54e229371f7b9fbd4cb8fee26aa3bc9a6324052b22f329464945172c1ff5a96d"
Oct 30 21:45:20.186132 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:20.186081    4522 scope.go:122] "RemoveContainer" containerID="c623ee45391b250d96a3ce77452f138120a2e4bac448f1253065d042db3473e5"
Oct 30 21:45:20.742645 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:20.742610    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:21.188601 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:21.188573    4522 scope.go:122] "RemoveContainer" containerID="374cd49ef40e091da1cff827bd64ac2fd10312aefd7a17c021999c8475874150"
Oct 30 21:45:21.399342 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:21.399316    4522 generic.go:356] "Generic (PLEG): container finished" podID="11373bdd-90b7-49b0-8d30-fcd3aecc457d" containerID="c852c1c6b0a4dccf287c6d5e7233d197eb8cd2b68f7ef18b34088694bf369c88" exitCode=60
Oct 30 21:45:21.399475 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:21.399391    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj" event={"ID":"11373bdd-90b7-49b0-8d30-fcd3aecc457d","Type":"ContainerDied","Data":"c852c1c6b0a4dccf287c6d5e7233d197eb8cd2b68f7ef18b34088694bf369c88"}
Oct 30 21:45:21.399475 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:21.399448    4522 scope.go:122] "RemoveContainer" containerID="54e229371f7b9fbd4cb8fee26aa3bc9a6324052b22f329464945172c1ff5a96d"
Oct 30 21:45:21.399878 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:21.399857    4522 scope.go:122] "RemoveContainer" containerID="c852c1c6b0a4dccf287c6d5e7233d197eb8cd2b68f7ef18b34088694bf369c88"
Oct 30 21:45:21.400153 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:45:21.400130    4522 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj_odh-ai-gateway-infra(11373bdd-90b7-49b0-8d30-fcd3aecc457d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj" podUID="11373bdd-90b7-49b0-8d30-fcd3aecc457d"
Oct 30 21:45:21.401442 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:21.401422    4522 generic.go:356] "Generic (PLEG): container finished" podID="a48fde8b-4dfd-4158-aee9-261aa7c61eda" containerID="3a4244fdfd6b9ecf788b6b3231160cb643358b338d9a784f6a60ec379802077c" exitCode=60
Oct 30 21:45:21.401533 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:21.401483    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z" event={"ID":"a48fde8b-4dfd-4158-aee9-261aa7c61eda","Type":"ContainerDied","Data":"3a4244fdfd6b9ecf788b6b3231160cb643358b338d9a784f6a60ec379802077c"}
Oct 30 21:45:21.401804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:21.401789    4522 scope.go:122] "RemoveContainer" containerID="3a4244fdfd6b9ecf788b6b3231160cb643358b338d9a784f6a60ec379802077c"
Oct 30 21:45:21.402087 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:45:21.402062    4522 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z_odh-ai-gateway-infra(a48fde8b-4dfd-4158-aee9-261aa7c61eda)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z" podUID="a48fde8b-4dfd-4158-aee9-261aa7c61eda"
Oct 30 21:45:21.410853 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:21.410836    4522 scope.go:122] "RemoveContainer" containerID="c623ee45391b250d96a3ce77452f138120a2e4bac448f1253065d042db3473e5"
Oct 30 21:45:21.415888 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:21.415862    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:45:22.185934 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.185899    4522 scope.go:122] "RemoveContainer" containerID="e35c9e81efdd28eccfadc80e086941aac5409961317985b7ea8e6a177e295259"
Oct 30 21:45:22.326337 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.326257    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:22.416431 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.416404    4522 generic.go:356] "Generic (PLEG): container finished" podID="b2630c3d-f938-4b16-8d1e-ab7959a8243f" containerID="bee679017e79e7fd01c02ceb4b97f6053494544bfbc74696fb1aa214ba6ab21c" exitCode=60
Oct 30 21:45:22.416554 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.416435    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k" event={"ID":"b2630c3d-f938-4b16-8d1e-ab7959a8243f","Type":"ContainerDied","Data":"bee679017e79e7fd01c02ceb4b97f6053494544bfbc74696fb1aa214ba6ab21c"}
Oct 30 21:45:22.416554 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.416516    4522 scope.go:122] "RemoveContainer" containerID="374cd49ef40e091da1cff827bd64ac2fd10312aefd7a17c021999c8475874150"
Oct 30 21:45:22.416934 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.416916    4522 scope.go:122] "RemoveContainer" containerID="bee679017e79e7fd01c02ceb4b97f6053494544bfbc74696fb1aa214ba6ab21c"
Oct 30 21:45:22.417254 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:45:22.417225    4522 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k_odh-ai-gateway-infra(b2630c3d-f938-4b16-8d1e-ab7959a8243f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k" podUID="b2630c3d-f938-4b16-8d1e-ab7959a8243f"
Oct 30 21:45:22.577215 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.577156    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj"]
Oct 30 21:45:22.587978 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.587953    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:22.691612 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.691584    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z"]
Oct 30 21:45:22.730272 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.730246    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj"
Oct 30 21:45:22.770839 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.770809    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/11373bdd-90b7-49b0-8d30-fcd3aecc457d-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11373bdd-90b7-49b0-8d30-fcd3aecc457d-maas-api-service-ca\") pod \"11373bdd-90b7-49b0-8d30-fcd3aecc457d\" (UID: \"11373bdd-90b7-49b0-8d30-fcd3aecc457d\") "
Oct 30 21:45:22.771002 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.770985    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11373bdd-90b7-49b0-8d30-fcd3aecc457d-kube-api-access-p5df6\" (UniqueName: \"kubernetes.io/projected/11373bdd-90b7-49b0-8d30-fcd3aecc457d-kube-api-access-p5df6\") pod \"11373bdd-90b7-49b0-8d30-fcd3aecc457d\" (UID: \"11373bdd-90b7-49b0-8d30-fcd3aecc457d\") "
Oct 30 21:45:22.771880 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.771858    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11373bdd-90b7-49b0-8d30-fcd3aecc457d-maas-api-service-ca" pod "11373bdd-90b7-49b0-8d30-fcd3aecc457d" (UID: "11373bdd-90b7-49b0-8d30-fcd3aecc457d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:22.778438 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.778409    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11373bdd-90b7-49b0-8d30-fcd3aecc457d-kube-api-access-p5df6" pod "11373bdd-90b7-49b0-8d30-fcd3aecc457d" (UID: "11373bdd-90b7-49b0-8d30-fcd3aecc457d"). InnerVolumeSpecName "kube-api-access-p5df6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:22.861908 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.861883    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z"
Oct 30 21:45:22.873201 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.873176    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11373bdd-90b7-49b0-8d30-fcd3aecc457d-maas-api-service-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:22.873201 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.873201    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5df6\" (UniqueName: \"kubernetes.io/projected/11373bdd-90b7-49b0-8d30-fcd3aecc457d-kube-api-access-p5df6\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:22.973984 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.973952    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a48fde8b-4dfd-4158-aee9-261aa7c61eda-kube-api-access-ldbq5\" (UniqueName: \"kubernetes.io/projected/a48fde8b-4dfd-4158-aee9-261aa7c61eda-kube-api-access-ldbq5\") pod \"a48fde8b-4dfd-4158-aee9-261aa7c61eda\" (UID: \"a48fde8b-4dfd-4158-aee9-261aa7c61eda\") "
Oct 30 21:45:22.974127 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.974028    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a48fde8b-4dfd-4158-aee9-261aa7c61eda-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a48fde8b-4dfd-4158-aee9-261aa7c61eda-maas-api-service-ca\") pod \"a48fde8b-4dfd-4158-aee9-261aa7c61eda\" (UID: \"a48fde8b-4dfd-4158-aee9-261aa7c61eda\") "
Oct 30 21:45:22.974468 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.974431    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a48fde8b-4dfd-4158-aee9-261aa7c61eda-maas-api-service-ca" pod "a48fde8b-4dfd-4158-aee9-261aa7c61eda" (UID: "a48fde8b-4dfd-4158-aee9-261aa7c61eda"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:22.976103 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:22.976073    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a48fde8b-4dfd-4158-aee9-261aa7c61eda-kube-api-access-ldbq5" pod "a48fde8b-4dfd-4158-aee9-261aa7c61eda" (UID: "a48fde8b-4dfd-4158-aee9-261aa7c61eda"). InnerVolumeSpecName "kube-api-access-ldbq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:23.076607 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.076577    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldbq5\" (UniqueName: \"kubernetes.io/projected/a48fde8b-4dfd-4158-aee9-261aa7c61eda-kube-api-access-ldbq5\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:23.076607 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.076599    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a48fde8b-4dfd-4158-aee9-261aa7c61eda-maas-api-service-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:23.423929 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.423902    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z"
Oct 30 21:45:23.424385 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.423901    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z" event={"ID":"a48fde8b-4dfd-4158-aee9-261aa7c61eda","Type":"ContainerDied","Data":"7791137c4907146e2e165a39712e8895b8a177da7cd991c75ba4c5378071d817"}
Oct 30 21:45:23.424385 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.424047    4522 scope.go:122] "RemoveContainer" containerID="3a4244fdfd6b9ecf788b6b3231160cb643358b338d9a784f6a60ec379802077c"
Oct 30 21:45:23.426119 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.426093    4522 generic.go:356] "Generic (PLEG): container finished" podID="1f50a977-8e9c-4610-84be-789a2e4fdb03" containerID="1a6a17bcc592b496f91e4e24fac6f2245a0c7ed2abfebe04a7f04758502d5caf" exitCode=60
Oct 30 21:45:23.426271 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.426206    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6" event={"ID":"1f50a977-8e9c-4610-84be-789a2e4fdb03","Type":"ContainerDied","Data":"1a6a17bcc592b496f91e4e24fac6f2245a0c7ed2abfebe04a7f04758502d5caf"}
Oct 30 21:45:23.426619 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.426603    4522 scope.go:122] "RemoveContainer" containerID="1a6a17bcc592b496f91e4e24fac6f2245a0c7ed2abfebe04a7f04758502d5caf"
Oct 30 21:45:23.426872 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:45:23.426849    4522 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6_odh-ai-gateway-infra(1f50a977-8e9c-4610-84be-789a2e4fdb03)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6" podUID="1f50a977-8e9c-4610-84be-789a2e4fdb03"
Oct 30 21:45:23.429324 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.429303    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj" event={"ID":"11373bdd-90b7-49b0-8d30-fcd3aecc457d","Type":"ContainerDied","Data":"cf669e7664ffe85713c53484a5af82e96b6bb23712e0f8fb737256d5e732ce31"}
Oct 30 21:45:23.429403 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.429334    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj"
Oct 30 21:45:23.433388 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.433373    4522 scope.go:122] "RemoveContainer" containerID="e35c9e81efdd28eccfadc80e086941aac5409961317985b7ea8e6a177e295259"
Oct 30 21:45:23.445140 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.445123    4522 scope.go:122] "RemoveContainer" containerID="c852c1c6b0a4dccf287c6d5e7233d197eb8cd2b68f7ef18b34088694bf369c88"
Oct 30 21:45:23.556805 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.556729    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k"]
Oct 30 21:45:23.587922 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.587865    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z"]
Oct 30 21:45:23.590528 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.590505    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-8ce31a-29889945-45d7z"]
Oct 30 21:45:23.678971 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.678937    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k"
Oct 30 21:45:23.784340 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.784309    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b2630c3d-f938-4b16-8d1e-ab7959a8243f-kube-api-access-fcdfh\" (UniqueName: \"kubernetes.io/projected/b2630c3d-f938-4b16-8d1e-ab7959a8243f-kube-api-access-fcdfh\") pod \"b2630c3d-f938-4b16-8d1e-ab7959a8243f\" (UID: \"b2630c3d-f938-4b16-8d1e-ab7959a8243f\") "
Oct 30 21:45:23.784510 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.784346    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b2630c3d-f938-4b16-8d1e-ab7959a8243f-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2630c3d-f938-4b16-8d1e-ab7959a8243f-maas-api-service-ca\") pod \"b2630c3d-f938-4b16-8d1e-ab7959a8243f\" (UID: \"b2630c3d-f938-4b16-8d1e-ab7959a8243f\") "
Oct 30 21:45:23.784796 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.784772    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2630c3d-f938-4b16-8d1e-ab7959a8243f-maas-api-service-ca" pod "b2630c3d-f938-4b16-8d1e-ab7959a8243f" (UID: "b2630c3d-f938-4b16-8d1e-ab7959a8243f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:23.786365 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.786343    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2630c3d-f938-4b16-8d1e-ab7959a8243f-kube-api-access-fcdfh" pod "b2630c3d-f938-4b16-8d1e-ab7959a8243f" (UID: "b2630c3d-f938-4b16-8d1e-ab7959a8243f"). InnerVolumeSpecName "kube-api-access-fcdfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:23.818527 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.818422    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj"]
Oct 30 21:45:23.818783 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.818608    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e0f967-29889945-9jfmj"]
Oct 30 21:45:23.885771 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.885744    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcdfh\" (UniqueName: \"kubernetes.io/projected/b2630c3d-f938-4b16-8d1e-ab7959a8243f-kube-api-access-fcdfh\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:23.885771 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:23.885767    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2630c3d-f938-4b16-8d1e-ab7959a8243f-maas-api-service-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:24.438778 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:24.438745    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k" event={"ID":"b2630c3d-f938-4b16-8d1e-ab7959a8243f","Type":"ContainerDied","Data":"9e16667d6706693e6e38baa05efa548989e944cdadb9b2d70d89c2a47692d976"}
Oct 30 21:45:24.438778 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:24.438764    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k"
Oct 30 21:45:24.439254 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:24.438811    4522 scope.go:122] "RemoveContainer" containerID="bee679017e79e7fd01c02ceb4b97f6053494544bfbc74696fb1aa214ba6ab21c"
Oct 30 21:45:24.602606 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:24.602569    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k"]
Oct 30 21:45:24.606029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:24.606001    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9f52c3-29889945-7rd6k"]
Oct 30 21:45:24.712374 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:24.712302    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6"]
Oct 30 21:45:24.863380 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:24.863357    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6"
Oct 30 21:45:24.998718 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:24.998637    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1f50a977-8e9c-4610-84be-789a2e4fdb03-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f50a977-8e9c-4610-84be-789a2e4fdb03-maas-api-service-ca\") pod \"1f50a977-8e9c-4610-84be-789a2e4fdb03\" (UID: \"1f50a977-8e9c-4610-84be-789a2e4fdb03\") "
Oct 30 21:45:24.998718 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:24.998690    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1f50a977-8e9c-4610-84be-789a2e4fdb03-kube-api-access-dgkk4\" (UniqueName: \"kubernetes.io/projected/1f50a977-8e9c-4610-84be-789a2e4fdb03-kube-api-access-dgkk4\") pod \"1f50a977-8e9c-4610-84be-789a2e4fdb03\" (UID: \"1f50a977-8e9c-4610-84be-789a2e4fdb03\") "
Oct 30 21:45:24.999028 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:24.999007    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f50a977-8e9c-4610-84be-789a2e4fdb03-maas-api-service-ca" pod "1f50a977-8e9c-4610-84be-789a2e4fdb03" (UID: "1f50a977-8e9c-4610-84be-789a2e4fdb03"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:24.999318 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:24.999283    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f50a977-8e9c-4610-84be-789a2e4fdb03-maas-api-service-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:25.001249 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:25.001212    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f50a977-8e9c-4610-84be-789a2e4fdb03-kube-api-access-dgkk4" pod "1f50a977-8e9c-4610-84be-789a2e4fdb03" (UID: "1f50a977-8e9c-4610-84be-789a2e4fdb03"). InnerVolumeSpecName "kube-api-access-dgkk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:25.100358 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:25.100321    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgkk4\" (UniqueName: \"kubernetes.io/projected/1f50a977-8e9c-4610-84be-789a2e4fdb03-kube-api-access-dgkk4\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:25.196412 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:25.196377    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="11373bdd-90b7-49b0-8d30-fcd3aecc457d" path="/var/lib/kubelet/pods/11373bdd-90b7-49b0-8d30-fcd3aecc457d/volumes"
Oct 30 21:45:25.196985 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:25.196967    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a48fde8b-4dfd-4158-aee9-261aa7c61eda" path="/var/lib/kubelet/pods/a48fde8b-4dfd-4158-aee9-261aa7c61eda/volumes"
Oct 30 21:45:25.197522 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:25.197504    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b2630c3d-f938-4b16-8d1e-ab7959a8243f" path="/var/lib/kubelet/pods/b2630c3d-f938-4b16-8d1e-ab7959a8243f/volumes"
Oct 30 21:45:25.446584 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:25.446553    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6" event={"ID":"1f50a977-8e9c-4610-84be-789a2e4fdb03","Type":"ContainerDied","Data":"dc1b4cca7cdc1f3633c30b85ef0b57c753a67cc9584d6cd88f631c3a57efe419"}
Oct 30 21:45:25.446584 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:25.446571    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6"
Oct 30 21:45:25.447042 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:25.446611    4522 scope.go:122] "RemoveContainer" containerID="1a6a17bcc592b496f91e4e24fac6f2245a0c7ed2abfebe04a7f04758502d5caf"
Oct 30 21:45:25.612268 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:25.612240    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6"]
Oct 30 21:45:25.661323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:25.661301    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-be8b73-29889945-6k7c6"]
Oct 30 21:45:25.967682 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:25.967653    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:27.280501 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:27.242628    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1f50a977-8e9c-4610-84be-789a2e4fdb03" path="/var/lib/kubelet/pods/1f50a977-8e9c-4610-84be-789a2e4fdb03/volumes"
Oct 30 21:45:27.319441 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:27.319406    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:27.540398 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:27.540314    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:27.785974 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:27.785945    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:30.258505 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:30.258454    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:31.693804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:31.693751    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:31.944183 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:31.944106    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:32.149300 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:32.149270    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:32.186088 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:32.186061    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b"]
Oct 30 21:45:32.235087 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:32.235039    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-7cf226-jts5b"]
Oct 30 21:45:32.865601 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:32.865569    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:33.192450 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:33.192422    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d5901957-464a-4ded-8a1c-529f2fbc5913" path="/var/lib/kubelet/pods/d5901957-464a-4ded-8a1c-529f2fbc5913/volumes"
Oct 30 21:45:36.997484 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:36.993957    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:37.988733 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:45:37.988694    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:45:39.651437 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:39.651400    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:39.844646 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:39.844604    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:40.041605 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:40.041490    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:41.747483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:41.746971    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:42.263910 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:42.263852    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:42.471972 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:42.471943    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:42.910091 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:42.909995    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:43.120382 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:43.120346    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:46.635845 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:46.635811    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:46.868804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:46.868776    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:46.905153 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:46.905077    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"]
Oct 30 21:45:46.905335 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:46.905311    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb" podUID="9334df98-484a-4998-a61b-f6f442983131" containerName="maas-api" containerID="cri-o://4c3621be4677fdb1f9068738d8d10c913675ca7a96820d88815ae09dc790d6a4" gracePeriod=30
Oct 30 21:45:47.152482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.146578    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:47.248356 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.248326    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"
Oct 30 21:45:47.263528 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.263493    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9334df98-484a-4998-a61b-f6f442983131-kube-api-access-5p7g5\" (UniqueName: \"kubernetes.io/projected/9334df98-484a-4998-a61b-f6f442983131-kube-api-access-5p7g5\") pod \"9334df98-484a-4998-a61b-f6f442983131\" (UID: \"9334df98-484a-4998-a61b-f6f442983131\") "
Oct 30 21:45:47.263670 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.263592    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9334df98-484a-4998-a61b-f6f442983131-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9334df98-484a-4998-a61b-f6f442983131-maas-api-tls\") pod \"9334df98-484a-4998-a61b-f6f442983131\" (UID: \"9334df98-484a-4998-a61b-f6f442983131\") "
Oct 30 21:45:47.263670 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.263651    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9334df98-484a-4998-a61b-f6f442983131-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9334df98-484a-4998-a61b-f6f442983131-openshift-service-ca\") pod \"9334df98-484a-4998-a61b-f6f442983131\" (UID: \"9334df98-484a-4998-a61b-f6f442983131\") "
Oct 30 21:45:47.263787 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.263697    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9334df98-484a-4998-a61b-f6f442983131-metrics-certs\" (UniqueName: \"kubernetes.io/secret/9334df98-484a-4998-a61b-f6f442983131-metrics-certs\") pod \"9334df98-484a-4998-a61b-f6f442983131\" (UID: \"9334df98-484a-4998-a61b-f6f442983131\") "
Oct 30 21:45:47.264122 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.264096    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9334df98-484a-4998-a61b-f6f442983131-openshift-service-ca" pod "9334df98-484a-4998-a61b-f6f442983131" (UID: "9334df98-484a-4998-a61b-f6f442983131"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:47.264343 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.264319    4522 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9334df98-484a-4998-a61b-f6f442983131-openshift-service-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:47.265706 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.265686    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9334df98-484a-4998-a61b-f6f442983131-kube-api-access-5p7g5" pod "9334df98-484a-4998-a61b-f6f442983131" (UID: "9334df98-484a-4998-a61b-f6f442983131"). InnerVolumeSpecName "kube-api-access-5p7g5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:47.266008 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.265997    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9334df98-484a-4998-a61b-f6f442983131-maas-api-tls" pod "9334df98-484a-4998-a61b-f6f442983131" (UID: "9334df98-484a-4998-a61b-f6f442983131"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:47.266309 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.266295    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9334df98-484a-4998-a61b-f6f442983131-metrics-certs" pod "9334df98-484a-4998-a61b-f6f442983131" (UID: "9334df98-484a-4998-a61b-f6f442983131"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:47.365454 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.365421    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5p7g5\" (UniqueName: \"kubernetes.io/projected/9334df98-484a-4998-a61b-f6f442983131-kube-api-access-5p7g5\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:47.365454 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.365450    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9334df98-484a-4998-a61b-f6f442983131-maas-api-tls\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:47.365454 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.365483    4522 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9334df98-484a-4998-a61b-f6f442983131-metrics-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:47.612378 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.612298    4522 generic.go:356] "Generic (PLEG): container finished" podID="9334df98-484a-4998-a61b-f6f442983131" containerID="4c3621be4677fdb1f9068738d8d10c913675ca7a96820d88815ae09dc790d6a4" exitCode=0
Oct 30 21:45:47.612378 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.612353    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"
Oct 30 21:45:47.612605 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.612380    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb" event={"ID":"9334df98-484a-4998-a61b-f6f442983131","Type":"ContainerDied","Data":"4c3621be4677fdb1f9068738d8d10c913675ca7a96820d88815ae09dc790d6a4"}
Oct 30 21:45:47.612605 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.612441    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb" event={"ID":"9334df98-484a-4998-a61b-f6f442983131","Type":"ContainerDied","Data":"9d68d196597698fa9b07a699733eb7602d025713ff38244388b44b912d9da877"}
Oct 30 21:45:47.612605 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.612479    4522 scope.go:122] "RemoveContainer" containerID="4c3621be4677fdb1f9068738d8d10c913675ca7a96820d88815ae09dc790d6a4"
Oct 30 21:45:47.622863 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.622843    4522 scope.go:122] "RemoveContainer" containerID="4c3621be4677fdb1f9068738d8d10c913675ca7a96820d88815ae09dc790d6a4"
Oct 30 21:45:47.623118 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:45:47.623095    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c3621be4677fdb1f9068738d8d10c913675ca7a96820d88815ae09dc790d6a4\": container with ID starting with 4c3621be4677fdb1f9068738d8d10c913675ca7a96820d88815ae09dc790d6a4 not found: ID does not exist" containerID="4c3621be4677fdb1f9068738d8d10c913675ca7a96820d88815ae09dc790d6a4"
Oct 30 21:45:47.623186 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.623130    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c3621be4677fdb1f9068738d8d10c913675ca7a96820d88815ae09dc790d6a4"} err="failed to get container status \"4c3621be4677fdb1f9068738d8d10c913675ca7a96820d88815ae09dc790d6a4\": rpc error: code = NotFound desc = could not find container \"4c3621be4677fdb1f9068738d8d10c913675ca7a96820d88815ae09dc790d6a4\": container with ID starting with 4c3621be4677fdb1f9068738d8d10c913675ca7a96820d88815ae09dc790d6a4 not found: ID does not exist"
Oct 30 21:45:47.774442 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.774408    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"]
Oct 30 21:45:47.779763 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:47.779725    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a4eab-746ccb57f9-5k2lb"]
Oct 30 21:45:49.066081 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:49.066042    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:49.191780 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:49.191749    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9334df98-484a-4998-a61b-f6f442983131" path="/var/lib/kubelet/pods/9334df98-484a-4998-a61b-f6f442983131/volumes"
Oct 30 21:45:49.414170 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:49.414068    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:49.689856 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:49.689818    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:49.891029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:49.890995    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:50.106365 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:50.106283    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:50.314431 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:50.314398    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:51.456582 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:51.456551    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:51.665186 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:51.665158    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:53.643787 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:53.643751    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:53.980913 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:53.980867    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:54.171646 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:54.171606    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:55.555492 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:55.554509    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:57.059547 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:57.059511    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:57.265155 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:57.265119    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:57.316892 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:57.316799    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"]
Oct 30 21:45:57.317071 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:57.317031    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn" podUID="66e432f7-6822-4fa3-9a9f-90cefabb0d17" containerName="istio-proxy" containerID="cri-o://8822d144cf86cd159c88269a6aa450f033e21f0e8c94bfbfaa9edb80646a903e" gracePeriod=30
Oct 30 21:45:57.334537 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:57.334511    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"]
Oct 30 21:45:57.334725 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:57.334705    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g" podUID="2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" containerName="istio-proxy" containerID="cri-o://934e290127161ffdaa99db5ca618eb7079156394f094bf4d078233722aa58271" gracePeriod=30
Oct 30 21:45:57.550544 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:57.550509    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:59.405905 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:59.405867    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"]
Oct 30 21:45:59.406386 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:59.406079    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm" podUID="aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" containerName="istio-proxy" containerID="cri-o://5788bebae6ee5c3771ece9fbb9bcbcbf6d39adb80abceaf881aa71e825377142" gracePeriod=30
Oct 30 21:45:59.455412 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:59.455369    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"]
Oct 30 21:45:59.455877 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:59.455843    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn" podUID="c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" containerName="istio-proxy" containerID="cri-o://b1cb58543b6e6d4435ce6a9033e5fd1d3185394be81168552f8f92a6e7a0e659" gracePeriod=30
Oct 30 21:45:59.457873 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:59.457845    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"]
Oct 30 21:45:59.458057 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:59.458036    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl" podUID="18a2be02-5bed-4207-87ea-f5fde7dcef87" containerName="istio-proxy" containerID="cri-o://9ac8544ed1e8692f0a400a9e4784f8426d3e79b8453bb4589e7743d75a218c1d" gracePeriod=30
Oct 30 21:45:59.541754 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:59.541714    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"]
Oct 30 21:45:59.541996 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:59.541969    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb" podUID="50f3c6ee-4557-489f-a400-c9350be38799" containerName="istio-proxy" containerID="cri-o://62ef7a536c90f667b78a48f793f049b5513d34a0b755458c683459ebe6f40cc8" gracePeriod=30
Oct 30 21:45:59.543918 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:59.543892    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"]
Oct 30 21:45:59.544089 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:59.544062    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg" podUID="2082b08f-ec75-4897-ab22-816004a7a1f4" containerName="istio-proxy" containerID="cri-o://6c889e8a023c4ee32cd761080da65d8d48db831a241dd7b70e0a6271d486d4cb" gracePeriod=30
Oct 30 21:45:59.614731 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:59.614693    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"]
Oct 30 21:45:59.615712 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:59.614954    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4" podUID="e00a76e2-1fa7-4361-aff4-10aedc28a9fa" containerName="istio-proxy" containerID="cri-o://ecd2d2bfec6ab792166e141fc016ce5a79180a45fa5b6185abff0d8b7a94f5a2" gracePeriod=30
Oct 30 21:45:59.628449 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:59.628420    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"]
Oct 30 21:45:59.628652 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:59.628631    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf" podUID="2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" containerName="istio-proxy" containerID="cri-o://910be7374f01bf45953cf60243fe63bdabed498aaeadb70862e0214f36f1f1c4" gracePeriod=30
Oct 30 21:45:59.660849 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:59.660781    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:45:59.660849 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:45:59.660835    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn" podUID="c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:46:00.015241 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:00.015210    4522 patch_prober.go:29] interesting pod/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:46:00.015433 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:00.015264    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g" podUID="2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:46:00.080619 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:00.080589    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:46:00.080708 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:00.080635    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4" podUID="e00a76e2-1fa7-4361-aff4-10aedc28a9fa" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:46:00.207973 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:00.207938    4522 patch_prober.go:29] interesting pod/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:46:00.208072 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:00.207990    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg" podUID="2082b08f-ec75-4897-ab22-816004a7a1f4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:46:00.512274 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:00.512240    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:00.683850 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:00.683818    4522 patch_prober.go:29] interesting pod/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:46:00.684001 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:00.683872    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm" podUID="aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:46:00.714255 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:00.714223    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:00.922437 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:00.922408    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:01.547670 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:01.547642    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:02.305195 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.305164    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:46:02.450516 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.450451    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:46:02.450624 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.450542    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl" podUID="18a2be02-5bed-4207-87ea-f5fde7dcef87" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:46:02.601338 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.601314    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:46:02.667481 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.666589    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:46:02.703829 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.703793    4522 generic.go:356] "Generic (PLEG): container finished" podID="2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" containerID="934e290127161ffdaa99db5ca618eb7079156394f094bf4d078233722aa58271" exitCode=0
Oct 30 21:46:02.704030 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.703905    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g" event={"ID":"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa","Type":"ContainerDied","Data":"934e290127161ffdaa99db5ca618eb7079156394f094bf4d078233722aa58271"}
Oct 30 21:46:02.704030 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.703955    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g" event={"ID":"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa","Type":"ContainerDied","Data":"790d5bc635e4f2776549f6a26c5782eb46c878dfd980f6ee39f0193f03a07b9e"}
Oct 30 21:46:02.704030 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.703982    4522 scope.go:122] "RemoveContainer" containerID="934e290127161ffdaa99db5ca618eb7079156394f094bf4d078233722aa58271"
Oct 30 21:46:02.704173 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.704134    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"
Oct 30 21:46:02.707242 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.707214    4522 generic.go:356] "Generic (PLEG): container finished" podID="66e432f7-6822-4fa3-9a9f-90cefabb0d17" containerID="8822d144cf86cd159c88269a6aa450f033e21f0e8c94bfbfaa9edb80646a903e" exitCode=0
Oct 30 21:46:02.707353 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.707331    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn" event={"ID":"66e432f7-6822-4fa3-9a9f-90cefabb0d17","Type":"ContainerDied","Data":"8822d144cf86cd159c88269a6aa450f033e21f0e8c94bfbfaa9edb80646a903e"}
Oct 30 21:46:02.707422 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.707373    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn" event={"ID":"66e432f7-6822-4fa3-9a9f-90cefabb0d17","Type":"ContainerDied","Data":"a1fdcc4a8d1a863c0507e6ed4edf3cfb94f2b912134e15d9fb15f04cefd497d7"}
Oct 30 21:46:02.707507 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.707442    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"
Oct 30 21:46:02.735362 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.731675    4522 scope.go:122] "RemoveContainer" containerID="934e290127161ffdaa99db5ca618eb7079156394f094bf4d078233722aa58271"
Oct 30 21:46:02.738231 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:46:02.735860    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"934e290127161ffdaa99db5ca618eb7079156394f094bf4d078233722aa58271\": container with ID starting with 934e290127161ffdaa99db5ca618eb7079156394f094bf4d078233722aa58271 not found: ID does not exist" containerID="934e290127161ffdaa99db5ca618eb7079156394f094bf4d078233722aa58271"
Oct 30 21:46:02.738231 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.735903    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"934e290127161ffdaa99db5ca618eb7079156394f094bf4d078233722aa58271"} err="failed to get container status \"934e290127161ffdaa99db5ca618eb7079156394f094bf4d078233722aa58271\": rpc error: code = NotFound desc = could not find container \"934e290127161ffdaa99db5ca618eb7079156394f094bf4d078233722aa58271\": container with ID starting with 934e290127161ffdaa99db5ca618eb7079156394f094bf4d078233722aa58271 not found: ID does not exist"
Oct 30 21:46:02.738231 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.735931    4522 scope.go:122] "RemoveContainer" containerID="8822d144cf86cd159c88269a6aa450f033e21f0e8c94bfbfaa9edb80646a903e"
Oct 30 21:46:02.754704 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.754438    4522 scope.go:122] "RemoveContainer" containerID="8822d144cf86cd159c88269a6aa450f033e21f0e8c94bfbfaa9edb80646a903e"
Oct 30 21:46:02.755244 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:46:02.755148    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8822d144cf86cd159c88269a6aa450f033e21f0e8c94bfbfaa9edb80646a903e\": container with ID starting with 8822d144cf86cd159c88269a6aa450f033e21f0e8c94bfbfaa9edb80646a903e not found: ID does not exist" containerID="8822d144cf86cd159c88269a6aa450f033e21f0e8c94bfbfaa9edb80646a903e"
Oct 30 21:46:02.755244 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.755186    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8822d144cf86cd159c88269a6aa450f033e21f0e8c94bfbfaa9edb80646a903e"} err="failed to get container status \"8822d144cf86cd159c88269a6aa450f033e21f0e8c94bfbfaa9edb80646a903e\": rpc error: code = NotFound desc = could not find container \"8822d144cf86cd159c88269a6aa450f033e21f0e8c94bfbfaa9edb80646a903e\": container with ID starting with 8822d144cf86cd159c88269a6aa450f033e21f0e8c94bfbfaa9edb80646a903e not found: ID does not exist"
Oct 30 21:46:02.783744 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.783717    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-envoy\") pod \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") "
Oct 30 21:46:02.783869 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.783796    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66e432f7-6822-4fa3-9a9f-90cefabb0d17-kube-api-access-bsmdd\" (UniqueName: \"kubernetes.io/projected/66e432f7-6822-4fa3-9a9f-90cefabb0d17-kube-api-access-bsmdd\") pod \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") "
Oct 30 21:46:02.783869 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.783845    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-envoy\") pod \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") "
Oct 30 21:46:02.783984 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.783876    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istiod-ca-cert\") pod \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") "
Oct 30 21:46:02.783984 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.783904    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-podinfo\") pod \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") "
Oct 30 21:46:02.783984 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.783942    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-data\") pod \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") "
Oct 30 21:46:02.783984 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.783973    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-token\" (UniqueName: \"kubernetes.io/projected/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-token\") pod \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") "
Oct 30 21:46:02.784182 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.784022    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-token\" (UniqueName: \"kubernetes.io/projected/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-token\") pod \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") "
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.784810    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-data" pod "66e432f7-6822-4fa3-9a9f-90cefabb0d17" (UID: "66e432f7-6822-4fa3-9a9f-90cefabb0d17"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.785014    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istiod-ca-cert" pod "66e432f7-6822-4fa3-9a9f-90cefabb0d17" (UID: "66e432f7-6822-4fa3-9a9f-90cefabb0d17"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.785418    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-workload-socket" pod "66e432f7-6822-4fa3-9a9f-90cefabb0d17" (UID: "66e432f7-6822-4fa3-9a9f-90cefabb0d17"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.785672    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-workload-socket\") pod \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") "
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.785732    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istiod-ca-cert\") pod \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") "
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.785798    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-data\") pod \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") "
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.785844    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-podinfo\") pod \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") "
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.785894    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-credential-socket\") pod \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") "
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.786066    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-credential-socket\") pod \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") "
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.786217    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-kube-api-access-9wrxr\" (UniqueName: \"kubernetes.io/projected/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-kube-api-access-9wrxr\") pod \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") "
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.786283    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-workload-socket\") pod \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") "
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.786448    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-workload-certs\") pod \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\" (UID: \"66e432f7-6822-4fa3-9a9f-90cefabb0d17\") "
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.786634    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-workload-certs\") pod \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\" (UID: \"2d82e144-f9a4-4729-9ed3-7f09e0cd09fa\") "
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.787630    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-credential-socket" pod "2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" (UID: "2d82e144-f9a4-4729-9ed3-7f09e0cd09fa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.788064    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istiod-ca-cert" pod "2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" (UID: "2d82e144-f9a4-4729-9ed3-7f09e0cd09fa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.788171    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-token" pod "2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" (UID: "2d82e144-f9a4-4729-9ed3-7f09e0cd09fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.788728    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-data" pod "2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" (UID: "2d82e144-f9a4-4729-9ed3-7f09e0cd09fa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.788835    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66e432f7-6822-4fa3-9a9f-90cefabb0d17-kube-api-access-bsmdd" pod "66e432f7-6822-4fa3-9a9f-90cefabb0d17" (UID: "66e432f7-6822-4fa3-9a9f-90cefabb0d17"). InnerVolumeSpecName "kube-api-access-bsmdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.788889    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-envoy" pod "2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" (UID: "2d82e144-f9a4-4729-9ed3-7f09e0cd09fa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.789121    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-workload-certs" pod "66e432f7-6822-4fa3-9a9f-90cefabb0d17" (UID: "66e432f7-6822-4fa3-9a9f-90cefabb0d17"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.789137    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-credential-socket" pod "66e432f7-6822-4fa3-9a9f-90cefabb0d17" (UID: "66e432f7-6822-4fa3-9a9f-90cefabb0d17"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.787055    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-envoy" pod "66e432f7-6822-4fa3-9a9f-90cefabb0d17" (UID: "66e432f7-6822-4fa3-9a9f-90cefabb0d17"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.789259    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-workload-socket" pod "2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" (UID: "2d82e144-f9a4-4729-9ed3-7f09e0cd09fa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.789498    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-workload-certs" pod "2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" (UID: "2d82e144-f9a4-4729-9ed3-7f09e0cd09fa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.790268    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.790295    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.790311    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.790331    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.790345    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.790360    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.790374    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.790394    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.790408    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.790422    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsmdd\" (UniqueName: \"kubernetes.io/projected/66e432f7-6822-4fa3-9a9f-90cefabb0d17-kube-api-access-bsmdd\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.790437    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.790472    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.790487    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.790501    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.794479 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.792605    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-kube-api-access-9wrxr" pod "2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" (UID: "2d82e144-f9a4-4729-9ed3-7f09e0cd09fa"). InnerVolumeSpecName "kube-api-access-9wrxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:02.796375 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.796059    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-podinfo" pod "2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" (UID: "2d82e144-f9a4-4729-9ed3-7f09e0cd09fa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:46:02.796375 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.796210    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-podinfo" pod "66e432f7-6822-4fa3-9a9f-90cefabb0d17" (UID: "66e432f7-6822-4fa3-9a9f-90cefabb0d17"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:46:02.798419 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.797602    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-token" pod "66e432f7-6822-4fa3-9a9f-90cefabb0d17" (UID: "66e432f7-6822-4fa3-9a9f-90cefabb0d17"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:02.891133 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.891083    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wrxr\" (UniqueName: \"kubernetes.io/projected/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-kube-api-access-9wrxr\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.891133 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.891105    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.891133 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.891115    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.891133 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:02.891123    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66e432f7-6822-4fa3-9a9f-90cefabb0d17-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:03.123542 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:03.123511    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"]
Oct 30 21:46:03.127114 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:03.127091    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-2sv9g"]
Oct 30 21:46:03.178689 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:03.178654    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:46:03.178837 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:03.178715    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf" podUID="2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:46:03.192814 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:03.192787    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" path="/var/lib/kubelet/pods/2d82e144-f9a4-4729-9ed3-7f09e0cd09fa/volumes"
Oct 30 21:46:03.234405 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:03.234382    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"]
Oct 30 21:46:03.239221 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:03.239196    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a4eab-openshift-default-868987fdc7-lczpn"]
Oct 30 21:46:04.209033 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.208996    4522 patch_prober.go:29] interesting pod/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:46:04.209424 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.209067    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb" podUID="50f3c6ee-4557-489f-a400-c9350be38799" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:46:04.723923 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.723140    4522 generic.go:356] "Generic (PLEG): container finished" podID="18a2be02-5bed-4207-87ea-f5fde7dcef87" containerID="9ac8544ed1e8692f0a400a9e4784f8426d3e79b8453bb4589e7743d75a218c1d" exitCode=0
Oct 30 21:46:04.723923 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.723224    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl" event={"ID":"18a2be02-5bed-4207-87ea-f5fde7dcef87","Type":"ContainerDied","Data":"9ac8544ed1e8692f0a400a9e4784f8426d3e79b8453bb4589e7743d75a218c1d"}
Oct 30 21:46:04.725665 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.725619    4522 generic.go:356] "Generic (PLEG): container finished" podID="2082b08f-ec75-4897-ab22-816004a7a1f4" containerID="6c889e8a023c4ee32cd761080da65d8d48db831a241dd7b70e0a6271d486d4cb" exitCode=0
Oct 30 21:46:04.726084 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.725766    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg" event={"ID":"2082b08f-ec75-4897-ab22-816004a7a1f4","Type":"ContainerDied","Data":"6c889e8a023c4ee32cd761080da65d8d48db831a241dd7b70e0a6271d486d4cb"}
Oct 30 21:46:04.749021 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.748991    4522 generic.go:356] "Generic (PLEG): container finished" podID="aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" containerID="5788bebae6ee5c3771ece9fbb9bcbcbf6d39adb80abceaf881aa71e825377142" exitCode=0
Oct 30 21:46:04.749134 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.749093    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm" event={"ID":"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc","Type":"ContainerDied","Data":"5788bebae6ee5c3771ece9fbb9bcbcbf6d39adb80abceaf881aa71e825377142"}
Oct 30 21:46:04.754451 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.754233    4522 generic.go:356] "Generic (PLEG): container finished" podID="50f3c6ee-4557-489f-a400-c9350be38799" containerID="62ef7a536c90f667b78a48f793f049b5513d34a0b755458c683459ebe6f40cc8" exitCode=0
Oct 30 21:46:04.754451 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.754364    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb" event={"ID":"50f3c6ee-4557-489f-a400-c9350be38799","Type":"ContainerDied","Data":"62ef7a536c90f667b78a48f793f049b5513d34a0b755458c683459ebe6f40cc8"}
Oct 30 21:46:04.756907 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.756521    4522 generic.go:356] "Generic (PLEG): container finished" podID="c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" containerID="b1cb58543b6e6d4435ce6a9033e5fd1d3185394be81168552f8f92a6e7a0e659" exitCode=0
Oct 30 21:46:04.756907 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.756568    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn" event={"ID":"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a","Type":"ContainerDied","Data":"b1cb58543b6e6d4435ce6a9033e5fd1d3185394be81168552f8f92a6e7a0e659"}
Oct 30 21:46:04.813595 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.812519    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:46:04.819513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.818680    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:46:04.927498 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.927454    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:46:04.953513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.948514    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-token\" (UniqueName: \"kubernetes.io/projected/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-token\") pod \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") "
Oct 30 21:46:04.953513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.948669    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-workload-socket\") pod \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") "
Oct 30 21:46:04.953513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.948722    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-envoy\") pod \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") "
Oct 30 21:46:04.953513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.948772    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-podinfo\") pod \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") "
Oct 30 21:46:04.953513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.948820    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-credential-socket\") pod \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") "
Oct 30 21:46:04.953513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.948902    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-kube-api-access-77llj\" (UniqueName: \"kubernetes.io/projected/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-kube-api-access-77llj\") pod \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") "
Oct 30 21:46:04.953513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.948959    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-workload-socket\") pod \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") "
Oct 30 21:46:04.953513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.949188    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-credential-socket\") pod \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") "
Oct 30 21:46:04.953513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.949266    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-podinfo\") pod \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") "
Oct 30 21:46:04.953513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.949323    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-data\") pod \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") "
Oct 30 21:46:04.953513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.949415    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-data\") pod \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") "
Oct 30 21:46:04.953513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.949509    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-envoy\") pod \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") "
Oct 30 21:46:04.953513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.949578    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istiod-ca-cert\") pod \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") "
Oct 30 21:46:04.953513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.949622    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-token\" (UniqueName: \"kubernetes.io/projected/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-token\") pod \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") "
Oct 30 21:46:04.953513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.949828    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-workload-certs\") pod \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") "
Oct 30 21:46:04.953513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.949922    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istiod-ca-cert\") pod \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") "
Oct 30 21:46:04.953513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.949961    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-workload-certs\") pod \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\" (UID: \"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc\") "
Oct 30 21:46:04.953513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.950034    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-kube-api-access-m9wwn\" (UniqueName: \"kubernetes.io/projected/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-kube-api-access-m9wwn\") pod \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\" (UID: \"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a\") "
Oct 30 21:46:04.961477 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.959881    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-data" pod "c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" (UID: "c2b1659e-bd26-4e4f-a16f-84c9dbc6657a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:04.961477 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.960151    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-data" pod "aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" (UID: "aee67ec5-b09a-40e1-9438-51a8d0c5f4cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:04.961477 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.960437    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istiod-ca-cert" pod "aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" (UID: "aee67ec5-b09a-40e1-9438-51a8d0c5f4cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:04.961477 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.960715    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-workload-socket" pod "c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" (UID: "c2b1659e-bd26-4e4f-a16f-84c9dbc6657a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:04.961477 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.961175    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-credential-socket" pod "c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" (UID: "c2b1659e-bd26-4e4f-a16f-84c9dbc6657a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:04.962551 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.962524    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-workload-certs" pod "c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" (UID: "c2b1659e-bd26-4e4f-a16f-84c9dbc6657a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:04.965752 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.965731    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istiod-ca-cert" pod "c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" (UID: "c2b1659e-bd26-4e4f-a16f-84c9dbc6657a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:04.966691 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.966524    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-envoy" pod "c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" (UID: "c2b1659e-bd26-4e4f-a16f-84c9dbc6657a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:04.966810 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.966765    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-credential-socket" pod "aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" (UID: "aee67ec5-b09a-40e1-9438-51a8d0c5f4cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:04.966968 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.966935    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-workload-socket" pod "aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" (UID: "aee67ec5-b09a-40e1-9438-51a8d0c5f4cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:04.967593 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.967555    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-workload-certs" pod "aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" (UID: "aee67ec5-b09a-40e1-9438-51a8d0c5f4cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:04.970155 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.970131    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-envoy" pod "aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" (UID: "aee67ec5-b09a-40e1-9438-51a8d0c5f4cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:04.974711 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.974690    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-kube-api-access-m9wwn" pod "c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" (UID: "c2b1659e-bd26-4e4f-a16f-84c9dbc6657a"). InnerVolumeSpecName "kube-api-access-m9wwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:04.979262 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.979233    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-podinfo" pod "aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" (UID: "aee67ec5-b09a-40e1-9438-51a8d0c5f4cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:46:04.996567 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:04.996430    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-token" pod "aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" (UID: "aee67ec5-b09a-40e1-9438-51a8d0c5f4cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:05.006610 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.006583    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-token" pod "c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" (UID: "c2b1659e-bd26-4e4f-a16f-84c9dbc6657a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:05.008142 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.008112    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-podinfo" pod "c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" (UID: "c2b1659e-bd26-4e4f-a16f-84c9dbc6657a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:46:05.008142 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.008129    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-kube-api-access-77llj" pod "aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" (UID: "aee67ec5-b09a-40e1-9438-51a8d0c5f4cc"). InnerVolumeSpecName "kube-api-access-77llj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:05.020929 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.020842    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:46:05.024289 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.024269    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:46:05.034768 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.034748    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:46:05.037933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.037913    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:46:05.059188 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059168    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-workload-certs\") pod \"2082b08f-ec75-4897-ab22-816004a7a1f4\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") "
Oct 30 21:46:05.059258 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059196    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-envoy\") pod \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") "
Oct 30 21:46:05.059258 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059216    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-credential-socket\") pod \"18a2be02-5bed-4207-87ea-f5fde7dcef87\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") "
Oct 30 21:46:05.059258 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059236    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-credential-socket\") pod \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") "
Oct 30 21:46:05.059409 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059256    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-workload-certs\") pod \"18a2be02-5bed-4207-87ea-f5fde7dcef87\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") "
Oct 30 21:46:05.059409 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059284    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-workload-socket\") pod \"50f3c6ee-4557-489f-a400-c9350be38799\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") "
Oct 30 21:46:05.059409 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059313    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-token\" (UniqueName: \"kubernetes.io/projected/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-token\") pod \"2082b08f-ec75-4897-ab22-816004a7a1f4\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") "
Oct 30 21:46:05.059409 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059348    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-kube-api-access-wq2bw\" (UniqueName: \"kubernetes.io/projected/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-kube-api-access-wq2bw\") pod \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") "
Oct 30 21:46:05.059409 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059373    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-envoy\") pod \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") "
Oct 30 21:46:05.059409 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059408    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-envoy\") pod \"2082b08f-ec75-4897-ab22-816004a7a1f4\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") "
Oct 30 21:46:05.059722 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059476    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50f3c6ee-4557-489f-a400-c9350be38799-kube-api-access-v4xnz\" (UniqueName: \"kubernetes.io/projected/50f3c6ee-4557-489f-a400-c9350be38799-kube-api-access-v4xnz\") pod \"50f3c6ee-4557-489f-a400-c9350be38799\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") "
Oct 30 21:46:05.059722 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059505    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/50f3c6ee-4557-489f-a400-c9350be38799-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50f3c6ee-4557-489f-a400-c9350be38799-istiod-ca-cert\") pod \"50f3c6ee-4557-489f-a400-c9350be38799\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") "
Oct 30 21:46:05.059722 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059523    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-workload-certs" pod "2082b08f-ec75-4897-ab22-816004a7a1f4" (UID: "2082b08f-ec75-4897-ab22-816004a7a1f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.059722 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059526    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-credential-socket" pod "18a2be02-5bed-4207-87ea-f5fde7dcef87" (UID: "18a2be02-5bed-4207-87ea-f5fde7dcef87"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.059722 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059538    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-workload-certs" pod "18a2be02-5bed-4207-87ea-f5fde7dcef87" (UID: "18a2be02-5bed-4207-87ea-f5fde7dcef87"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.059722 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059543    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-credential-socket" pod "2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" (UID: "2df06a7b-ba8f-4649-a0c6-4de63d76fe3d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.059722 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059549    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2082b08f-ec75-4897-ab22-816004a7a1f4-kube-api-access-q2mrl\" (UniqueName: \"kubernetes.io/projected/2082b08f-ec75-4897-ab22-816004a7a1f4-kube-api-access-q2mrl\") pod \"2082b08f-ec75-4897-ab22-816004a7a1f4\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") "
Oct 30 21:46:05.059722 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059581    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-workload-socket" pod "50f3c6ee-4557-489f-a400-c9350be38799" (UID: "50f3c6ee-4557-489f-a400-c9350be38799"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.059722 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059649    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-data\") pod \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") "
Oct 30 21:46:05.059722 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059678    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-workload-certs\") pod \"50f3c6ee-4557-489f-a400-c9350be38799\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") "
Oct 30 21:46:05.059722 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059706    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/50f3c6ee-4557-489f-a400-c9350be38799-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50f3c6ee-4557-489f-a400-c9350be38799-istio-podinfo\") pod \"50f3c6ee-4557-489f-a400-c9350be38799\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") "
Oct 30 21:46:05.060310 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059760    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-envoy\") pod \"18a2be02-5bed-4207-87ea-f5fde7dcef87\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") "
Oct 30 21:46:05.060310 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059791    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-credential-socket\") pod \"2082b08f-ec75-4897-ab22-816004a7a1f4\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") "
Oct 30 21:46:05.060310 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059827    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-workload-socket\") pod \"2082b08f-ec75-4897-ab22-816004a7a1f4\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") "
Oct 30 21:46:05.060310 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059860    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50f3c6ee-4557-489f-a400-c9350be38799-istio-token\" (UniqueName: \"kubernetes.io/projected/50f3c6ee-4557-489f-a400-c9350be38799-istio-token\") pod \"50f3c6ee-4557-489f-a400-c9350be38799\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") "
Oct 30 21:46:05.060310 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059888    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-data\") pod \"2082b08f-ec75-4897-ab22-816004a7a1f4\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") "
Oct 30 21:46:05.060310 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059937    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-istio-data\") pod \"50f3c6ee-4557-489f-a400-c9350be38799\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") "
Oct 30 21:46:05.060310 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.059982    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-istio-envoy\") pod \"50f3c6ee-4557-489f-a400-c9350be38799\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") "
Oct 30 21:46:05.060310 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060021    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-podinfo\") pod \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") "
Oct 30 21:46:05.060310 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060050    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-workload-certs\") pod \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") "
Oct 30 21:46:05.060310 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060097    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18a2be02-5bed-4207-87ea-f5fde7dcef87-kube-api-access-h8vjm\" (UniqueName: \"kubernetes.io/projected/18a2be02-5bed-4207-87ea-f5fde7dcef87-kube-api-access-h8vjm\") pod \"18a2be02-5bed-4207-87ea-f5fde7dcef87\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") "
Oct 30 21:46:05.060310 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060141    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-podinfo\") pod \"2082b08f-ec75-4897-ab22-816004a7a1f4\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") "
Oct 30 21:46:05.060310 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060181    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2082b08f-ec75-4897-ab22-816004a7a1f4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2082b08f-ec75-4897-ab22-816004a7a1f4-istiod-ca-cert\") pod \"2082b08f-ec75-4897-ab22-816004a7a1f4\" (UID: \"2082b08f-ec75-4897-ab22-816004a7a1f4\") "
Oct 30 21:46:05.060310 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060211    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-data\") pod \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") "
Oct 30 21:46:05.060310 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060252    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-podinfo\") pod \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") "
Oct 30 21:46:05.060310 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060285    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-kube-api-access-clbxt\" (UniqueName: \"kubernetes.io/projected/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-kube-api-access-clbxt\") pod \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") "
Oct 30 21:46:05.061073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060321    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-token\" (UniqueName: \"kubernetes.io/projected/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-token\") pod \"18a2be02-5bed-4207-87ea-f5fde7dcef87\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") "
Oct 30 21:46:05.061073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060351    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-workload-socket\") pod \"18a2be02-5bed-4207-87ea-f5fde7dcef87\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") "
Oct 30 21:46:05.061073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060379    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-workload-socket\") pod \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") "
Oct 30 21:46:05.061073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060428    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/18a2be02-5bed-4207-87ea-f5fde7dcef87-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18a2be02-5bed-4207-87ea-f5fde7dcef87-istiod-ca-cert\") pod \"18a2be02-5bed-4207-87ea-f5fde7dcef87\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") "
Oct 30 21:46:05.061073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060486    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-token\" (UniqueName: \"kubernetes.io/projected/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-token\") pod \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") "
Oct 30 21:46:05.061073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060524    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istiod-ca-cert\") pod \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") "
Oct 30 21:46:05.061073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060554    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-credential-socket\") pod \"50f3c6ee-4557-489f-a400-c9350be38799\" (UID: \"50f3c6ee-4557-489f-a400-c9350be38799\") "
Oct 30 21:46:05.061073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060600    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-podinfo\") pod \"18a2be02-5bed-4207-87ea-f5fde7dcef87\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") "
Oct 30 21:46:05.061073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060634    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-credential-socket\") pod \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") "
Oct 30 21:46:05.061073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060677    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-token\" (UniqueName: \"kubernetes.io/projected/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-token\") pod \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") "
Oct 30 21:46:05.061073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060713    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-workload-socket\") pod \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") "
Oct 30 21:46:05.061073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060751    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istiod-ca-cert\") pod \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\" (UID: \"e00a76e2-1fa7-4361-aff4-10aedc28a9fa\") "
Oct 30 21:46:05.061073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060778    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-workload-certs\") pod \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\" (UID: \"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d\") "
Oct 30 21:46:05.061073 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.060823    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-data\") pod \"18a2be02-5bed-4207-87ea-f5fde7dcef87\" (UID: \"18a2be02-5bed-4207-87ea-f5fde7dcef87\") "
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061422    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061444    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061484    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061498    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061513    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061527    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061540    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061552    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061566    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061579    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061594    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9wwn\" (UniqueName: \"kubernetes.io/projected/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-kube-api-access-m9wwn\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061608    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061621    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061633    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061647    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061660    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061676    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77llj\" (UniqueName: \"kubernetes.io/projected/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-kube-api-access-77llj\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061688    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061701    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061713    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061727    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061740    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061754    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.061804 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061782    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-envoy" pod "e00a76e2-1fa7-4361-aff4-10aedc28a9fa" (UID: "e00a76e2-1fa7-4361-aff4-10aedc28a9fa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.062858 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.061964    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-data" pod "18a2be02-5bed-4207-87ea-f5fde7dcef87" (UID: "18a2be02-5bed-4207-87ea-f5fde7dcef87"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.062858 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.062179    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-kube-api-access-wq2bw" pod "e00a76e2-1fa7-4361-aff4-10aedc28a9fa" (UID: "e00a76e2-1fa7-4361-aff4-10aedc28a9fa"). InnerVolumeSpecName "kube-api-access-wq2bw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:05.062858 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.062344    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-workload-certs" pod "50f3c6ee-4557-489f-a400-c9350be38799" (UID: "50f3c6ee-4557-489f-a400-c9350be38799"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.062858 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.062386    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-data" pod "2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" (UID: "2df06a7b-ba8f-4649-a0c6-4de63d76fe3d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.062858 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.062424    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-envoy" pod "2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" (UID: "2df06a7b-ba8f-4649-a0c6-4de63d76fe3d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.062858 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.062450    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-envoy" pod "2082b08f-ec75-4897-ab22-816004a7a1f4" (UID: "2082b08f-ec75-4897-ab22-816004a7a1f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.062858 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.062515    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2082b08f-ec75-4897-ab22-816004a7a1f4-kube-api-access-q2mrl" pod "2082b08f-ec75-4897-ab22-816004a7a1f4" (UID: "2082b08f-ec75-4897-ab22-816004a7a1f4"). InnerVolumeSpecName "kube-api-access-q2mrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:05.062858 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.062547    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50f3c6ee-4557-489f-a400-c9350be38799-kube-api-access-v4xnz" pod "50f3c6ee-4557-489f-a400-c9350be38799" (UID: "50f3c6ee-4557-489f-a400-c9350be38799"). InnerVolumeSpecName "kube-api-access-v4xnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:05.062858 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.062609    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50f3c6ee-4557-489f-a400-c9350be38799-istiod-ca-cert" pod "50f3c6ee-4557-489f-a400-c9350be38799" (UID: "50f3c6ee-4557-489f-a400-c9350be38799"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:05.062858 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.062797    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-istio-data" pod "50f3c6ee-4557-489f-a400-c9350be38799" (UID: "50f3c6ee-4557-489f-a400-c9350be38799"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.063795 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.062963    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-workload-certs" pod "e00a76e2-1fa7-4361-aff4-10aedc28a9fa" (UID: "e00a76e2-1fa7-4361-aff4-10aedc28a9fa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.063795 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.063021    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-data" pod "2082b08f-ec75-4897-ab22-816004a7a1f4" (UID: "2082b08f-ec75-4897-ab22-816004a7a1f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.063795 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.063106    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-credential-socket" pod "50f3c6ee-4557-489f-a400-c9350be38799" (UID: "50f3c6ee-4557-489f-a400-c9350be38799"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.063795 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.063259    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-data" pod "e00a76e2-1fa7-4361-aff4-10aedc28a9fa" (UID: "e00a76e2-1fa7-4361-aff4-10aedc28a9fa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.063795 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.063517    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-credential-socket" pod "2082b08f-ec75-4897-ab22-816004a7a1f4" (UID: "2082b08f-ec75-4897-ab22-816004a7a1f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.063795 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.063682    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2082b08f-ec75-4897-ab22-816004a7a1f4-istiod-ca-cert" pod "2082b08f-ec75-4897-ab22-816004a7a1f4" (UID: "2082b08f-ec75-4897-ab22-816004a7a1f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:05.063795 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.063729    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-workload-socket" pod "2082b08f-ec75-4897-ab22-816004a7a1f4" (UID: "2082b08f-ec75-4897-ab22-816004a7a1f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.063795 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.063737    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-workload-socket" pod "2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" (UID: "2df06a7b-ba8f-4649-a0c6-4de63d76fe3d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.064144 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.063925    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-credential-socket" pod "e00a76e2-1fa7-4361-aff4-10aedc28a9fa" (UID: "e00a76e2-1fa7-4361-aff4-10aedc28a9fa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.064724 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.064700    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istiod-ca-cert" pod "e00a76e2-1fa7-4361-aff4-10aedc28a9fa" (UID: "e00a76e2-1fa7-4361-aff4-10aedc28a9fa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:05.064854 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.064832    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-podinfo" pod "2082b08f-ec75-4897-ab22-816004a7a1f4" (UID: "2082b08f-ec75-4897-ab22-816004a7a1f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:46:05.064917 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.064883    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/50f3c6ee-4557-489f-a400-c9350be38799-istio-podinfo" pod "50f3c6ee-4557-489f-a400-c9350be38799" (UID: "50f3c6ee-4557-489f-a400-c9350be38799"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:46:05.065036 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.065012    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-workload-socket" pod "18a2be02-5bed-4207-87ea-f5fde7dcef87" (UID: "18a2be02-5bed-4207-87ea-f5fde7dcef87"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.065445 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.065175    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-workload-certs" pod "2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" (UID: "2df06a7b-ba8f-4649-a0c6-4de63d76fe3d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.065445 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.065261    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-workload-socket" pod "e00a76e2-1fa7-4361-aff4-10aedc28a9fa" (UID: "e00a76e2-1fa7-4361-aff4-10aedc28a9fa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.065616 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.065538    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istiod-ca-cert" pod "2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" (UID: "2df06a7b-ba8f-4649-a0c6-4de63d76fe3d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:05.065616 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.065556    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-kube-api-access-clbxt" pod "2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" (UID: "2df06a7b-ba8f-4649-a0c6-4de63d76fe3d"). InnerVolumeSpecName "kube-api-access-clbxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:05.065616 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.065585    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a2be02-5bed-4207-87ea-f5fde7dcef87-istiod-ca-cert" pod "18a2be02-5bed-4207-87ea-f5fde7dcef87" (UID: "18a2be02-5bed-4207-87ea-f5fde7dcef87"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:05.066069 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.066035    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-token" pod "2082b08f-ec75-4897-ab22-816004a7a1f4" (UID: "2082b08f-ec75-4897-ab22-816004a7a1f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:05.066514 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.066486    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-envoy" pod "18a2be02-5bed-4207-87ea-f5fde7dcef87" (UID: "18a2be02-5bed-4207-87ea-f5fde7dcef87"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.066622 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.066601    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50f3c6ee-4557-489f-a400-c9350be38799-istio-token" pod "50f3c6ee-4557-489f-a400-c9350be38799" (UID: "50f3c6ee-4557-489f-a400-c9350be38799"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:05.066837 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.066813    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-podinfo" pod "e00a76e2-1fa7-4361-aff4-10aedc28a9fa" (UID: "e00a76e2-1fa7-4361-aff4-10aedc28a9fa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:46:05.066939 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.066859    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-istio-envoy" pod "50f3c6ee-4557-489f-a400-c9350be38799" (UID: "50f3c6ee-4557-489f-a400-c9350be38799"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:05.067086 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.067064    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-token" pod "e00a76e2-1fa7-4361-aff4-10aedc28a9fa" (UID: "e00a76e2-1fa7-4361-aff4-10aedc28a9fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:05.067543 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.067520    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a2be02-5bed-4207-87ea-f5fde7dcef87-kube-api-access-h8vjm" pod "18a2be02-5bed-4207-87ea-f5fde7dcef87" (UID: "18a2be02-5bed-4207-87ea-f5fde7dcef87"). InnerVolumeSpecName "kube-api-access-h8vjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:05.067615 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.067542    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-token" pod "18a2be02-5bed-4207-87ea-f5fde7dcef87" (UID: "18a2be02-5bed-4207-87ea-f5fde7dcef87"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:05.067615 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.067599    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-podinfo" pod "2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" (UID: "2df06a7b-ba8f-4649-a0c6-4de63d76fe3d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:46:05.067724 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.067709    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-token" pod "2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" (UID: "2df06a7b-ba8f-4649-a0c6-4de63d76fe3d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:05.068021 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.068004    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-podinfo" pod "18a2be02-5bed-4207-87ea-f5fde7dcef87" (UID: "18a2be02-5bed-4207-87ea-f5fde7dcef87"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:46:05.163006 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.162980    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wq2bw\" (UniqueName: \"kubernetes.io/projected/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-kube-api-access-wq2bw\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163006 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163005    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163015    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163024    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4xnz\" (UniqueName: \"kubernetes.io/projected/50f3c6ee-4557-489f-a400-c9350be38799-kube-api-access-v4xnz\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163033    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50f3c6ee-4557-489f-a400-c9350be38799-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163043    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2mrl\" (UniqueName: \"kubernetes.io/projected/2082b08f-ec75-4897-ab22-816004a7a1f4-kube-api-access-q2mrl\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163050    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163058    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163068    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50f3c6ee-4557-489f-a400-c9350be38799-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163076    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163084    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163093    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163101    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50f3c6ee-4557-489f-a400-c9350be38799-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163110    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163118    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163125    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163133    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163141    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163150    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8vjm\" (UniqueName: \"kubernetes.io/projected/18a2be02-5bed-4207-87ea-f5fde7dcef87-kube-api-access-h8vjm\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163158    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163167    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2082b08f-ec75-4897-ab22-816004a7a1f4-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163177    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163187    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163195    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clbxt\" (UniqueName: \"kubernetes.io/projected/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-kube-api-access-clbxt\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163204    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163212    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163210 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163220    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163228    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18a2be02-5bed-4207-87ea-f5fde7dcef87-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163236    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163244    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163251    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50f3c6ee-4557-489f-a400-c9350be38799-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163259    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163267    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163275    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163282    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163289    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163297    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163304    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18a2be02-5bed-4207-87ea-f5fde7dcef87-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163313    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e00a76e2-1fa7-4361-aff4-10aedc28a9fa-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.163933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.163321    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2082b08f-ec75-4897-ab22-816004a7a1f4-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:05.192252 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.192223    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="66e432f7-6822-4fa3-9a9f-90cefabb0d17" path="/var/lib/kubelet/pods/66e432f7-6822-4fa3-9a9f-90cefabb0d17/volumes"
Oct 30 21:46:05.764311 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.764243    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"
Oct 30 21:46:05.764311 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.764260    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn" event={"ID":"c2b1659e-bd26-4e4f-a16f-84c9dbc6657a","Type":"ContainerDied","Data":"ac08255a99a13865fa3d40df571bf4ba85988ac1821e7a8b631fc93bc5599d38"}
Oct 30 21:46:05.764797 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.764323    4522 scope.go:122] "RemoveContainer" containerID="b1cb58543b6e6d4435ce6a9033e5fd1d3185394be81168552f8f92a6e7a0e659"
Oct 30 21:46:05.765798 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.765774    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"
Oct 30 21:46:05.765887 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.765799    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl" event={"ID":"18a2be02-5bed-4207-87ea-f5fde7dcef87","Type":"ContainerDied","Data":"56b6a079ee3be5ec024ccc0aae935c906229322993ba7f3f0de1d18d7064607f"}
Oct 30 21:46:05.767401 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.767372    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg" event={"ID":"2082b08f-ec75-4897-ab22-816004a7a1f4","Type":"ContainerDied","Data":"f0c7733a561f530f9057dd6a5cfd95fe33e11501465d54a1c93fdde32d63a232"}
Oct 30 21:46:05.767550 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.767380    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"
Oct 30 21:46:05.768870 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.768839    4522 generic.go:356] "Generic (PLEG): container finished" podID="e00a76e2-1fa7-4361-aff4-10aedc28a9fa" containerID="ecd2d2bfec6ab792166e141fc016ce5a79180a45fa5b6185abff0d8b7a94f5a2" exitCode=0
Oct 30 21:46:05.768955 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.768876    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"
Oct 30 21:46:05.768955 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.768918    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4" event={"ID":"e00a76e2-1fa7-4361-aff4-10aedc28a9fa","Type":"ContainerDied","Data":"ecd2d2bfec6ab792166e141fc016ce5a79180a45fa5b6185abff0d8b7a94f5a2"}
Oct 30 21:46:05.769076 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.768959    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4" event={"ID":"e00a76e2-1fa7-4361-aff4-10aedc28a9fa","Type":"ContainerDied","Data":"e93c6417b1867e0142057a4cfd3738acc415e9a354f5f998bb1667e369ea9600"}
Oct 30 21:46:05.770304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.770280    4522 generic.go:356] "Generic (PLEG): container finished" podID="2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" containerID="910be7374f01bf45953cf60243fe63bdabed498aaeadb70862e0214f36f1f1c4" exitCode=0
Oct 30 21:46:05.770407 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.770348    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf" event={"ID":"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d","Type":"ContainerDied","Data":"910be7374f01bf45953cf60243fe63bdabed498aaeadb70862e0214f36f1f1c4"}
Oct 30 21:46:05.770407 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.770398    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf" event={"ID":"2df06a7b-ba8f-4649-a0c6-4de63d76fe3d","Type":"ContainerDied","Data":"65a5e311263fe4a4d7f03bc83826eb08e849dd805686ddbdd1cb49f927abb480"}
Oct 30 21:46:05.770528 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.770409    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"
Oct 30 21:46:05.771917 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.771895    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"
Oct 30 21:46:05.771917 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.771908    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm" event={"ID":"aee67ec5-b09a-40e1-9438-51a8d0c5f4cc","Type":"ContainerDied","Data":"672b4b6eeae5592558987fb552913c2bde07ee40f6c256ee80c404037adb3370"}
Oct 30 21:46:05.773403 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.773384    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb" event={"ID":"50f3c6ee-4557-489f-a400-c9350be38799","Type":"ContainerDied","Data":"4892855f85ab5c9d9a7d537bd691f6215d6efdf912417dc58b3b41d189173a22"}
Oct 30 21:46:05.773403 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.773397    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"
Oct 30 21:46:05.775697 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.775678    4522 scope.go:122] "RemoveContainer" containerID="9ac8544ed1e8692f0a400a9e4784f8426d3e79b8453bb4589e7743d75a218c1d"
Oct 30 21:46:05.783731 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.783716    4522 scope.go:122] "RemoveContainer" containerID="6c889e8a023c4ee32cd761080da65d8d48db831a241dd7b70e0a6271d486d4cb"
Oct 30 21:46:05.791263 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.791248    4522 scope.go:122] "RemoveContainer" containerID="ecd2d2bfec6ab792166e141fc016ce5a79180a45fa5b6185abff0d8b7a94f5a2"
Oct 30 21:46:05.798664 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.798650    4522 scope.go:122] "RemoveContainer" containerID="ecd2d2bfec6ab792166e141fc016ce5a79180a45fa5b6185abff0d8b7a94f5a2"
Oct 30 21:46:05.798873 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:46:05.798854    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecd2d2bfec6ab792166e141fc016ce5a79180a45fa5b6185abff0d8b7a94f5a2\": container with ID starting with ecd2d2bfec6ab792166e141fc016ce5a79180a45fa5b6185abff0d8b7a94f5a2 not found: ID does not exist" containerID="ecd2d2bfec6ab792166e141fc016ce5a79180a45fa5b6185abff0d8b7a94f5a2"
Oct 30 21:46:05.798912 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.798884    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecd2d2bfec6ab792166e141fc016ce5a79180a45fa5b6185abff0d8b7a94f5a2"} err="failed to get container status \"ecd2d2bfec6ab792166e141fc016ce5a79180a45fa5b6185abff0d8b7a94f5a2\": rpc error: code = NotFound desc = could not find container \"ecd2d2bfec6ab792166e141fc016ce5a79180a45fa5b6185abff0d8b7a94f5a2\": container with ID starting with ecd2d2bfec6ab792166e141fc016ce5a79180a45fa5b6185abff0d8b7a94f5a2 not found: ID does not exist"
Oct 30 21:46:05.798912 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.798905    4522 scope.go:122] "RemoveContainer" containerID="910be7374f01bf45953cf60243fe63bdabed498aaeadb70862e0214f36f1f1c4"
Oct 30 21:46:05.806242 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.806226    4522 scope.go:122] "RemoveContainer" containerID="910be7374f01bf45953cf60243fe63bdabed498aaeadb70862e0214f36f1f1c4"
Oct 30 21:46:05.806487 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:46:05.806468    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"910be7374f01bf45953cf60243fe63bdabed498aaeadb70862e0214f36f1f1c4\": container with ID starting with 910be7374f01bf45953cf60243fe63bdabed498aaeadb70862e0214f36f1f1c4 not found: ID does not exist" containerID="910be7374f01bf45953cf60243fe63bdabed498aaeadb70862e0214f36f1f1c4"
Oct 30 21:46:05.806525 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.806495    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"910be7374f01bf45953cf60243fe63bdabed498aaeadb70862e0214f36f1f1c4"} err="failed to get container status \"910be7374f01bf45953cf60243fe63bdabed498aaeadb70862e0214f36f1f1c4\": rpc error: code = NotFound desc = could not find container \"910be7374f01bf45953cf60243fe63bdabed498aaeadb70862e0214f36f1f1c4\": container with ID starting with 910be7374f01bf45953cf60243fe63bdabed498aaeadb70862e0214f36f1f1c4 not found: ID does not exist"
Oct 30 21:46:05.806525 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.806509    4522 scope.go:122] "RemoveContainer" containerID="5788bebae6ee5c3771ece9fbb9bcbcbf6d39adb80abceaf881aa71e825377142"
Oct 30 21:46:05.813661 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.813644    4522 scope.go:122] "RemoveContainer" containerID="62ef7a536c90f667b78a48f793f049b5513d34a0b755458c683459ebe6f40cc8"
Oct 30 21:46:05.940280 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.940250    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"]
Oct 30 21:46:05.945877 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.945853    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-bjjsn"]
Oct 30 21:46:05.951077 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:05.951047    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:06.054282 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:06.054210    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"]
Oct 30 21:46:06.060718 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:06.060695    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-r8qxm"]
Oct 30 21:46:06.168255 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:06.168232    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"]
Oct 30 21:46:06.171966 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:06.171943    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-cn9jl"]
Oct 30 21:46:06.195492 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:06.195447    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:06.278705 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:06.278683    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"]
Oct 30 21:46:06.282466 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:06.282434    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-qqpkb"]
Oct 30 21:46:06.390610 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:06.390518    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"]
Oct 30 21:46:06.392565 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:06.392541    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-rfknf"]
Oct 30 21:46:06.402000 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:06.401976    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:06.500737 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:06.500710    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"]
Oct 30 21:46:06.503885 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:06.503860    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-s6mdg"]
Oct 30 21:46:06.610532 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:06.610505    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"]
Oct 30 21:46:06.614641 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:06.614616    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-drzh4"]
Oct 30 21:46:07.192021 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:07.191993    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="18a2be02-5bed-4207-87ea-f5fde7dcef87" path="/var/lib/kubelet/pods/18a2be02-5bed-4207-87ea-f5fde7dcef87/volumes"
Oct 30 21:46:07.192476 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:07.192448    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2082b08f-ec75-4897-ab22-816004a7a1f4" path="/var/lib/kubelet/pods/2082b08f-ec75-4897-ab22-816004a7a1f4/volumes"
Oct 30 21:46:07.192893 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:07.192880    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" path="/var/lib/kubelet/pods/2df06a7b-ba8f-4649-a0c6-4de63d76fe3d/volumes"
Oct 30 21:46:07.193672 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:07.193657    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="50f3c6ee-4557-489f-a400-c9350be38799" path="/var/lib/kubelet/pods/50f3c6ee-4557-489f-a400-c9350be38799/volumes"
Oct 30 21:46:07.194081 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:07.194069    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" path="/var/lib/kubelet/pods/aee67ec5-b09a-40e1-9438-51a8d0c5f4cc/volumes"
Oct 30 21:46:07.194512 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:07.194499    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" path="/var/lib/kubelet/pods/c2b1659e-bd26-4e4f-a16f-84c9dbc6657a/volumes"
Oct 30 21:46:07.195188 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:07.195174    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e00a76e2-1fa7-4361-aff4-10aedc28a9fa" path="/var/lib/kubelet/pods/e00a76e2-1fa7-4361-aff4-10aedc28a9fa/volumes"
Oct 30 21:46:07.989303 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:46:07.989268    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:46:08.533914 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:08.533879    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:08.727659 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:08.727622    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:09.480091 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:09.480058    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:10.120928 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:10.120889    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:10.828188 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:10.828149    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:15.264308 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:15.264228    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:15.921148 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:15.921107    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:16.108594 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:16.107449    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:16.359138 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:16.359055    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:20.960628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:20.960584    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:22.956964 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:22.956926    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:23.190420 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:23.190390    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:23.940014 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:23.939985    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:24.161539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:24.161502    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:25.936797 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:25.936766    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:27.220177 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:27.220137    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:46:28.108409 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:28.108335    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:30.440502 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:30.440448    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:31.813045 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:31.813019    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:46:31.816102 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:31.816077    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:46:34.522514 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:34.522478    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:36.036713 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:36.036682    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:36.245359 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:36.245334    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:36.469509 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:36.469453    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:37.987608 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:46:37.987576    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:46:41.214812 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:41.214777    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:41.424410 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:41.424381    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:41.628346 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:41.628269    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:46.175869 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:46.175796    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:47.086343 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:47.086309    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:47.694421 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:47.694386    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:47.884863 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:47.884832    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:50.247048 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:50.247012    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:50.867480 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:50.866201    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:52.783635 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:52.783604    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:46:53.588822 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:53.588789    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:53.788422 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:53.788391    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:53.982483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:53.981804    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:55.660606 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:55.660570    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:56.993602 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:56.993561    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:57.227415 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:57.227387    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:59.804081 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804046    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k"]
Oct 30 21:46:59.804453 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804437    4522 cpu_manager.go:414] "containerMap: removing container" podUID="2082b08f-ec75-4897-ab22-816004a7a1f4" containerName="istio-proxy"
Oct 30 21:46:59.804453 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804453    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2082b08f-ec75-4897-ab22-816004a7a1f4" containerName="istio-proxy"
Oct 30 21:46:59.804453 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804473    4522 cpu_manager.go:414] "containerMap: removing container" podUID="11373bdd-90b7-49b0-8d30-fcd3aecc457d" containerName="cleanup"
Oct 30 21:46:59.804453 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804481    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11373bdd-90b7-49b0-8d30-fcd3aecc457d" containerName="cleanup"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804487    4522 cpu_manager.go:414] "containerMap: removing container" podUID="b2630c3d-f938-4b16-8d1e-ab7959a8243f" containerName="cleanup"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804491    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2630c3d-f938-4b16-8d1e-ab7959a8243f" containerName="cleanup"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804500    4522 cpu_manager.go:414] "containerMap: removing container" podUID="a48fde8b-4dfd-4158-aee9-261aa7c61eda" containerName="cleanup"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804504    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a48fde8b-4dfd-4158-aee9-261aa7c61eda" containerName="cleanup"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804512    4522 cpu_manager.go:414] "containerMap: removing container" podUID="a48fde8b-4dfd-4158-aee9-261aa7c61eda" containerName="cleanup"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804519    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a48fde8b-4dfd-4158-aee9-261aa7c61eda" containerName="cleanup"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804533    4522 cpu_manager.go:414] "containerMap: removing container" podUID="b2630c3d-f938-4b16-8d1e-ab7959a8243f" containerName="cleanup"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804537    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2630c3d-f938-4b16-8d1e-ab7959a8243f" containerName="cleanup"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804543    4522 cpu_manager.go:414] "containerMap: removing container" podUID="18a2be02-5bed-4207-87ea-f5fde7dcef87" containerName="istio-proxy"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804547    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18a2be02-5bed-4207-87ea-f5fde7dcef87" containerName="istio-proxy"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804552    4522 cpu_manager.go:414] "containerMap: removing container" podUID="11373bdd-90b7-49b0-8d30-fcd3aecc457d" containerName="cleanup"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804556    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11373bdd-90b7-49b0-8d30-fcd3aecc457d" containerName="cleanup"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804565    4522 cpu_manager.go:414] "containerMap: removing container" podUID="66e432f7-6822-4fa3-9a9f-90cefabb0d17" containerName="istio-proxy"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804569    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="66e432f7-6822-4fa3-9a9f-90cefabb0d17" containerName="istio-proxy"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804577    4522 cpu_manager.go:414] "containerMap: removing container" podUID="aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" containerName="istio-proxy"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804581    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" containerName="istio-proxy"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804590    4522 cpu_manager.go:414] "containerMap: removing container" podUID="50f3c6ee-4557-489f-a400-c9350be38799" containerName="istio-proxy"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804596    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50f3c6ee-4557-489f-a400-c9350be38799" containerName="istio-proxy"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804610    4522 cpu_manager.go:414] "containerMap: removing container" podUID="2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" containerName="istio-proxy"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804616    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" containerName="istio-proxy"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804625    4522 cpu_manager.go:414] "containerMap: removing container" podUID="e00a76e2-1fa7-4361-aff4-10aedc28a9fa" containerName="istio-proxy"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804629    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e00a76e2-1fa7-4361-aff4-10aedc28a9fa" containerName="istio-proxy"
Oct 30 21:46:59.804628 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804635    4522 cpu_manager.go:414] "containerMap: removing container" podUID="d5901957-464a-4ded-8a1c-529f2fbc5913" containerName="revoke-keys"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804640    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d5901957-464a-4ded-8a1c-529f2fbc5913" containerName="revoke-keys"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804650    4522 cpu_manager.go:414] "containerMap: removing container" podUID="2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" containerName="istio-proxy"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804654    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" containerName="istio-proxy"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804661    4522 cpu_manager.go:414] "containerMap: removing container" podUID="9334df98-484a-4998-a61b-f6f442983131" containerName="maas-api"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804665    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9334df98-484a-4998-a61b-f6f442983131" containerName="maas-api"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804674    4522 cpu_manager.go:414] "containerMap: removing container" podUID="1f50a977-8e9c-4610-84be-789a2e4fdb03" containerName="cleanup"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804681    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f50a977-8e9c-4610-84be-789a2e4fdb03" containerName="cleanup"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804688    4522 cpu_manager.go:414] "containerMap: removing container" podUID="1f50a977-8e9c-4610-84be-789a2e4fdb03" containerName="cleanup"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804692    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f50a977-8e9c-4610-84be-789a2e4fdb03" containerName="cleanup"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804699    4522 cpu_manager.go:414] "containerMap: removing container" podUID="1f50a977-8e9c-4610-84be-789a2e4fdb03" containerName="cleanup"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804703    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f50a977-8e9c-4610-84be-789a2e4fdb03" containerName="cleanup"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804710    4522 cpu_manager.go:414] "containerMap: removing container" podUID="c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" containerName="istio-proxy"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804716    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" containerName="istio-proxy"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804773    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="aee67ec5-b09a-40e1-9438-51a8d0c5f4cc" containerName="istio-proxy"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804782    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="50f3c6ee-4557-489f-a400-c9350be38799" containerName="istio-proxy"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804789    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="2df06a7b-ba8f-4649-a0c6-4de63d76fe3d" containerName="istio-proxy"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804795    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="e00a76e2-1fa7-4361-aff4-10aedc28a9fa" containerName="istio-proxy"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804799    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="a48fde8b-4dfd-4158-aee9-261aa7c61eda" containerName="cleanup"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804804    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="d5901957-464a-4ded-8a1c-529f2fbc5913" containerName="revoke-keys"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804810    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d82e144-f9a4-4729-9ed3-7f09e0cd09fa" containerName="istio-proxy"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804815    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2630c3d-f938-4b16-8d1e-ab7959a8243f" containerName="cleanup"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804820    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="9334df98-484a-4998-a61b-f6f442983131" containerName="maas-api"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804827    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="1f50a977-8e9c-4610-84be-789a2e4fdb03" containerName="cleanup"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804835    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="1f50a977-8e9c-4610-84be-789a2e4fdb03" containerName="cleanup"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804842    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="c2b1659e-bd26-4e4f-a16f-84c9dbc6657a" containerName="istio-proxy"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804848    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="2082b08f-ec75-4897-ab22-816004a7a1f4" containerName="istio-proxy"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804852    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="11373bdd-90b7-49b0-8d30-fcd3aecc457d" containerName="cleanup"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804857    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="a48fde8b-4dfd-4158-aee9-261aa7c61eda" containerName="cleanup"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804863    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="11373bdd-90b7-49b0-8d30-fcd3aecc457d" containerName="cleanup"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804868    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="11373bdd-90b7-49b0-8d30-fcd3aecc457d" containerName="cleanup"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804873    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="18a2be02-5bed-4207-87ea-f5fde7dcef87" containerName="istio-proxy"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804878    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2630c3d-f938-4b16-8d1e-ab7959a8243f" containerName="cleanup"
Oct 30 21:46:59.805279 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.804883    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="66e432f7-6822-4fa3-9a9f-90cefabb0d17" containerName="istio-proxy"
Oct 30 21:46:59.808094 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.808078    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k"
Oct 30 21:46:59.865225 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.865197    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k"]
Oct 30 21:46:59.912166 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.912142    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vmmz2\""
Oct 30 21:46:59.912301 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.912250    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:46:59.916999 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.916973    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdpl4\" (UniqueName: \"kubernetes.io/projected/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-kube-api-access-bdpl4\") pod \"maas-api-revoke-sub-f39f471c-c669k\" (UID: \"bb295ee6-c611-423f-b1aa-f9d2a6ce5d07\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k"
Oct 30 21:46:59.917071 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.917026    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f39f471c-c669k\" (UID: \"bb295ee6-c611-423f-b1aa-f9d2a6ce5d07\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k"
Oct 30 21:46:59.917184 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:46:59.917165    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f39f471c-c669k\" (UID: \"bb295ee6-c611-423f-b1aa-f9d2a6ce5d07\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k"
Oct 30 21:47:00.018631 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:00.018603    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f39f471c-c669k\" (UID: \"bb295ee6-c611-423f-b1aa-f9d2a6ce5d07\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k"
Oct 30 21:47:00.018755 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:00.018697    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdpl4\" (UniqueName: \"kubernetes.io/projected/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-kube-api-access-bdpl4\") pod \"maas-api-revoke-sub-f39f471c-c669k\" (UID: \"bb295ee6-c611-423f-b1aa-f9d2a6ce5d07\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k"
Oct 30 21:47:00.018755 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:00.018721    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f39f471c-c669k\" (UID: \"bb295ee6-c611-423f-b1aa-f9d2a6ce5d07\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k"
Oct 30 21:47:00.019305 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:00.019286    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f39f471c-c669k\" (UID: \"bb295ee6-c611-423f-b1aa-f9d2a6ce5d07\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k"
Oct 30 21:47:00.020920 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:00.020900    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f39f471c-c669k\" (UID: \"bb295ee6-c611-423f-b1aa-f9d2a6ce5d07\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k"
Oct 30 21:47:00.075558 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:00.075506    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdpl4\" (UniqueName: \"kubernetes.io/projected/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-kube-api-access-bdpl4\") pod \"maas-api-revoke-sub-f39f471c-c669k\" (UID: \"bb295ee6-c611-423f-b1aa-f9d2a6ce5d07\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k"
Oct 30 21:47:00.121566 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:00.121546    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k"
Oct 30 21:47:00.490402 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:00.490373    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k"]
Oct 30 21:47:00.493579 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:47:00.493544    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb295ee6_c611_423f_b1aa_f9d2a6ce5d07.slice/crio-91ab364ea4df5ca69bfd4502fe6718ad72fc81546ea12e63b8df64536e24b0d2 WatchSource:0}: Error finding container 91ab364ea4df5ca69bfd4502fe6718ad72fc81546ea12e63b8df64536e24b0d2: Status 404 returned error can't find the container with id 91ab364ea4df5ca69bfd4502fe6718ad72fc81546ea12e63b8df64536e24b0d2
Oct 30 21:47:00.690358 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:00.690324    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:01.078855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:01.078824    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k" event={"ID":"bb295ee6-c611-423f-b1aa-f9d2a6ce5d07","Type":"ContainerStarted","Data":"c0295a1a37d424c3260de5a6bbdf785896e9434d1fed5d413dd142944734d539"}
Oct 30 21:47:01.079196 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:01.078907    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k" event={"ID":"bb295ee6-c611-423f-b1aa-f9d2a6ce5d07","Type":"ContainerStarted","Data":"91ab364ea4df5ca69bfd4502fe6718ad72fc81546ea12e63b8df64536e24b0d2"}
Oct 30 21:47:01.194156 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:01.194097    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k" podStartSLOduration=2.194080353 podStartE2EDuration="2.194080353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:47:01.191743971 +0000 UTC m=+2130.136689331" watchObservedRunningTime="2026-10-30 21:47:01.194080353 +0000 UTC m=+2130.139025713"
Oct 30 21:47:02.085263 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:02.085225    4522 generic.go:356] "Generic (PLEG): container finished" podID="bb295ee6-c611-423f-b1aa-f9d2a6ce5d07" containerID="c0295a1a37d424c3260de5a6bbdf785896e9434d1fed5d413dd142944734d539" exitCode=0
Oct 30 21:47:02.085651 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:02.085289    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k" event={"ID":"bb295ee6-c611-423f-b1aa-f9d2a6ce5d07","Type":"ContainerDied","Data":"c0295a1a37d424c3260de5a6bbdf785896e9434d1fed5d413dd142944734d539"}
Oct 30 21:47:03.228759 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:03.228734    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k"
Oct 30 21:47:03.350523 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:03.350433    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-maas-api-openshift-ca\") pod \"bb295ee6-c611-423f-b1aa-f9d2a6ce5d07\" (UID: \"bb295ee6-c611-423f-b1aa-f9d2a6ce5d07\") "
Oct 30 21:47:03.350700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:03.350547    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-kube-api-access-bdpl4\" (UniqueName: \"kubernetes.io/projected/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-kube-api-access-bdpl4\") pod \"bb295ee6-c611-423f-b1aa-f9d2a6ce5d07\" (UID: \"bb295ee6-c611-423f-b1aa-f9d2a6ce5d07\") "
Oct 30 21:47:03.350700 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:03.350667    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-maas-api-xks-ca\") pod \"bb295ee6-c611-423f-b1aa-f9d2a6ce5d07\" (UID: \"bb295ee6-c611-423f-b1aa-f9d2a6ce5d07\") "
Oct 30 21:47:03.350850 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:03.350828    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-maas-api-openshift-ca" pod "bb295ee6-c611-423f-b1aa-f9d2a6ce5d07" (UID: "bb295ee6-c611-423f-b1aa-f9d2a6ce5d07"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:47:03.351487 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:03.351446    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-maas-api-openshift-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:03.353041 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:03.353011    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-kube-api-access-bdpl4" pod "bb295ee6-c611-423f-b1aa-f9d2a6ce5d07" (UID: "bb295ee6-c611-423f-b1aa-f9d2a6ce5d07"). InnerVolumeSpecName "kube-api-access-bdpl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:47:03.353171 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:03.353118    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-maas-api-xks-ca" pod "bb295ee6-c611-423f-b1aa-f9d2a6ce5d07" (UID: "bb295ee6-c611-423f-b1aa-f9d2a6ce5d07"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:47:03.452932 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:03.452897    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdpl4\" (UniqueName: \"kubernetes.io/projected/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-kube-api-access-bdpl4\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:03.452932 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:03.452928    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07-maas-api-xks-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:04.096815 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:04.096782    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k" event={"ID":"bb295ee6-c611-423f-b1aa-f9d2a6ce5d07","Type":"ContainerDied","Data":"91ab364ea4df5ca69bfd4502fe6718ad72fc81546ea12e63b8df64536e24b0d2"}
Oct 30 21:47:04.097001 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:04.096833    4522 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91ab364ea4df5ca69bfd4502fe6718ad72fc81546ea12e63b8df64536e24b0d2"
Oct 30 21:47:04.097001 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:04.096791    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k"
Oct 30 21:47:05.696945 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:05.696309    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:07.988601 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:47:07.988566    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:47:10.946582 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:10.946517    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:14.919044 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:14.919003    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:14.919687 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:14.919665    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:47:16.110836 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:16.110799    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:16.664120 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:16.658715    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:16.886927 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:16.886896    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:20.584280 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:20.584232    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:20.788495 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:20.788450    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:20.985507 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:20.985451    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:25.510738 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:25.510707    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:28.449225 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:28.449192    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:30.251788 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:30.251749    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:33.640779 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:33.640742    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:35.045483 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:35.045427    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:37.987408 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:47:37.987376    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:47:38.044695 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:38.044663    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:39.415695 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:39.415664    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:40.930811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:40.930775    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:41.130988 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:41.130960    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:41.329826 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:41.329751    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:41.828583 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:41.828549    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:46.135657 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:46.135621    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:48.108439 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:48.108403    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:48.297973 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:48.297943    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:48.492032 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:48.491997    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:48.875949 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:48.875871    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:47:48.912445 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:48.912404    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:50.493899 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:50.493861    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:52.021990 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:52.021954    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:52.295793 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:52.295680    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:52.516033 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:52.515987    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:52.968357 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:52.968313    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:53.879131 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:53.879101    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"]
Oct 30 21:47:54.030754 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:54.030701    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:57.450285 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:57.450230    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:59.273395 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:59.273327    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:59.480178 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:59.480145    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:59.554809 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:59.554738    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"]
Oct 30 21:47:59.554983 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:59.554951    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf" podUID="f6d41871-eb2d-4e14-90d0-77425f828f41" containerName="istio-proxy" containerID="cri-o://fb2566a3f1235a4f51b6c5bb668ccdc502cef48b95238d9a9580357593435b1e" gracePeriod=30
Oct 30 21:47:59.684251 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:47:59.684219    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:01.369791 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:01.369747    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:01.583595 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:01.583563    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:02.254216 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:02.254107    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:02.940373 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:02.940338    4522 patch_prober.go:29] interesting pod/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:48:02.940759 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:02.940390    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf" podUID="f6d41871-eb2d-4e14-90d0-77425f828f41" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:48:04.818017 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:04.817945    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:48:04.997112 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:04.997077    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-workload-certs\") pod \"f6d41871-eb2d-4e14-90d0-77425f828f41\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") "
Oct 30 21:48:04.997273 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:04.997145    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-workload-socket\") pod \"f6d41871-eb2d-4e14-90d0-77425f828f41\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") "
Oct 30 21:48:04.997273 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:04.997178    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f6d41871-eb2d-4e14-90d0-77425f828f41-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6d41871-eb2d-4e14-90d0-77425f828f41-istiod-ca-cert\") pod \"f6d41871-eb2d-4e14-90d0-77425f828f41\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") "
Oct 30 21:48:04.997273 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:04.997233    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-data\") pod \"f6d41871-eb2d-4e14-90d0-77425f828f41\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") "
Oct 30 21:48:04.997440 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:04.997328    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-podinfo\") pod \"f6d41871-eb2d-4e14-90d0-77425f828f41\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") "
Oct 30 21:48:04.997440 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:04.997366    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-token\" (UniqueName: \"kubernetes.io/projected/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-token\") pod \"f6d41871-eb2d-4e14-90d0-77425f828f41\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") "
Oct 30 21:48:04.997571 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:04.997444    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f6d41871-eb2d-4e14-90d0-77425f828f41-kube-api-access-7r9dx\" (UniqueName: \"kubernetes.io/projected/f6d41871-eb2d-4e14-90d0-77425f828f41-kube-api-access-7r9dx\") pod \"f6d41871-eb2d-4e14-90d0-77425f828f41\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") "
Oct 30 21:48:04.997571 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:04.997326    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-workload-certs" pod "f6d41871-eb2d-4e14-90d0-77425f828f41" (UID: "f6d41871-eb2d-4e14-90d0-77425f828f41"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:04.997571 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:04.997521    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-workload-socket" pod "f6d41871-eb2d-4e14-90d0-77425f828f41" (UID: "f6d41871-eb2d-4e14-90d0-77425f828f41"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:04.997760 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:04.997734    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6d41871-eb2d-4e14-90d0-77425f828f41-istiod-ca-cert" pod "f6d41871-eb2d-4e14-90d0-77425f828f41" (UID: "f6d41871-eb2d-4e14-90d0-77425f828f41"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:48:04.997881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:04.997858    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-envoy\") pod \"f6d41871-eb2d-4e14-90d0-77425f828f41\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") "
Oct 30 21:48:04.998122 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:04.997914    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-credential-socket\") pod \"f6d41871-eb2d-4e14-90d0-77425f828f41\" (UID: \"f6d41871-eb2d-4e14-90d0-77425f828f41\") "
Oct 30 21:48:04.998122 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:04.998010    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-data" pod "f6d41871-eb2d-4e14-90d0-77425f828f41" (UID: "f6d41871-eb2d-4e14-90d0-77425f828f41"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:04.998395 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:04.998373    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:04.998395 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:04.998402    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6d41871-eb2d-4e14-90d0-77425f828f41-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:04.998565 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:04.998415    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:04.998565 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:04.998428    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:04.998666 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:04.998587    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-credential-socket" pod "f6d41871-eb2d-4e14-90d0-77425f828f41" (UID: "f6d41871-eb2d-4e14-90d0-77425f828f41"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:04.999987 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:04.999795    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6d41871-eb2d-4e14-90d0-77425f828f41-kube-api-access-7r9dx" pod "f6d41871-eb2d-4e14-90d0-77425f828f41" (UID: "f6d41871-eb2d-4e14-90d0-77425f828f41"). InnerVolumeSpecName "kube-api-access-7r9dx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:05.000365 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:05.000342    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-podinfo" pod "f6d41871-eb2d-4e14-90d0-77425f828f41" (UID: "f6d41871-eb2d-4e14-90d0-77425f828f41"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:48:05.000583 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:05.000560    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-token" pod "f6d41871-eb2d-4e14-90d0-77425f828f41" (UID: "f6d41871-eb2d-4e14-90d0-77425f828f41"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:05.000690 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:05.000671    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-envoy" pod "f6d41871-eb2d-4e14-90d0-77425f828f41" (UID: "f6d41871-eb2d-4e14-90d0-77425f828f41"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:05.099287 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:05.099227    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:05.099287 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:05.099252    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:05.099287 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:05.099265    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7r9dx\" (UniqueName: \"kubernetes.io/projected/f6d41871-eb2d-4e14-90d0-77425f828f41-kube-api-access-7r9dx\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:05.099287 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:05.099277    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:05.099287 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:05.099285    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6d41871-eb2d-4e14-90d0-77425f828f41-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:05.406099 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:05.406019    4522 generic.go:356] "Generic (PLEG): container finished" podID="f6d41871-eb2d-4e14-90d0-77425f828f41" containerID="fb2566a3f1235a4f51b6c5bb668ccdc502cef48b95238d9a9580357593435b1e" exitCode=0
Oct 30 21:48:05.406099 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:05.406065    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"
Oct 30 21:48:05.406287 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:05.406101    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf" event={"ID":"f6d41871-eb2d-4e14-90d0-77425f828f41","Type":"ContainerDied","Data":"fb2566a3f1235a4f51b6c5bb668ccdc502cef48b95238d9a9580357593435b1e"}
Oct 30 21:48:05.406287 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:05.406153    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf" event={"ID":"f6d41871-eb2d-4e14-90d0-77425f828f41","Type":"ContainerDied","Data":"8e0fe082445e7e976022c296eda7e0bd630c0784e2eb5f8a94005ec1f06ccbce"}
Oct 30 21:48:05.406287 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:05.406174    4522 scope.go:122] "RemoveContainer" containerID="fb2566a3f1235a4f51b6c5bb668ccdc502cef48b95238d9a9580357593435b1e"
Oct 30 21:48:05.414669 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:05.414655    4522 scope.go:122] "RemoveContainer" containerID="fb2566a3f1235a4f51b6c5bb668ccdc502cef48b95238d9a9580357593435b1e"
Oct 30 21:48:05.414936 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:48:05.414914    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb2566a3f1235a4f51b6c5bb668ccdc502cef48b95238d9a9580357593435b1e\": container with ID starting with fb2566a3f1235a4f51b6c5bb668ccdc502cef48b95238d9a9580357593435b1e not found: ID does not exist" containerID="fb2566a3f1235a4f51b6c5bb668ccdc502cef48b95238d9a9580357593435b1e"
Oct 30 21:48:05.415029 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:05.414941    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb2566a3f1235a4f51b6c5bb668ccdc502cef48b95238d9a9580357593435b1e"} err="failed to get container status \"fb2566a3f1235a4f51b6c5bb668ccdc502cef48b95238d9a9580357593435b1e\": rpc error: code = NotFound desc = could not find container \"fb2566a3f1235a4f51b6c5bb668ccdc502cef48b95238d9a9580357593435b1e\": container with ID starting with fb2566a3f1235a4f51b6c5bb668ccdc502cef48b95238d9a9580357593435b1e not found: ID does not exist"
Oct 30 21:48:05.567209 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:05.567186    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"]
Oct 30 21:48:05.615877 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:05.615852    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-9f52c3-openshift-default-df5ffd65f-7k9pf"]
Oct 30 21:48:05.814107 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:05.814086    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:06.047851 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:06.047824    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:06.961834 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:06.961803    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:07.192227 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:07.192195    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f6d41871-eb2d-4e14-90d0-77425f828f41" path="/var/lib/kubelet/pods/f6d41871-eb2d-4e14-90d0-77425f828f41/volumes"
Oct 30 21:48:07.987755 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:48:07.987717    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:48:08.898640 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:08.898599    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld" podUID="afd04a47-10c4-4ccf-879c-c549765a0c50" containerName="main" containerID="cri-o://fc1fd3c5b2c3e815c38320e738c34ead08dafeaeda96deb1614c62d92dd0ae99" gracePeriod=45
Oct 30 21:48:09.144913 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.144889    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:48:09.231305 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.231278    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-home\" (UniqueName: \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-home\") pod \"afd04a47-10c4-4ccf-879c-c549765a0c50\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") "
Oct 30 21:48:09.231431 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.231334    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/afd04a47-10c4-4ccf-879c-c549765a0c50-tls-certs\" (UniqueName: \"kubernetes.io/secret/afd04a47-10c4-4ccf-879c-c549765a0c50-tls-certs\") pod \"afd04a47-10c4-4ccf-879c-c549765a0c50\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") "
Oct 30 21:48:09.231431 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.231375    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/afd04a47-10c4-4ccf-879c-c549765a0c50-kube-api-access-xxsgn\" (UniqueName: \"kubernetes.io/projected/afd04a47-10c4-4ccf-879c-c549765a0c50-kube-api-access-xxsgn\") pod \"afd04a47-10c4-4ccf-879c-c549765a0c50\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") "
Oct 30 21:48:09.231632 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.231523    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-home" pod "afd04a47-10c4-4ccf-879c-c549765a0c50" (UID: "afd04a47-10c4-4ccf-879c-c549765a0c50"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:09.231632 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.231555    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-model-cache\") pod \"afd04a47-10c4-4ccf-879c-c549765a0c50\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") "
Oct 30 21:48:09.231632 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.231591    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-tmp-dir\") pod \"afd04a47-10c4-4ccf-879c-c549765a0c50\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") "
Oct 30 21:48:09.231781 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.231656    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-dshm\" (UniqueName: \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-dshm\") pod \"afd04a47-10c4-4ccf-879c-c549765a0c50\" (UID: \"afd04a47-10c4-4ccf-879c-c549765a0c50\") "
Oct 30 21:48:09.231781 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.231674    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-model-cache" pod "afd04a47-10c4-4ccf-879c-c549765a0c50" (UID: "afd04a47-10c4-4ccf-879c-c549765a0c50"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:09.231888 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.231863    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-tmp-dir" pod "afd04a47-10c4-4ccf-879c-c549765a0c50" (UID: "afd04a47-10c4-4ccf-879c-c549765a0c50"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:09.232075 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.232052    4522 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-model-cache\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:09.232166 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.232079    4522 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-tmp-dir\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:09.232166 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.232094    4522 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-home\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:09.233616 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.233587    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-dshm" pod "afd04a47-10c4-4ccf-879c-c549765a0c50" (UID: "afd04a47-10c4-4ccf-879c-c549765a0c50"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:09.233705 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.233615    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afd04a47-10c4-4ccf-879c-c549765a0c50-kube-api-access-xxsgn" pod "afd04a47-10c4-4ccf-879c-c549765a0c50" (UID: "afd04a47-10c4-4ccf-879c-c549765a0c50"). InnerVolumeSpecName "kube-api-access-xxsgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:09.233705 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.233655    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afd04a47-10c4-4ccf-879c-c549765a0c50-tls-certs" pod "afd04a47-10c4-4ccf-879c-c549765a0c50" (UID: "afd04a47-10c4-4ccf-879c-c549765a0c50"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:09.333714 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.333676    4522 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afd04a47-10c4-4ccf-879c-c549765a0c50-dshm\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:09.333714 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.333715    4522 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afd04a47-10c4-4ccf-879c-c549765a0c50-tls-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:09.333964 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.333731    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxsgn\" (UniqueName: \"kubernetes.io/projected/afd04a47-10c4-4ccf-879c-c549765a0c50-kube-api-access-xxsgn\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:09.428072 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.428040    4522 generic.go:356] "Generic (PLEG): container finished" podID="afd04a47-10c4-4ccf-879c-c549765a0c50" containerID="fc1fd3c5b2c3e815c38320e738c34ead08dafeaeda96deb1614c62d92dd0ae99" exitCode=0
Oct 30 21:48:09.428213 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.428136    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"
Oct 30 21:48:09.428213 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.428153    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld" event={"ID":"afd04a47-10c4-4ccf-879c-c549765a0c50","Type":"ContainerDied","Data":"fc1fd3c5b2c3e815c38320e738c34ead08dafeaeda96deb1614c62d92dd0ae99"}
Oct 30 21:48:09.428213 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.428187    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld" event={"ID":"afd04a47-10c4-4ccf-879c-c549765a0c50","Type":"ContainerDied","Data":"8e28ce88f58ead4656afa144361c50c12a66f7cbb2c74f48bd24d98189776e1a"}
Oct 30 21:48:09.428213 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.428207    4522 scope.go:122] "RemoveContainer" containerID="fc1fd3c5b2c3e815c38320e738c34ead08dafeaeda96deb1614c62d92dd0ae99"
Oct 30 21:48:09.437415 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.437399    4522 scope.go:122] "RemoveContainer" containerID="fc1fd3c5b2c3e815c38320e738c34ead08dafeaeda96deb1614c62d92dd0ae99"
Oct 30 21:48:09.437670 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:48:09.437653    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc1fd3c5b2c3e815c38320e738c34ead08dafeaeda96deb1614c62d92dd0ae99\": container with ID starting with fc1fd3c5b2c3e815c38320e738c34ead08dafeaeda96deb1614c62d92dd0ae99 not found: ID does not exist" containerID="fc1fd3c5b2c3e815c38320e738c34ead08dafeaeda96deb1614c62d92dd0ae99"
Oct 30 21:48:09.437737 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.437683    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc1fd3c5b2c3e815c38320e738c34ead08dafeaeda96deb1614c62d92dd0ae99"} err="failed to get container status \"fc1fd3c5b2c3e815c38320e738c34ead08dafeaeda96deb1614c62d92dd0ae99\": rpc error: code = NotFound desc = could not find container \"fc1fd3c5b2c3e815c38320e738c34ead08dafeaeda96deb1614c62d92dd0ae99\": container with ID starting with fc1fd3c5b2c3e815c38320e738c34ead08dafeaeda96deb1614c62d92dd0ae99 not found: ID does not exist"
Oct 30 21:48:09.589712 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.589625    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"]
Oct 30 21:48:09.591382 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:09.591354    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld"]
Oct 30 21:48:10.094982 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:10.094933    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-38b832/premium-w2-38b832-kserve-544986cd88-bgcld" podUID="afd04a47-10c4-4ccf-879c-c549765a0c50" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": context deadline exceeded"
Oct 30 21:48:11.190644 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:11.190606    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="afd04a47-10c4-4ccf-879c-c549765a0c50" path="/var/lib/kubelet/pods/afd04a47-10c4-4ccf-879c-c549765a0c50/volumes"
Oct 30 21:48:11.662198 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:11.662090    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:16.344800 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:16.344703    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:21.047546 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:21.047509    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:23.007369 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:23.007337    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:48:25.969858 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:25.969799    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:28.787267 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:28.787227    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:30.668902 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:30.668850    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:30.879059 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:30.879013    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:31.069746 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:31.069654    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:32.851148 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:32.851118    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:35.347575 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:35.347522    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:37.987122 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:48:37.987088    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:48:39.480399 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:39.480360    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:39.669043 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:39.669011    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:40.245813 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:40.245782    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:44.989703 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:44.989664    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:49.637613 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:49.637578    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:54.523536 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:54.523501    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:56.554250 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:56.554220    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:48:59.334660 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:48:59.334623    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:03.987013 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:03.986984    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:04.269135 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:04.269036    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:04.481784 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:04.481752    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:07.987790 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:49:07.987758    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:49:08.118382 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:08.118353    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:09.574255 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:09.574217    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:09.837107 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:09.837017    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:10.040497 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:10.040444    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:10.239486 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:10.239443    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:10.493621 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:10.493538    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:14.876374 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:14.876316    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:15.640391 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:15.640352    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:49:17.709371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:17.709340    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:17.915403 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:17.915376    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:18.006802 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:18.006728    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"]
Oct 30 21:49:18.006962 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:18.006942    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz" podUID="7c59d15b-3c97-44d5-a0b0-df53e4c8f646" containerName="istio-proxy" containerID="cri-o://a868b47e29abc2ddc88a4a2bde693bc8cc96e6b672f73d7bd96525884117a8e1" gracePeriod=30
Oct 30 21:49:18.119580 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:18.119543    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:18.564713 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:18.564676    4522 patch_prober.go:29] interesting pod/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:49:18.564875 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:18.564735    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz" podUID="7c59d15b-3c97-44d5-a0b0-df53e4c8f646" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:49:19.855973 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:19.855938    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:23.263110 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.263084    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:49:23.291616 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.291557    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-workload-socket\") pod \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") "
Oct 30 21:49:23.291616 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.291604    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-kube-api-access-55t5t\" (UniqueName: \"kubernetes.io/projected/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-kube-api-access-55t5t\") pod \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") "
Oct 30 21:49:23.291791 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.291643    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istiod-ca-cert\") pod \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") "
Oct 30 21:49:23.291791 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.291689    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-envoy\") pod \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") "
Oct 30 21:49:23.291791 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.291749    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-token\" (UniqueName: \"kubernetes.io/projected/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-token\") pod \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") "
Oct 30 21:49:23.291943 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.291794    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-credential-socket\") pod \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") "
Oct 30 21:49:23.291943 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.291820    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-workload-socket" pod "7c59d15b-3c97-44d5-a0b0-df53e4c8f646" (UID: "7c59d15b-3c97-44d5-a0b0-df53e4c8f646"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:49:23.291943 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.291887    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-data\") pod \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") "
Oct 30 21:49:23.291943 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.291924    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-workload-certs\") pod \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") "
Oct 30 21:49:23.292140 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.291953    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-podinfo\") pod \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\" (UID: \"7c59d15b-3c97-44d5-a0b0-df53e4c8f646\") "
Oct 30 21:49:23.292140 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.292088    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-credential-socket" pod "7c59d15b-3c97-44d5-a0b0-df53e4c8f646" (UID: "7c59d15b-3c97-44d5-a0b0-df53e4c8f646"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:49:23.292140 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.292104    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-data" pod "7c59d15b-3c97-44d5-a0b0-df53e4c8f646" (UID: "7c59d15b-3c97-44d5-a0b0-df53e4c8f646"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:49:23.292140 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.292123    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istiod-ca-cert" pod "7c59d15b-3c97-44d5-a0b0-df53e4c8f646" (UID: "7c59d15b-3c97-44d5-a0b0-df53e4c8f646"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:49:23.292351 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.292248    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-workload-certs" pod "7c59d15b-3c97-44d5-a0b0-df53e4c8f646" (UID: "7c59d15b-3c97-44d5-a0b0-df53e4c8f646"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:49:23.292480 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.292438    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:23.292561 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.292484    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:23.292561 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.292500    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:23.292561 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.292513    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:23.292561 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.292527    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:23.293769 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.293745    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-envoy" pod "7c59d15b-3c97-44d5-a0b0-df53e4c8f646" (UID: "7c59d15b-3c97-44d5-a0b0-df53e4c8f646"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:49:23.294028 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.294014    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-podinfo" pod "7c59d15b-3c97-44d5-a0b0-df53e4c8f646" (UID: "7c59d15b-3c97-44d5-a0b0-df53e4c8f646"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:49:23.294196 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.294167    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-token" pod "7c59d15b-3c97-44d5-a0b0-df53e4c8f646" (UID: "7c59d15b-3c97-44d5-a0b0-df53e4c8f646"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:49:23.294281 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.294192    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-kube-api-access-55t5t" pod "7c59d15b-3c97-44d5-a0b0-df53e4c8f646" (UID: "7c59d15b-3c97-44d5-a0b0-df53e4c8f646"). InnerVolumeSpecName "kube-api-access-55t5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:49:23.393872 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.393839    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55t5t\" (UniqueName: \"kubernetes.io/projected/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-kube-api-access-55t5t\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:23.393872 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.393866    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:23.393872 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.393877    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:23.394102 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.393886    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c59d15b-3c97-44d5-a0b0-df53e4c8f646-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:23.779433 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.779399    4522 generic.go:356] "Generic (PLEG): container finished" podID="7c59d15b-3c97-44d5-a0b0-df53e4c8f646" containerID="a868b47e29abc2ddc88a4a2bde693bc8cc96e6b672f73d7bd96525884117a8e1" exitCode=0
Oct 30 21:49:23.779617 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.779445    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"
Oct 30 21:49:23.779617 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.779486    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz" event={"ID":"7c59d15b-3c97-44d5-a0b0-df53e4c8f646","Type":"ContainerDied","Data":"a868b47e29abc2ddc88a4a2bde693bc8cc96e6b672f73d7bd96525884117a8e1"}
Oct 30 21:49:23.779617 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.779543    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz" event={"ID":"7c59d15b-3c97-44d5-a0b0-df53e4c8f646","Type":"ContainerDied","Data":"88acd80ffa605656443895f52429b7e0d465fda7bf88b475a1de20f382760c71"}
Oct 30 21:49:23.779617 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.779573    4522 scope.go:122] "RemoveContainer" containerID="a868b47e29abc2ddc88a4a2bde693bc8cc96e6b672f73d7bd96525884117a8e1"
Oct 30 21:49:23.790219 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.790195    4522 scope.go:122] "RemoveContainer" containerID="a868b47e29abc2ddc88a4a2bde693bc8cc96e6b672f73d7bd96525884117a8e1"
Oct 30 21:49:23.790501 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:49:23.790477    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a868b47e29abc2ddc88a4a2bde693bc8cc96e6b672f73d7bd96525884117a8e1\": container with ID starting with a868b47e29abc2ddc88a4a2bde693bc8cc96e6b672f73d7bd96525884117a8e1 not found: ID does not exist" containerID="a868b47e29abc2ddc88a4a2bde693bc8cc96e6b672f73d7bd96525884117a8e1"
Oct 30 21:49:23.790558 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.790517    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a868b47e29abc2ddc88a4a2bde693bc8cc96e6b672f73d7bd96525884117a8e1"} err="failed to get container status \"a868b47e29abc2ddc88a4a2bde693bc8cc96e6b672f73d7bd96525884117a8e1\": rpc error: code = NotFound desc = could not find container \"a868b47e29abc2ddc88a4a2bde693bc8cc96e6b672f73d7bd96525884117a8e1\": container with ID starting with a868b47e29abc2ddc88a4a2bde693bc8cc96e6b672f73d7bd96525884117a8e1 not found: ID does not exist"
Oct 30 21:49:23.927623 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.927586    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:23.946466 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.946437    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"]
Oct 30 21:49:23.948516 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:23.948492    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-38b832-openshift-default-849f7b9d8f-vnfsz"]
Oct 30 21:49:24.690296 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:24.690255    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:24.889454 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:24.889418    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:25.190861 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:25.190831    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7c59d15b-3c97-44d5-a0b0-df53e4c8f646" path="/var/lib/kubelet/pods/7c59d15b-3c97-44d5-a0b0-df53e4c8f646/volumes"
Oct 30 21:49:25.487520 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:25.487433    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:25.738596 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:25.738490    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:25.927903 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:25.927871    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:26.341254 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:26.341206    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:29.121240 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:29.121203    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:30.660409 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:30.660374    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:32.993130 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:32.993097    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:33.186331 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:33.186300    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:33.480982 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:33.480955    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:35.693408 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:35.693377    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:37.741376 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:37.741303    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:37.987366 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:49:37.987330    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:49:40.560049 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:40.560008    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:45.263480 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:45.263385    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:49:45.363666 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:45.363624    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:45.971214 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:45.971177    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:46.171997 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:46.171960    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:50.158044 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:50.157997    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:54.837767 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:54.837730    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:55.947352 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:55.947319    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:56.152248 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:56.152219    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:58.944712 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:49:58.944682    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:00.448449 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:00.448411    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:00.767485 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:00.767397    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:01.345050 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:01.345021    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:05.427920 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:05.427884    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:50:05.688151 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:05.688065    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:07.989208 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:50:07.989173    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:50:08.295646 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:08.295572    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:08.546636 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:08.546542    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:08.760959 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:08.760926    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:09.013397 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:09.013366    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:10.608276 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:10.608239    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:13.922242 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:13.922211    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"]
Oct 30 21:50:13.972116 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:13.971796    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"]
Oct 30 21:50:14.144604 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:14.144576    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:15.049561 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:15.049521    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:16.680393 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:16.680354    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:16.965091 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:16.964968    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:17.211677 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:17.211638    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:20.509332 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:20.509298    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:50:20.996298 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:20.996260    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:21.200369 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:21.200295    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:21.393932 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:21.393851    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:21.600604 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:21.600566    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:21.944996 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:21.944949    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:24.552225 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:24.552194    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:24.759785 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:24.759748    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:26.852405 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:26.852367    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:27.052514 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:27.052476    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:27.274344 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:27.274304    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:28.941426 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:28.941390    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn" podUID="a4f4d580-1397-4f98-b232-d803802890f8" containerName="main" containerID="cri-o://98443958deba0d730ba7be6f54ee139ab4710eb9c2805af3f70cdaad28a15403" gracePeriod=45
Oct 30 21:50:28.992356 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:28.992307    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6" podUID="de5762f3-98dd-4c97-a9f7-a65698c9f271" containerName="main" containerID="cri-o://f1bf4fe9b53dd9f7b937624ce101e6798acf3326da959c95cb02e4ac04ff765e" gracePeriod=45
Oct 30 21:50:29.086190 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.086163    4522 generic.go:356] "Generic (PLEG): container finished" podID="a4f4d580-1397-4f98-b232-d803802890f8" containerID="98443958deba0d730ba7be6f54ee139ab4710eb9c2805af3f70cdaad28a15403" exitCode=0
Oct 30 21:50:29.086302 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.086211    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn" event={"ID":"a4f4d580-1397-4f98-b232-d803802890f8","Type":"ContainerDied","Data":"98443958deba0d730ba7be6f54ee139ab4710eb9c2805af3f70cdaad28a15403"}
Oct 30 21:50:29.266018 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.265989    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:50:29.291199 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.291177    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:50:29.448772 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.448734    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-dshm\" (UniqueName: \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-dshm\") pod \"de5762f3-98dd-4c97-a9f7-a65698c9f271\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") "
Oct 30 21:50:29.448946 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.448786    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-model-cache\") pod \"a4f4d580-1397-4f98-b232-d803802890f8\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") "
Oct 30 21:50:29.448946 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.448838    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a4f4d580-1397-4f98-b232-d803802890f8-kube-api-access-2t5zz\" (UniqueName: \"kubernetes.io/projected/a4f4d580-1397-4f98-b232-d803802890f8-kube-api-access-2t5zz\") pod \"a4f4d580-1397-4f98-b232-d803802890f8\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") "
Oct 30 21:50:29.448946 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.448870    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-model-cache\") pod \"de5762f3-98dd-4c97-a9f7-a65698c9f271\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") "
Oct 30 21:50:29.449078 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.448966    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-dshm\") pod \"a4f4d580-1397-4f98-b232-d803802890f8\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") "
Oct 30 21:50:29.449078 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.449004    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-tmp-dir\") pod \"de5762f3-98dd-4c97-a9f7-a65698c9f271\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") "
Oct 30 21:50:29.449078 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.449044    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-home\" (UniqueName: \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-home\") pod \"de5762f3-98dd-4c97-a9f7-a65698c9f271\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") "
Oct 30 21:50:29.449078 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.449070    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a4f4d580-1397-4f98-b232-d803802890f8-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4f4d580-1397-4f98-b232-d803802890f8-tls-certs\") pod \"a4f4d580-1397-4f98-b232-d803802890f8\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") "
Oct 30 21:50:29.449286 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.449131    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-home\" (UniqueName: \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-home\") pod \"a4f4d580-1397-4f98-b232-d803802890f8\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") "
Oct 30 21:50:29.449417 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.449383    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-tmp-dir" pod "de5762f3-98dd-4c97-a9f7-a65698c9f271" (UID: "de5762f3-98dd-4c97-a9f7-a65698c9f271"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:50:29.449417 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.449391    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-model-cache" pod "de5762f3-98dd-4c97-a9f7-a65698c9f271" (UID: "de5762f3-98dd-4c97-a9f7-a65698c9f271"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:50:29.449598 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.449569    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-model-cache" pod "a4f4d580-1397-4f98-b232-d803802890f8" (UID: "a4f4d580-1397-4f98-b232-d803802890f8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:50:29.450208 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.449664    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-home" pod "de5762f3-98dd-4c97-a9f7-a65698c9f271" (UID: "de5762f3-98dd-4c97-a9f7-a65698c9f271"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:50:29.450208 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.449781    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-home" pod "a4f4d580-1397-4f98-b232-d803802890f8" (UID: "a4f4d580-1397-4f98-b232-d803802890f8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:50:29.450208 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.449213    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/de5762f3-98dd-4c97-a9f7-a65698c9f271-tls-certs\" (UniqueName: \"kubernetes.io/secret/de5762f3-98dd-4c97-a9f7-a65698c9f271-tls-certs\") pod \"de5762f3-98dd-4c97-a9f7-a65698c9f271\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") "
Oct 30 21:50:29.450208 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.449868    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/de5762f3-98dd-4c97-a9f7-a65698c9f271-kube-api-access-h4nrn\" (UniqueName: \"kubernetes.io/projected/de5762f3-98dd-4c97-a9f7-a65698c9f271-kube-api-access-h4nrn\") pod \"de5762f3-98dd-4c97-a9f7-a65698c9f271\" (UID: \"de5762f3-98dd-4c97-a9f7-a65698c9f271\") "
Oct 30 21:50:29.450488 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.450264    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-tmp-dir\") pod \"a4f4d580-1397-4f98-b232-d803802890f8\" (UID: \"a4f4d580-1397-4f98-b232-d803802890f8\") "
Oct 30 21:50:29.450721 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.450699    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-tmp-dir" pod "a4f4d580-1397-4f98-b232-d803802890f8" (UID: "a4f4d580-1397-4f98-b232-d803802890f8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:50:29.450982 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.450963    4522 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-tmp-dir\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:29.451048 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.450987    4522 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-home\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:29.451048 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.451000    4522 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-home\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:29.451048 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.451013    4522 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-tmp-dir\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:29.451048 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.451025    4522 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-model-cache\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:29.451048 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.451040    4522 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-model-cache\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:29.452403 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.452376    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4f4d580-1397-4f98-b232-d803802890f8-kube-api-access-2t5zz" pod "a4f4d580-1397-4f98-b232-d803802890f8" (UID: "a4f4d580-1397-4f98-b232-d803802890f8"). InnerVolumeSpecName "kube-api-access-2t5zz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:50:29.452548 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.452420    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4f4d580-1397-4f98-b232-d803802890f8-tls-certs" pod "a4f4d580-1397-4f98-b232-d803802890f8" (UID: "a4f4d580-1397-4f98-b232-d803802890f8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:50:29.452686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.452666    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-dshm" pod "a4f4d580-1397-4f98-b232-d803802890f8" (UID: "a4f4d580-1397-4f98-b232-d803802890f8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:50:29.453256 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.453229    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-dshm" pod "de5762f3-98dd-4c97-a9f7-a65698c9f271" (UID: "de5762f3-98dd-4c97-a9f7-a65698c9f271"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:50:29.453256 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.453227    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de5762f3-98dd-4c97-a9f7-a65698c9f271-kube-api-access-h4nrn" pod "de5762f3-98dd-4c97-a9f7-a65698c9f271" (UID: "de5762f3-98dd-4c97-a9f7-a65698c9f271"). InnerVolumeSpecName "kube-api-access-h4nrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:50:29.453959 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.453939    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de5762f3-98dd-4c97-a9f7-a65698c9f271-tls-certs" pod "de5762f3-98dd-4c97-a9f7-a65698c9f271" (UID: "de5762f3-98dd-4c97-a9f7-a65698c9f271"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:50:29.508327 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.508092    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:29.552025 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.551997    4522 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de5762f3-98dd-4c97-a9f7-a65698c9f271-tls-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:29.552025 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.552023    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4nrn\" (UniqueName: \"kubernetes.io/projected/de5762f3-98dd-4c97-a9f7-a65698c9f271-kube-api-access-h4nrn\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:29.552197 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.552034    4522 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de5762f3-98dd-4c97-a9f7-a65698c9f271-dshm\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:29.552197 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.552043    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2t5zz\" (UniqueName: \"kubernetes.io/projected/a4f4d580-1397-4f98-b232-d803802890f8-kube-api-access-2t5zz\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:29.552197 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.552052    4522 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4f4d580-1397-4f98-b232-d803802890f8-dshm\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:29.552197 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:29.552060    4522 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4f4d580-1397-4f98-b232-d803802890f8-tls-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:30.091808 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:30.091776    4522 generic.go:356] "Generic (PLEG): container finished" podID="de5762f3-98dd-4c97-a9f7-a65698c9f271" containerID="f1bf4fe9b53dd9f7b937624ce101e6798acf3326da959c95cb02e4ac04ff765e" exitCode=0
Oct 30 21:50:30.092267 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:30.091821    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"
Oct 30 21:50:30.092267 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:30.091854    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6" event={"ID":"de5762f3-98dd-4c97-a9f7-a65698c9f271","Type":"ContainerDied","Data":"f1bf4fe9b53dd9f7b937624ce101e6798acf3326da959c95cb02e4ac04ff765e"}
Oct 30 21:50:30.092267 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:30.091897    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6" event={"ID":"de5762f3-98dd-4c97-a9f7-a65698c9f271","Type":"ContainerDied","Data":"184373fdfcbe45399e3d418e7eaceac732d77b5623452ca3b0756766fbfccc79"}
Oct 30 21:50:30.092267 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:30.091914    4522 scope.go:122] "RemoveContainer" containerID="f1bf4fe9b53dd9f7b937624ce101e6798acf3326da959c95cb02e4ac04ff765e"
Oct 30 21:50:30.093330 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:30.093279    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn" event={"ID":"a4f4d580-1397-4f98-b232-d803802890f8","Type":"ContainerDied","Data":"216cdb289d845574d7e57c59d6af289b354e939d4d869696b922f7b8b29f7f85"}
Oct 30 21:50:30.093330 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:30.093290    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"
Oct 30 21:50:30.101897 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:30.101882    4522 scope.go:122] "RemoveContainer" containerID="f1bf4fe9b53dd9f7b937624ce101e6798acf3326da959c95cb02e4ac04ff765e"
Oct 30 21:50:30.102191 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:50:30.102158    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1bf4fe9b53dd9f7b937624ce101e6798acf3326da959c95cb02e4ac04ff765e\": container with ID starting with f1bf4fe9b53dd9f7b937624ce101e6798acf3326da959c95cb02e4ac04ff765e not found: ID does not exist" containerID="f1bf4fe9b53dd9f7b937624ce101e6798acf3326da959c95cb02e4ac04ff765e"
Oct 30 21:50:30.102286 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:30.102203    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1bf4fe9b53dd9f7b937624ce101e6798acf3326da959c95cb02e4ac04ff765e"} err="failed to get container status \"f1bf4fe9b53dd9f7b937624ce101e6798acf3326da959c95cb02e4ac04ff765e\": rpc error: code = NotFound desc = could not find container \"f1bf4fe9b53dd9f7b937624ce101e6798acf3326da959c95cb02e4ac04ff765e\": container with ID starting with f1bf4fe9b53dd9f7b937624ce101e6798acf3326da959c95cb02e4ac04ff765e not found: ID does not exist"
Oct 30 21:50:30.102286 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:30.102227    4522 scope.go:122] "RemoveContainer" containerID="98443958deba0d730ba7be6f54ee139ab4710eb9c2805af3f70cdaad28a15403"
Oct 30 21:50:30.252372 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:30.252310    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"]
Oct 30 21:50:30.301661 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:30.301633    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-be9451/simulator-w0-be9451-kserve-669466fb45-fbmb6"]
Oct 30 21:50:30.409058 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:30.409026    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"]
Oct 30 21:50:30.412797 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:30.412770    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-be9451/distinct-2-w0-be9451-kserve-6b568dc4f6-qr4dn"]
Oct 30 21:50:31.192468 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:31.192427    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a4f4d580-1397-4f98-b232-d803802890f8" path="/var/lib/kubelet/pods/a4f4d580-1397-4f98-b232-d803802890f8/volumes"
Oct 30 21:50:31.192895 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:31.192879    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="de5762f3-98dd-4c97-a9f7-a65698c9f271" path="/var/lib/kubelet/pods/de5762f3-98dd-4c97-a9f7-a65698c9f271/volumes"
Oct 30 21:50:32.150830 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:32.150710    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:36.801597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:36.801541    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:37.001936 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:37.001899    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:37.196348 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:37.196304    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:37.987277 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:50:37.987243    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:50:41.726108 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:41.726072    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:46.447323 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:46.447275    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:50.377005 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:50.376969    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"]
Oct 30 21:50:50.377408 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:50.377207    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv" podUID="b0e0cd0b-3d80-4586-a456-1e04ebf7ce31" containerName="maas-api" containerID="cri-o://8d91dbff86b2d7820a3eb6568a65d174c2720047b3c14f3e1b83eb75ee3837ff" gracePeriod=30
Oct 30 21:50:50.522087 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:50.522025    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:50.655776 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:50.655753    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"
Oct 30 21:50:50.754243 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:50.743915    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-maas-api-tls\") pod \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\" (UID: \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\") "
Oct 30 21:50:50.754243 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:50.744107    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-kube-api-access-vqlr9\" (UniqueName: \"kubernetes.io/projected/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-kube-api-access-vqlr9\") pod \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\" (UID: \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\") "
Oct 30 21:50:50.754243 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:50.744303    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-openshift-service-ca\") pod \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\" (UID: \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\") "
Oct 30 21:50:50.754243 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:50.744388    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-metrics-certs\") pod \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\" (UID: \"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31\") "
Oct 30 21:50:50.754243 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:50.749053    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-openshift-service-ca" pod "b0e0cd0b-3d80-4586-a456-1e04ebf7ce31" (UID: "b0e0cd0b-3d80-4586-a456-1e04ebf7ce31"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:50:50.754243 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:50.749266    4522 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-openshift-service-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:50.754243 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:50.753575    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-metrics-certs" pod "b0e0cd0b-3d80-4586-a456-1e04ebf7ce31" (UID: "b0e0cd0b-3d80-4586-a456-1e04ebf7ce31"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:50:50.755349 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:50.755305    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-maas-api-tls" pod "b0e0cd0b-3d80-4586-a456-1e04ebf7ce31" (UID: "b0e0cd0b-3d80-4586-a456-1e04ebf7ce31"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:50:50.755851 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:50.755827    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-kube-api-access-vqlr9" pod "b0e0cd0b-3d80-4586-a456-1e04ebf7ce31" (UID: "b0e0cd0b-3d80-4586-a456-1e04ebf7ce31"). InnerVolumeSpecName "kube-api-access-vqlr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:50:50.850047 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:50.850011    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-maas-api-tls\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:50.850047 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:50.850045    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqlr9\" (UniqueName: \"kubernetes.io/projected/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-kube-api-access-vqlr9\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:50.850288 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:50.850061    4522 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31-metrics-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:50:51.195313 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:51.195223    4522 generic.go:356] "Generic (PLEG): container finished" podID="b0e0cd0b-3d80-4586-a456-1e04ebf7ce31" containerID="8d91dbff86b2d7820a3eb6568a65d174c2720047b3c14f3e1b83eb75ee3837ff" exitCode=0
Oct 30 21:50:51.195527 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:51.195376    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"
Oct 30 21:50:51.198365 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:51.198346    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:50:51.198507 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:51.198392    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv" event={"ID":"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31","Type":"ContainerDied","Data":"8d91dbff86b2d7820a3eb6568a65d174c2720047b3c14f3e1b83eb75ee3837ff"}
Oct 30 21:50:51.198507 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:51.198427    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv" event={"ID":"b0e0cd0b-3d80-4586-a456-1e04ebf7ce31","Type":"ContainerDied","Data":"ec2fe691eb8d57dc7392ccf475931d80b35a8837e51402bf1645f9d2bed9430d"}
Oct 30 21:50:51.198507 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:51.198470    4522 scope.go:122] "RemoveContainer" containerID="8d91dbff86b2d7820a3eb6568a65d174c2720047b3c14f3e1b83eb75ee3837ff"
Oct 30 21:50:51.207335 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:51.207312    4522 scope.go:122] "RemoveContainer" containerID="8d91dbff86b2d7820a3eb6568a65d174c2720047b3c14f3e1b83eb75ee3837ff"
Oct 30 21:50:51.208002 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:50:51.207983    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d91dbff86b2d7820a3eb6568a65d174c2720047b3c14f3e1b83eb75ee3837ff\": container with ID starting with 8d91dbff86b2d7820a3eb6568a65d174c2720047b3c14f3e1b83eb75ee3837ff not found: ID does not exist" containerID="8d91dbff86b2d7820a3eb6568a65d174c2720047b3c14f3e1b83eb75ee3837ff"
Oct 30 21:50:51.208083 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:51.208010    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d91dbff86b2d7820a3eb6568a65d174c2720047b3c14f3e1b83eb75ee3837ff"} err="failed to get container status \"8d91dbff86b2d7820a3eb6568a65d174c2720047b3c14f3e1b83eb75ee3837ff\": rpc error: code = NotFound desc = could not find container \"8d91dbff86b2d7820a3eb6568a65d174c2720047b3c14f3e1b83eb75ee3837ff\": container with ID starting with 8d91dbff86b2d7820a3eb6568a65d174c2720047b3c14f3e1b83eb75ee3837ff not found: ID does not exist"
Oct 30 21:50:51.358512 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:51.358452    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"]
Oct 30 21:50:51.364742 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:51.364715    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-be9451-59c96c97c5-5cjpv"]
Oct 30 21:50:52.073570 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:52.073541    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:52.379789 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:52.379709    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:52.575686 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:52.575655    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:52.965886 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:52.965855    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:53.157382 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:53.157350    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:53.191635 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:53.191609    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b0e0cd0b-3d80-4586-a456-1e04ebf7ce31" path="/var/lib/kubelet/pods/b0e0cd0b-3d80-4586-a456-1e04ebf7ce31/volumes"
Oct 30 21:50:57.459985 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:57.459949    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:59.958303 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:50:59.958256    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:00.147784 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:00.147750    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:00.313473 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:00.313380    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"]
Oct 30 21:51:00.313638 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:00.313606    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b" podUID="fe7de012-dd07-498f-bc46-cd733c546162" containerName="istio-proxy" containerID="cri-o://9aace06da24012e4d22ef9de25377b8755739b14be6996396538711c179677a7" gracePeriod=30
Oct 30 21:51:00.376728 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:00.376689    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:02.165502 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:02.165445    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:03.818517 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:03.818485    4522 patch_prober.go:29] interesting pod/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:51:03.818879 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:03.818537    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b" podUID="fe7de012-dd07-498f-bc46-cd733c546162" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:51:05.560422 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.560400    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:51:05.689788 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.689760    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-workload-certs\") pod \"fe7de012-dd07-498f-bc46-cd733c546162\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") "
Oct 30 21:51:05.689920 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.689792    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-workload-socket\") pod \"fe7de012-dd07-498f-bc46-cd733c546162\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") "
Oct 30 21:51:05.689920 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.689848    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-istio-data\") pod \"fe7de012-dd07-498f-bc46-cd733c546162\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") "
Oct 30 21:51:05.689920 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.689874    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-istio-envoy\") pod \"fe7de012-dd07-498f-bc46-cd733c546162\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") "
Oct 30 21:51:05.689920 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.689894    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fe7de012-dd07-498f-bc46-cd733c546162-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe7de012-dd07-498f-bc46-cd733c546162-istiod-ca-cert\") pod \"fe7de012-dd07-498f-bc46-cd733c546162\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") "
Oct 30 21:51:05.690132 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.689922    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-credential-socket\") pod \"fe7de012-dd07-498f-bc46-cd733c546162\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") "
Oct 30 21:51:05.690132 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.689961    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fe7de012-dd07-498f-bc46-cd733c546162-istio-token\" (UniqueName: \"kubernetes.io/projected/fe7de012-dd07-498f-bc46-cd733c546162-istio-token\") pod \"fe7de012-dd07-498f-bc46-cd733c546162\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") "
Oct 30 21:51:05.690132 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.690002    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fe7de012-dd07-498f-bc46-cd733c546162-kube-api-access-nlrkm\" (UniqueName: \"kubernetes.io/projected/fe7de012-dd07-498f-bc46-cd733c546162-kube-api-access-nlrkm\") pod \"fe7de012-dd07-498f-bc46-cd733c546162\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") "
Oct 30 21:51:05.690132 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.690034    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-workload-certs" pod "fe7de012-dd07-498f-bc46-cd733c546162" (UID: "fe7de012-dd07-498f-bc46-cd733c546162"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:05.690132 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.690057    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fe7de012-dd07-498f-bc46-cd733c546162-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe7de012-dd07-498f-bc46-cd733c546162-istio-podinfo\") pod \"fe7de012-dd07-498f-bc46-cd733c546162\" (UID: \"fe7de012-dd07-498f-bc46-cd733c546162\") "
Oct 30 21:51:05.690132 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.690127    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-workload-socket" pod "fe7de012-dd07-498f-bc46-cd733c546162" (UID: "fe7de012-dd07-498f-bc46-cd733c546162"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:05.690419 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.690151    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-istio-data" pod "fe7de012-dd07-498f-bc46-cd733c546162" (UID: "fe7de012-dd07-498f-bc46-cd733c546162"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:05.690419 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.690292    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-credential-socket" pod "fe7de012-dd07-498f-bc46-cd733c546162" (UID: "fe7de012-dd07-498f-bc46-cd733c546162"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:05.690546 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.690417    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe7de012-dd07-498f-bc46-cd733c546162-istiod-ca-cert" pod "fe7de012-dd07-498f-bc46-cd733c546162" (UID: "fe7de012-dd07-498f-bc46-cd733c546162"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:51:05.690546 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.690425    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:05.690546 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.690487    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:05.690546 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.690504    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:05.690546 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.690513    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:05.692058 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.692036    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-istio-envoy" pod "fe7de012-dd07-498f-bc46-cd733c546162" (UID: "fe7de012-dd07-498f-bc46-cd733c546162"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:05.692202 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.692186    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fe7de012-dd07-498f-bc46-cd733c546162-istio-podinfo" pod "fe7de012-dd07-498f-bc46-cd733c546162" (UID: "fe7de012-dd07-498f-bc46-cd733c546162"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:51:05.692614 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.692598    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe7de012-dd07-498f-bc46-cd733c546162-istio-token" pod "fe7de012-dd07-498f-bc46-cd733c546162" (UID: "fe7de012-dd07-498f-bc46-cd733c546162"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:05.692673 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.692609    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe7de012-dd07-498f-bc46-cd733c546162-kube-api-access-nlrkm" pod "fe7de012-dd07-498f-bc46-cd733c546162" (UID: "fe7de012-dd07-498f-bc46-cd733c546162"). InnerVolumeSpecName "kube-api-access-nlrkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:05.791334 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.791310    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe7de012-dd07-498f-bc46-cd733c546162-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:05.791334 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.791335    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlrkm\" (UniqueName: \"kubernetes.io/projected/fe7de012-dd07-498f-bc46-cd733c546162-kube-api-access-nlrkm\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:05.791509 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.791345    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe7de012-dd07-498f-bc46-cd733c546162-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:05.791509 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.791354    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe7de012-dd07-498f-bc46-cd733c546162-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:05.791509 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:05.791362    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe7de012-dd07-498f-bc46-cd733c546162-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:06.238059 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.238027    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"]
Oct 30 21:51:06.238257 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.238215    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g" podUID="3e7763dd-12cc-4939-a7bf-f0bfdeef3952" containerName="discovery" containerID="cri-o://18846f93c6ab1adef4ff20b93125efdd9fe9121585df1a4440b1fed699754435" gracePeriod=30
Oct 30 21:51:06.268699 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.268672    4522 generic.go:356] "Generic (PLEG): container finished" podID="fe7de012-dd07-498f-bc46-cd733c546162" containerID="9aace06da24012e4d22ef9de25377b8755739b14be6996396538711c179677a7" exitCode=0
Oct 30 21:51:06.268832 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.268722    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"
Oct 30 21:51:06.268832 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.268744    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b" event={"ID":"fe7de012-dd07-498f-bc46-cd733c546162","Type":"ContainerDied","Data":"9aace06da24012e4d22ef9de25377b8755739b14be6996396538711c179677a7"}
Oct 30 21:51:06.268832 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.268797    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b" event={"ID":"fe7de012-dd07-498f-bc46-cd733c546162","Type":"ContainerDied","Data":"e222a42ea87cd4af4a6c487385aed716d71950b7126ec49ca8ee4c626f222e8d"}
Oct 30 21:51:06.268832 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.268820    4522 scope.go:122] "RemoveContainer" containerID="9aace06da24012e4d22ef9de25377b8755739b14be6996396538711c179677a7"
Oct 30 21:51:06.349624 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.349600    4522 scope.go:122] "RemoveContainer" containerID="9aace06da24012e4d22ef9de25377b8755739b14be6996396538711c179677a7"
Oct 30 21:51:06.349949 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:51:06.349929    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9aace06da24012e4d22ef9de25377b8755739b14be6996396538711c179677a7\": container with ID starting with 9aace06da24012e4d22ef9de25377b8755739b14be6996396538711c179677a7 not found: ID does not exist" containerID="9aace06da24012e4d22ef9de25377b8755739b14be6996396538711c179677a7"
Oct 30 21:51:06.350024 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.349963    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9aace06da24012e4d22ef9de25377b8755739b14be6996396538711c179677a7"} err="failed to get container status \"9aace06da24012e4d22ef9de25377b8755739b14be6996396538711c179677a7\": rpc error: code = NotFound desc = could not find container \"9aace06da24012e4d22ef9de25377b8755739b14be6996396538711c179677a7\": container with ID starting with 9aace06da24012e4d22ef9de25377b8755739b14be6996396538711c179677a7 not found: ID does not exist"
Oct 30 21:51:06.466270 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.466242    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"]
Oct 30 21:51:06.470482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.470446    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-be9451-openshift-default-565fb88cd9-nqg8b"]
Oct 30 21:51:06.486766 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.486742    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:51:06.599336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.599274    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-cacerts\" (UniqueName: \"kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-cacerts\") pod \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") "
Oct 30 21:51:06.599336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.599324    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-csr-ca-configmap\") pod \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") "
Oct 30 21:51:06.599813 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.599363    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-kubeconfig\") pod \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") "
Oct 30 21:51:06.599813 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.599419    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-csr-dns-cert\") pod \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") "
Oct 30 21:51:06.599813 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.599447    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-token\" (UniqueName: \"kubernetes.io/projected/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-token\") pod \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") "
Oct 30 21:51:06.599813 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.599514    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-kube-api-access-9dds5\" (UniqueName: \"kubernetes.io/projected/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-kube-api-access-9dds5\") pod \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") "
Oct 30 21:51:06.599813 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.599554    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-local-certs\") pod \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\" (UID: \"3e7763dd-12cc-4939-a7bf-f0bfdeef3952\") "
Oct 30 21:51:06.599813 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.599779    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-csr-ca-configmap" pod "3e7763dd-12cc-4939-a7bf-f0bfdeef3952" (UID: "3e7763dd-12cc-4939-a7bf-f0bfdeef3952"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:51:06.600146 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.599959    4522 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-csr-ca-configmap\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:06.602076 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.601964    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-cacerts" pod "3e7763dd-12cc-4939-a7bf-f0bfdeef3952" (UID: "3e7763dd-12cc-4939-a7bf-f0bfdeef3952"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:51:06.602076 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.602012    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-kubeconfig" pod "3e7763dd-12cc-4939-a7bf-f0bfdeef3952" (UID: "3e7763dd-12cc-4939-a7bf-f0bfdeef3952"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:51:06.602296 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.602272    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-token" pod "3e7763dd-12cc-4939-a7bf-f0bfdeef3952" (UID: "3e7763dd-12cc-4939-a7bf-f0bfdeef3952"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:06.602563 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.602529    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-local-certs" pod "3e7763dd-12cc-4939-a7bf-f0bfdeef3952" (UID: "3e7763dd-12cc-4939-a7bf-f0bfdeef3952"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:06.602726 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.602702    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-kube-api-access-9dds5" pod "3e7763dd-12cc-4939-a7bf-f0bfdeef3952" (UID: "3e7763dd-12cc-4939-a7bf-f0bfdeef3952"). InnerVolumeSpecName "kube-api-access-9dds5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:06.602860 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.602832    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-csr-dns-cert" pod "3e7763dd-12cc-4939-a7bf-f0bfdeef3952" (UID: "3e7763dd-12cc-4939-a7bf-f0bfdeef3952"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:51:06.701258 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.701224    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dds5\" (UniqueName: \"kubernetes.io/projected/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-kube-api-access-9dds5\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:06.701258 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.701256    4522 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-local-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:06.701427 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.701266    4522 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-cacerts\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:06.701427 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.701275    4522 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-kubeconfig\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:06.701427 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.701283    4522 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-csr-dns-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:06.701427 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.701291    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e7763dd-12cc-4939-a7bf-f0bfdeef3952-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:06.853774 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:06.853682    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:07.190759 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:07.190732    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fe7de012-dd07-498f-bc46-cd733c546162" path="/var/lib/kubelet/pods/fe7de012-dd07-498f-bc46-cd733c546162/volumes"
Oct 30 21:51:07.277737 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:07.277703    4522 generic.go:356] "Generic (PLEG): container finished" podID="3e7763dd-12cc-4939-a7bf-f0bfdeef3952" containerID="18846f93c6ab1adef4ff20b93125efdd9fe9121585df1a4440b1fed699754435" exitCode=0
Oct 30 21:51:07.277916 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:07.277766    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"
Oct 30 21:51:07.277916 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:07.277788    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g" event={"ID":"3e7763dd-12cc-4939-a7bf-f0bfdeef3952","Type":"ContainerDied","Data":"18846f93c6ab1adef4ff20b93125efdd9fe9121585df1a4440b1fed699754435"}
Oct 30 21:51:07.277916 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:07.277840    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g" event={"ID":"3e7763dd-12cc-4939-a7bf-f0bfdeef3952","Type":"ContainerDied","Data":"3b2f658ffa2f27596ec93b577dc333a683ce37d8b1f7c5e985e4cfa0984b856d"}
Oct 30 21:51:07.277916 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:07.277865    4522 scope.go:122] "RemoveContainer" containerID="18846f93c6ab1adef4ff20b93125efdd9fe9121585df1a4440b1fed699754435"
Oct 30 21:51:07.289028 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:07.289010    4522 scope.go:122] "RemoveContainer" containerID="18846f93c6ab1adef4ff20b93125efdd9fe9121585df1a4440b1fed699754435"
Oct 30 21:51:07.289362 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:51:07.289337    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18846f93c6ab1adef4ff20b93125efdd9fe9121585df1a4440b1fed699754435\": container with ID starting with 18846f93c6ab1adef4ff20b93125efdd9fe9121585df1a4440b1fed699754435 not found: ID does not exist" containerID="18846f93c6ab1adef4ff20b93125efdd9fe9121585df1a4440b1fed699754435"
Oct 30 21:51:07.289432 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:07.289374    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18846f93c6ab1adef4ff20b93125efdd9fe9121585df1a4440b1fed699754435"} err="failed to get container status \"18846f93c6ab1adef4ff20b93125efdd9fe9121585df1a4440b1fed699754435\": rpc error: code = NotFound desc = could not find container \"18846f93c6ab1adef4ff20b93125efdd9fe9121585df1a4440b1fed699754435\": container with ID starting with 18846f93c6ab1adef4ff20b93125efdd9fe9121585df1a4440b1fed699754435 not found: ID does not exist"
Oct 30 21:51:07.439155 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:07.439114    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"]
Oct 30 21:51:07.488094 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:07.488021    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mht5g"]
Oct 30 21:51:07.988313 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:51:07.988283    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:51:09.191281 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:09.191249    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3e7763dd-12cc-4939-a7bf-f0bfdeef3952" path="/var/lib/kubelet/pods/3e7763dd-12cc-4939-a7bf-f0bfdeef3952/volumes"
Oct 30 21:51:09.227471 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:09.227407    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:51:11.701855 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:11.701822    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:11.893602 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:11.893567    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:12.168599 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.168565    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7196-a2cb71"]
Oct 30 21:51:12.168976 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.168958    4522 cpu_manager.go:414] "containerMap: removing container" podUID="b2630c3d-f938-4b16-8d1e-ab7959a8243f" containerName="cleanup"
Oct 30 21:51:12.169053 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.168978    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2630c3d-f938-4b16-8d1e-ab7959a8243f" containerName="cleanup"
Oct 30 21:51:12.169053 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.168991    4522 cpu_manager.go:414] "containerMap: removing container" podUID="11373bdd-90b7-49b0-8d30-fcd3aecc457d" containerName="cleanup"
Oct 30 21:51:12.169053 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.168998    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11373bdd-90b7-49b0-8d30-fcd3aecc457d" containerName="cleanup"
Oct 30 21:51:12.169053 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169011    4522 cpu_manager.go:414] "containerMap: removing container" podUID="b0e0cd0b-3d80-4586-a456-1e04ebf7ce31" containerName="maas-api"
Oct 30 21:51:12.169053 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169018    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b0e0cd0b-3d80-4586-a456-1e04ebf7ce31" containerName="maas-api"
Oct 30 21:51:12.169053 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169026    4522 cpu_manager.go:414] "containerMap: removing container" podUID="de5762f3-98dd-4c97-a9f7-a65698c9f271" containerName="main"
Oct 30 21:51:12.169053 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169034    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="de5762f3-98dd-4c97-a9f7-a65698c9f271" containerName="main"
Oct 30 21:51:12.169053 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169054    4522 cpu_manager.go:414] "containerMap: removing container" podUID="a4f4d580-1397-4f98-b232-d803802890f8" containerName="main"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169060    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a4f4d580-1397-4f98-b232-d803802890f8" containerName="main"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169072    4522 cpu_manager.go:414] "containerMap: removing container" podUID="afd04a47-10c4-4ccf-879c-c549765a0c50" containerName="main"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169076    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="afd04a47-10c4-4ccf-879c-c549765a0c50" containerName="main"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169082    4522 cpu_manager.go:414] "containerMap: removing container" podUID="7c59d15b-3c97-44d5-a0b0-df53e4c8f646" containerName="istio-proxy"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169086    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7c59d15b-3c97-44d5-a0b0-df53e4c8f646" containerName="istio-proxy"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169092    4522 cpu_manager.go:414] "containerMap: removing container" podUID="fe7de012-dd07-498f-bc46-cd733c546162" containerName="istio-proxy"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169096    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fe7de012-dd07-498f-bc46-cd733c546162" containerName="istio-proxy"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169109    4522 cpu_manager.go:414] "containerMap: removing container" podUID="f6d41871-eb2d-4e14-90d0-77425f828f41" containerName="istio-proxy"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169113    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f6d41871-eb2d-4e14-90d0-77425f828f41" containerName="istio-proxy"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169120    4522 cpu_manager.go:414] "containerMap: removing container" podUID="3e7763dd-12cc-4939-a7bf-f0bfdeef3952" containerName="discovery"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169126    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3e7763dd-12cc-4939-a7bf-f0bfdeef3952" containerName="discovery"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169141    4522 cpu_manager.go:414] "containerMap: removing container" podUID="bb295ee6-c611-423f-b1aa-f9d2a6ce5d07" containerName="revoke-keys"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169146    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb295ee6-c611-423f-b1aa-f9d2a6ce5d07" containerName="revoke-keys"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169152    4522 cpu_manager.go:414] "containerMap: removing container" podUID="a48fde8b-4dfd-4158-aee9-261aa7c61eda" containerName="cleanup"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169158    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a48fde8b-4dfd-4158-aee9-261aa7c61eda" containerName="cleanup"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169232    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="b0e0cd0b-3d80-4586-a456-1e04ebf7ce31" containerName="maas-api"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169250    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="de5762f3-98dd-4c97-a9f7-a65698c9f271" containerName="main"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169258    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="a4f4d580-1397-4f98-b232-d803802890f8" containerName="main"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169265    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="afd04a47-10c4-4ccf-879c-c549765a0c50" containerName="main"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169271    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="7c59d15b-3c97-44d5-a0b0-df53e4c8f646" containerName="istio-proxy"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169279    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="fe7de012-dd07-498f-bc46-cd733c546162" containerName="istio-proxy"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169289    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2630c3d-f938-4b16-8d1e-ab7959a8243f" containerName="cleanup"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169297    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="f6d41871-eb2d-4e14-90d0-77425f828f41" containerName="istio-proxy"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169306    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="3e7763dd-12cc-4939-a7bf-f0bfdeef3952" containerName="discovery"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169313    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="1f50a977-8e9c-4610-84be-789a2e4fdb03" containerName="cleanup"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169322    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="bb295ee6-c611-423f-b1aa-f9d2a6ce5d07" containerName="revoke-keys"
Oct 30 21:51:12.169371 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.169328    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="a48fde8b-4dfd-4158-aee9-261aa7c61eda" containerName="cleanup"
Oct 30 21:51:12.172507 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.172488    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7196-a2cb71"
Oct 30 21:51:12.227047 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.226997    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pmshp\""
Oct 30 21:51:12.229093 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.229070    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7196-a2cb71"]
Oct 30 21:51:12.349892 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.349857    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptzcj\" (UniqueName: \"kubernetes.io/projected/2867e1d0-1d95-45f5-84fb-58477298f4a0-kube-api-access-ptzcj\") pod \"test-curl-7196-a2cb71\" (UID: \"2867e1d0-1d95-45f5-84fb-58477298f4a0\") " pod="opendatahub/test-curl-7196-a2cb71"
Oct 30 21:51:12.450925 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.450843    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzcj\" (UniqueName: \"kubernetes.io/projected/2867e1d0-1d95-45f5-84fb-58477298f4a0-kube-api-access-ptzcj\") pod \"test-curl-7196-a2cb71\" (UID: \"2867e1d0-1d95-45f5-84fb-58477298f4a0\") " pod="opendatahub/test-curl-7196-a2cb71"
Oct 30 21:51:12.506617 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.506593    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptzcj\" (UniqueName: \"kubernetes.io/projected/2867e1d0-1d95-45f5-84fb-58477298f4a0-kube-api-access-ptzcj\") pod \"test-curl-7196-a2cb71\" (UID: \"2867e1d0-1d95-45f5-84fb-58477298f4a0\") " pod="opendatahub/test-curl-7196-a2cb71"
Oct 30 21:51:12.785363 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:12.785291    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7196-a2cb71"
Oct 30 21:51:13.151119 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:13.151050    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7196-a2cb71"]
Oct 30 21:51:13.154175 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:51:13.154149    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2867e1d0_1d95_45f5_84fb_58477298f4a0.slice/crio-1a7cce4ff4c1be4986915316123920319629c4d418d0cd1251bdc5dd913496c4 WatchSource:0}: Error finding container 1a7cce4ff4c1be4986915316123920319629c4d418d0cd1251bdc5dd913496c4: Status 404 returned error can't find the container with id 1a7cce4ff4c1be4986915316123920319629c4d418d0cd1251bdc5dd913496c4
Oct 30 21:51:13.156045 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:13.156028    4522 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:51:13.305481 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:13.305436    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7196-a2cb71" event={"ID":"2867e1d0-1d95-45f5-84fb-58477298f4a0","Type":"ContainerStarted","Data":"1a7cce4ff4c1be4986915316123920319629c4d418d0cd1251bdc5dd913496c4"}
Oct 30 21:51:16.327151 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:16.327113    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7196-a2cb71" event={"ID":"2867e1d0-1d95-45f5-84fb-58477298f4a0","Type":"ContainerStarted","Data":"58521b33ff9f74e1b7d22cb5996c875a6cc97152afdc4806882822027b247623"}
Oct 30 21:51:16.439612 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:16.439530    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7196-a2cb71" podStartSLOduration=1.893073243 podStartE2EDuration="4.439511684s" totalImagesPullingTime="2.546438441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:51:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:51:16.437496651 +0000 UTC m=+2385.382442023" watchObservedRunningTime="2026-10-30 21:51:16.439511684 +0000 UTC m=+2385.384457044"
Oct 30 21:51:16.449712 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:16.449678    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:17.012050 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:17.012017    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"]
Oct 30 21:51:17.012255 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:17.012220    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj" podUID="174c4004-d6e9-46c8-a05a-ec295d4eff67" containerName="istio-proxy" containerID="cri-o://0278ffddfa2069ed2536bdd8bd7310b6ea3923f0c8bbb982be93e505525a1d33" gracePeriod=30
Oct 30 21:51:20.181349 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:20.181315    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-cl7nj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:51:20.181747 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:20.181375    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj" podUID="174c4004-d6e9-46c8-a05a-ec295d4eff67" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:51:21.173475 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:21.173426    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:22.256006 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.255984    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:51:22.357432 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.357369    4522 generic.go:356] "Generic (PLEG): container finished" podID="174c4004-d6e9-46c8-a05a-ec295d4eff67" containerID="0278ffddfa2069ed2536bdd8bd7310b6ea3923f0c8bbb982be93e505525a1d33" exitCode=0
Oct 30 21:51:22.357432 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.357425    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"
Oct 30 21:51:22.357634 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.357429    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj" event={"ID":"174c4004-d6e9-46c8-a05a-ec295d4eff67","Type":"ContainerDied","Data":"0278ffddfa2069ed2536bdd8bd7310b6ea3923f0c8bbb982be93e505525a1d33"}
Oct 30 21:51:22.357634 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.357501    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj" event={"ID":"174c4004-d6e9-46c8-a05a-ec295d4eff67","Type":"ContainerDied","Data":"30e8fc5d7d9b08808d6a10b9356e7c33ad96215a57ae462ce6dc4bebb964e43c"}
Oct 30 21:51:22.357634 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.357534    4522 scope.go:122] "RemoveContainer" containerID="0278ffddfa2069ed2536bdd8bd7310b6ea3923f0c8bbb982be93e505525a1d33"
Oct 30 21:51:22.366533 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.366514    4522 scope.go:122] "RemoveContainer" containerID="0278ffddfa2069ed2536bdd8bd7310b6ea3923f0c8bbb982be93e505525a1d33"
Oct 30 21:51:22.366801 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:51:22.366778    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0278ffddfa2069ed2536bdd8bd7310b6ea3923f0c8bbb982be93e505525a1d33\": container with ID starting with 0278ffddfa2069ed2536bdd8bd7310b6ea3923f0c8bbb982be93e505525a1d33 not found: ID does not exist" containerID="0278ffddfa2069ed2536bdd8bd7310b6ea3923f0c8bbb982be93e505525a1d33"
Oct 30 21:51:22.366846 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.366810    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0278ffddfa2069ed2536bdd8bd7310b6ea3923f0c8bbb982be93e505525a1d33"} err="failed to get container status \"0278ffddfa2069ed2536bdd8bd7310b6ea3923f0c8bbb982be93e505525a1d33\": rpc error: code = NotFound desc = could not find container \"0278ffddfa2069ed2536bdd8bd7310b6ea3923f0c8bbb982be93e505525a1d33\": container with ID starting with 0278ffddfa2069ed2536bdd8bd7310b6ea3923f0c8bbb982be93e505525a1d33 not found: ID does not exist"
Oct 30 21:51:22.436365 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.436333    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-token\" (UniqueName: \"kubernetes.io/projected/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-token\") pod \"174c4004-d6e9-46c8-a05a-ec295d4eff67\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") "
Oct 30 21:51:22.436563 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.436373    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-podinfo\") pod \"174c4004-d6e9-46c8-a05a-ec295d4eff67\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") "
Oct 30 21:51:22.436563 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.436428    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-data\") pod \"174c4004-d6e9-46c8-a05a-ec295d4eff67\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") "
Oct 30 21:51:22.436563 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.436455    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-credential-socket\") pod \"174c4004-d6e9-46c8-a05a-ec295d4eff67\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") "
Oct 30 21:51:22.436563 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.436508    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/174c4004-d6e9-46c8-a05a-ec295d4eff67-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/174c4004-d6e9-46c8-a05a-ec295d4eff67-istiod-ca-cert\") pod \"174c4004-d6e9-46c8-a05a-ec295d4eff67\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") "
Oct 30 21:51:22.436790 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.436593    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-envoy\") pod \"174c4004-d6e9-46c8-a05a-ec295d4eff67\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") "
Oct 30 21:51:22.436790 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.436642    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-workload-socket\") pod \"174c4004-d6e9-46c8-a05a-ec295d4eff67\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") "
Oct 30 21:51:22.436790 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.436683    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-workload-certs\") pod \"174c4004-d6e9-46c8-a05a-ec295d4eff67\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") "
Oct 30 21:51:22.436790 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.436707    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/174c4004-d6e9-46c8-a05a-ec295d4eff67-kube-api-access-kdnzd\" (UniqueName: \"kubernetes.io/projected/174c4004-d6e9-46c8-a05a-ec295d4eff67-kube-api-access-kdnzd\") pod \"174c4004-d6e9-46c8-a05a-ec295d4eff67\" (UID: \"174c4004-d6e9-46c8-a05a-ec295d4eff67\") "
Oct 30 21:51:22.436790 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.436744    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-data" pod "174c4004-d6e9-46c8-a05a-ec295d4eff67" (UID: "174c4004-d6e9-46c8-a05a-ec295d4eff67"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:22.437051 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.436825    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-credential-socket" pod "174c4004-d6e9-46c8-a05a-ec295d4eff67" (UID: "174c4004-d6e9-46c8-a05a-ec295d4eff67"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:22.437051 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.436972    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-workload-socket" pod "174c4004-d6e9-46c8-a05a-ec295d4eff67" (UID: "174c4004-d6e9-46c8-a05a-ec295d4eff67"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:22.437051 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.437022    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/174c4004-d6e9-46c8-a05a-ec295d4eff67-istiod-ca-cert" pod "174c4004-d6e9-46c8-a05a-ec295d4eff67" (UID: "174c4004-d6e9-46c8-a05a-ec295d4eff67"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:51:22.437224 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.437169    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:22.437224 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.437180    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-workload-certs" pod "174c4004-d6e9-46c8-a05a-ec295d4eff67" (UID: "174c4004-d6e9-46c8-a05a-ec295d4eff67"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:22.437224 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.437191    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:22.437224 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.437221    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/174c4004-d6e9-46c8-a05a-ec295d4eff67-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:22.437439 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.437237    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:22.438881 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.438856    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-envoy" pod "174c4004-d6e9-46c8-a05a-ec295d4eff67" (UID: "174c4004-d6e9-46c8-a05a-ec295d4eff67"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:22.438981 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.438897    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-podinfo" pod "174c4004-d6e9-46c8-a05a-ec295d4eff67" (UID: "174c4004-d6e9-46c8-a05a-ec295d4eff67"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:51:22.439048 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.439029    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-token" pod "174c4004-d6e9-46c8-a05a-ec295d4eff67" (UID: "174c4004-d6e9-46c8-a05a-ec295d4eff67"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:22.439151 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.439132    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/174c4004-d6e9-46c8-a05a-ec295d4eff67-kube-api-access-kdnzd" pod "174c4004-d6e9-46c8-a05a-ec295d4eff67" (UID: "174c4004-d6e9-46c8-a05a-ec295d4eff67"). InnerVolumeSpecName "kube-api-access-kdnzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:22.537903 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.537878    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:22.537903 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.537902    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/174c4004-d6e9-46c8-a05a-ec295d4eff67-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:22.538063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.537912    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdnzd\" (UniqueName: \"kubernetes.io/projected/174c4004-d6e9-46c8-a05a-ec295d4eff67-kube-api-access-kdnzd\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:22.538063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.537923    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:22.538063 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.537932    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/174c4004-d6e9-46c8-a05a-ec295d4eff67-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:22.775990 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.775960    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"]
Oct 30 21:51:22.825077 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:22.825048    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-cl7nj"]
Oct 30 21:51:23.191939 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:23.191910    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="174c4004-d6e9-46c8-a05a-ec295d4eff67" path="/var/lib/kubelet/pods/174c4004-d6e9-46c8-a05a-ec295d4eff67/volumes"
Oct 30 21:51:25.856429 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:25.856394    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:29.811995 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:29.811966    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:30.543294 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:30.543261    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:31.821010 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:31.820978    4522 scope.go:122] "RemoveContainer" containerID="b9dff4d51714cda183f087ddc8ab5b099e71a7cf725f68ddaee1f6b2bd0d9c60"
Oct 30 21:51:31.852422 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:31.852395    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:51:31.855942 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:31.855922    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:51:35.235447 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:35.235414    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:37.986953 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:51:37.986911    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:51:39.907763 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:39.907725    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:44.549955 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:44.549896    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:49.306582 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:49.306544    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:53.914786 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:53.914750    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:58.015115 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:58.015082    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:58.207753 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:58.207727    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:58.561940 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:51:58.561902    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:03.226773 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:03.226724    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:04.048318 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:04.048284    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k"]
Oct 30 21:52:04.096729 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:04.096700    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f39f471c-c669k"]
Oct 30 21:52:05.190412 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:05.190379    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bb295ee6-c611-423f-b1aa-f9d2a6ce5d07" path="/var/lib/kubelet/pods/bb295ee6-c611-423f-b1aa-f9d2a6ce5d07/volumes"
Oct 30 21:52:05.994636 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:05.994606    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:06.751513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:06.751485    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:06.948547 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:06.948511    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:07.877396 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:07.877361    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:07.987892 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:52:07.987851    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:52:12.645098 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:12.645067    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:17.311988 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:17.311959    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7196-a2cb71"]
Oct 30 21:52:17.312397 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:17.312109    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7196-a2cb71" podUID="2867e1d0-1d95-45f5-84fb-58477298f4a0" containerName="test-curl-7196-a2cb71" containerID="cri-o://58521b33ff9f74e1b7d22cb5996c875a6cc97152afdc4806882822027b247623" gracePeriod=2
Oct 30 21:52:17.315507 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:17.315481    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7196-a2cb71"]
Oct 30 21:52:17.345255 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:17.345216    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:17.362570 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:52:17.362539    4522 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7196-a2cb71\" is forbidden: User \"system:node:ip-10-0-142-237.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-237.us-west-1.compute.internal' and this object" podUID="2867e1d0-1d95-45f5-84fb-58477298f4a0" pod="opendatahub/test-curl-7196-a2cb71"
Oct 30 21:52:19.540853 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:19.540828    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7196-a2cb71"
Oct 30 21:52:19.605706 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:19.605641    4522 generic.go:356] "Generic (PLEG): container finished" podID="2867e1d0-1d95-45f5-84fb-58477298f4a0" containerID="58521b33ff9f74e1b7d22cb5996c875a6cc97152afdc4806882822027b247623" exitCode=137
Oct 30 21:52:19.605706 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:19.605680    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7196-a2cb71"
Oct 30 21:52:19.605856 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:19.605738    4522 scope.go:122] "RemoveContainer" containerID="58521b33ff9f74e1b7d22cb5996c875a6cc97152afdc4806882822027b247623"
Oct 30 21:52:19.612141 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:19.612117    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2867e1d0-1d95-45f5-84fb-58477298f4a0-kube-api-access-ptzcj\" (UniqueName: \"kubernetes.io/projected/2867e1d0-1d95-45f5-84fb-58477298f4a0-kube-api-access-ptzcj\") pod \"2867e1d0-1d95-45f5-84fb-58477298f4a0\" (UID: \"2867e1d0-1d95-45f5-84fb-58477298f4a0\") "
Oct 30 21:52:19.613268 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:19.613251    4522 scope.go:122] "RemoveContainer" containerID="58521b33ff9f74e1b7d22cb5996c875a6cc97152afdc4806882822027b247623"
Oct 30 21:52:19.613576 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:52:19.613557    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58521b33ff9f74e1b7d22cb5996c875a6cc97152afdc4806882822027b247623\": container with ID starting with 58521b33ff9f74e1b7d22cb5996c875a6cc97152afdc4806882822027b247623 not found: ID does not exist" containerID="58521b33ff9f74e1b7d22cb5996c875a6cc97152afdc4806882822027b247623"
Oct 30 21:52:19.613629 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:19.613585    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58521b33ff9f74e1b7d22cb5996c875a6cc97152afdc4806882822027b247623"} err="failed to get container status \"58521b33ff9f74e1b7d22cb5996c875a6cc97152afdc4806882822027b247623\": rpc error: code = NotFound desc = could not find container \"58521b33ff9f74e1b7d22cb5996c875a6cc97152afdc4806882822027b247623\": container with ID starting with 58521b33ff9f74e1b7d22cb5996c875a6cc97152afdc4806882822027b247623 not found: ID does not exist"
Oct 30 21:52:19.614009 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:19.613985    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2867e1d0-1d95-45f5-84fb-58477298f4a0-kube-api-access-ptzcj" pod "2867e1d0-1d95-45f5-84fb-58477298f4a0" (UID: "2867e1d0-1d95-45f5-84fb-58477298f4a0"). InnerVolumeSpecName "kube-api-access-ptzcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:52:19.713642 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:19.713612    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptzcj\" (UniqueName: \"kubernetes.io/projected/2867e1d0-1d95-45f5-84fb-58477298f4a0-kube-api-access-ptzcj\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:52:19.963993 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:52:19.963958    4522 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7196-a2cb71\" is forbidden: User \"system:node:ip-10-0-142-237.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-237.us-west-1.compute.internal' and this object" podUID="2867e1d0-1d95-45f5-84fb-58477298f4a0" pod="opendatahub/test-curl-7196-a2cb71"
Oct 30 21:52:21.191609 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:21.191572    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2867e1d0-1d95-45f5-84fb-58477298f4a0" path="/var/lib/kubelet/pods/2867e1d0-1d95-45f5-84fb-58477298f4a0/volumes"
Oct 30 21:52:21.237982 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:52:21.237951    4522 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7196-a2cb71\" is forbidden: User \"system:node:ip-10-0-142-237.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-237.us-west-1.compute.internal' and this object" podUID="2867e1d0-1d95-45f5-84fb-58477298f4a0" pod="opendatahub/test-curl-7196-a2cb71"
Oct 30 21:52:22.489530 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:22.489497    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:27.341263 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:27.341185    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:30.143251 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:30.143214    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:30.331518 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:30.331485    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:32.052366 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:32.052330    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:36.218512 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:36.218484    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:37.668113 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:37.668079    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:37.952834 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:37.952749    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:37.986850 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:52:37.986818    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:52:38.142578 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:38.142550    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:38.687597 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:38.687566    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:42.119040 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:42.119010    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:52:42.929049 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:42.928990    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:43.710195 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:43.710109    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:47.648546 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:47.648508    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:52.346228 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:52.346195    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:57.074927 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:52:57.074890    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:01.762588 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:01.762553    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:02.744221 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:02.744183    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:06.455182 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:06.455143    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:07.987534 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:53:07.987502    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:53:11.245548 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:11.245514    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:15.953392 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:15.953357    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:20.361536 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:20.361493    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:20.649079 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:20.648975    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:21.458630 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:21.458602    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:25.444737 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:25.444705    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:27.621386 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:27.621352    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:27.815225 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:27.815195    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:28.006540 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:28.006504    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:30.282290 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:30.282257    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:30.488042 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:30.488005    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:31.876778 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:31.876749    4522 scope.go:122] "RemoveContainer" containerID="c0295a1a37d424c3260de5a6bbdf785896e9434d1fed5d413dd142944734d539"
Oct 30 21:53:35.447725 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:35.447693    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:37.987329 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:53:37.987287    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:53:40.145933 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:40.145877    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:40.552915 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:40.552874    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:40.784450 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:40.784420    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:44.852291 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:44.852196    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:49.564045 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:49.564015    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:53.721939 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:53.721908    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:55.218956 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:55.218923    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:55.455681 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:55.455645    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:55.646655 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:55.646581    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:56.136610 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:56.136576    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:57.252708 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:53:57.252669    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:54:00.448574 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:00.448540    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:02.615946 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:02.615911    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:02.824007 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:02.823973    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:03.040962 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:03.040933    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:05.457504 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:05.457454    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:07.987468 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:54:07.987416    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:54:10.442577 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:10.442539    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:15.172392 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:15.172309    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:15.611004 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:15.610914    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:15.811743 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:15.811710    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:19.853934 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:19.853901    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:23.995181 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:23.995147    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:25.483557 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:25.483523    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:25.772183 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:25.772105    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:25.974669 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:25.974636    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:26.405468 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:26.405422    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:29.411051 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:29.411017    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:54:30.747841 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:30.747795    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:30.940437 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:30.940404    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:33.061784 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:33.061743    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:33.247991 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:33.247958    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:33.459709 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:33.459677    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:33.852607 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:33.852529    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:35.848248 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:35.848211    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:37.987800 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:54:37.987760    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:54:38.781216 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:38.781181    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"]
Oct 30 21:54:38.913051 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:38.913022    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:40.836604 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:40.836566    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:46.209475 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:46.209427    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:46.430431 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:46.430397    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:50.156178 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:50.156145    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:54:53.799904 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:53.799864    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj" podUID="5870207c-906d-47f0-bb38-ca1020a0dccb" containerName="main" containerID="cri-o://db7e24e64261b3041d24b3fb70754bef643c65140367c17e37d934b0feface84" gracePeriod=45
Oct 30 21:54:53.862663 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:53.862634    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj" podUID="5870207c-906d-47f0-bb38-ca1020a0dccb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": dial tcp 10.133.0.43:8000: connect: connection refused"
Oct 30 21:54:54.037385 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.037361    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:54:54.174556 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.174521    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-dshm\" (UniqueName: \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-dshm\") pod \"5870207c-906d-47f0-bb38-ca1020a0dccb\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") "
Oct 30 21:54:54.174718 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.174616    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-home\" (UniqueName: \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-home\") pod \"5870207c-906d-47f0-bb38-ca1020a0dccb\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") "
Oct 30 21:54:54.174718 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.174651    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-model-cache\") pod \"5870207c-906d-47f0-bb38-ca1020a0dccb\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") "
Oct 30 21:54:54.174718 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.174686    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5870207c-906d-47f0-bb38-ca1020a0dccb-kube-api-access-sk25c\" (UniqueName: \"kubernetes.io/projected/5870207c-906d-47f0-bb38-ca1020a0dccb-kube-api-access-sk25c\") pod \"5870207c-906d-47f0-bb38-ca1020a0dccb\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") "
Oct 30 21:54:54.174890 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.174752    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-tmp-dir\") pod \"5870207c-906d-47f0-bb38-ca1020a0dccb\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") "
Oct 30 21:54:54.174890 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.174799    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5870207c-906d-47f0-bb38-ca1020a0dccb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5870207c-906d-47f0-bb38-ca1020a0dccb-tls-certs\") pod \"5870207c-906d-47f0-bb38-ca1020a0dccb\" (UID: \"5870207c-906d-47f0-bb38-ca1020a0dccb\") "
Oct 30 21:54:54.174890 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.174869    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-home" pod "5870207c-906d-47f0-bb38-ca1020a0dccb" (UID: "5870207c-906d-47f0-bb38-ca1020a0dccb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:54.175224 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.175111    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-tmp-dir" pod "5870207c-906d-47f0-bb38-ca1020a0dccb" (UID: "5870207c-906d-47f0-bb38-ca1020a0dccb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:54.175224 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.175185    4522 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-home\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:54.175224 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.175200    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-model-cache" pod "5870207c-906d-47f0-bb38-ca1020a0dccb" (UID: "5870207c-906d-47f0-bb38-ca1020a0dccb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:54.176775 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.176729    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-dshm" pod "5870207c-906d-47f0-bb38-ca1020a0dccb" (UID: "5870207c-906d-47f0-bb38-ca1020a0dccb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:54.176863 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.176829    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5870207c-906d-47f0-bb38-ca1020a0dccb-tls-certs" pod "5870207c-906d-47f0-bb38-ca1020a0dccb" (UID: "5870207c-906d-47f0-bb38-ca1020a0dccb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:54:54.177150 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.177128    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5870207c-906d-47f0-bb38-ca1020a0dccb-kube-api-access-sk25c" pod "5870207c-906d-47f0-bb38-ca1020a0dccb" (UID: "5870207c-906d-47f0-bb38-ca1020a0dccb"). InnerVolumeSpecName "kube-api-access-sk25c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:54:54.276109 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.276073    4522 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-model-cache\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:54.276109 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.276109    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sk25c\" (UniqueName: \"kubernetes.io/projected/5870207c-906d-47f0-bb38-ca1020a0dccb-kube-api-access-sk25c\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:54.276401 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.276126    4522 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-tmp-dir\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:54.276401 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.276140    4522 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5870207c-906d-47f0-bb38-ca1020a0dccb-tls-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:54.276401 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.276153    4522 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5870207c-906d-47f0-bb38-ca1020a0dccb-dshm\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:54.277436 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.277405    4522 generic.go:356] "Generic (PLEG): container finished" podID="5870207c-906d-47f0-bb38-ca1020a0dccb" containerID="db7e24e64261b3041d24b3fb70754bef643c65140367c17e37d934b0feface84" exitCode=0
Oct 30 21:54:54.277624 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.277452    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"
Oct 30 21:54:54.277624 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.277499    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj" event={"ID":"5870207c-906d-47f0-bb38-ca1020a0dccb","Type":"ContainerDied","Data":"db7e24e64261b3041d24b3fb70754bef643c65140367c17e37d934b0feface84"}
Oct 30 21:54:54.277624 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.277554    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj" event={"ID":"5870207c-906d-47f0-bb38-ca1020a0dccb","Type":"ContainerDied","Data":"6de4f00b76faba18524643abcccb1fc2f7d1cdc7f56ab93d0a5d6d996b8a4e74"}
Oct 30 21:54:54.277624 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.277574    4522 scope.go:122] "RemoveContainer" containerID="db7e24e64261b3041d24b3fb70754bef643c65140367c17e37d934b0feface84"
Oct 30 21:54:54.287766 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.287750    4522 scope.go:122] "RemoveContainer" containerID="db7e24e64261b3041d24b3fb70754bef643c65140367c17e37d934b0feface84"
Oct 30 21:54:54.288078 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:54:54.288058    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db7e24e64261b3041d24b3fb70754bef643c65140367c17e37d934b0feface84\": container with ID starting with db7e24e64261b3041d24b3fb70754bef643c65140367c17e37d934b0feface84 not found: ID does not exist" containerID="db7e24e64261b3041d24b3fb70754bef643c65140367c17e37d934b0feface84"
Oct 30 21:54:54.288176 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.288083    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db7e24e64261b3041d24b3fb70754bef643c65140367c17e37d934b0feface84"} err="failed to get container status \"db7e24e64261b3041d24b3fb70754bef643c65140367c17e37d934b0feface84\": rpc error: code = NotFound desc = could not find container \"db7e24e64261b3041d24b3fb70754bef643c65140367c17e37d934b0feface84\": container with ID starting with db7e24e64261b3041d24b3fb70754bef643c65140367c17e37d934b0feface84 not found: ID does not exist"
Oct 30 21:54:54.443450 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.443370    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"]
Oct 30 21:54:54.444637 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:54.444616    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-8ce31a/premium-w1-8ce31a-kserve-797cddc464-bh6sj"]
Oct 30 21:54:55.190811 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:55.190778    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5870207c-906d-47f0-bb38-ca1020a0dccb" path="/var/lib/kubelet/pods/5870207c-906d-47f0-bb38-ca1020a0dccb/volumes"
Oct 30 21:54:59.535023 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:59.534991    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"]
Oct 30 21:54:59.535414 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:59.535176    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq" podUID="53a26546-ac0e-47d2-b1da-c1d08799ce83" containerName="maas-api" containerID="cri-o://c4947de6f9bdfab93f31d052606f24fe7728d0a8d243a7cfb1a3b494881b63f5" gracePeriod=30
Oct 30 21:54:59.687360 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:59.687332    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:59.786724 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:59.786675    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"
Oct 30 21:54:59.926039 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:59.926011    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/53a26546-ac0e-47d2-b1da-c1d08799ce83-metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a26546-ac0e-47d2-b1da-c1d08799ce83-metrics-certs\") pod \"53a26546-ac0e-47d2-b1da-c1d08799ce83\" (UID: \"53a26546-ac0e-47d2-b1da-c1d08799ce83\") "
Oct 30 21:54:59.926235 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:59.926071    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/53a26546-ac0e-47d2-b1da-c1d08799ce83-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53a26546-ac0e-47d2-b1da-c1d08799ce83-openshift-service-ca\") pod \"53a26546-ac0e-47d2-b1da-c1d08799ce83\" (UID: \"53a26546-ac0e-47d2-b1da-c1d08799ce83\") "
Oct 30 21:54:59.926235 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:59.926095    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/53a26546-ac0e-47d2-b1da-c1d08799ce83-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53a26546-ac0e-47d2-b1da-c1d08799ce83-maas-api-tls\") pod \"53a26546-ac0e-47d2-b1da-c1d08799ce83\" (UID: \"53a26546-ac0e-47d2-b1da-c1d08799ce83\") "
Oct 30 21:54:59.926235 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:59.926128    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/53a26546-ac0e-47d2-b1da-c1d08799ce83-kube-api-access-dpwkp\" (UniqueName: \"kubernetes.io/projected/53a26546-ac0e-47d2-b1da-c1d08799ce83-kube-api-access-dpwkp\") pod \"53a26546-ac0e-47d2-b1da-c1d08799ce83\" (UID: \"53a26546-ac0e-47d2-b1da-c1d08799ce83\") "
Oct 30 21:54:59.926677 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:59.926429    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53a26546-ac0e-47d2-b1da-c1d08799ce83-openshift-service-ca" pod "53a26546-ac0e-47d2-b1da-c1d08799ce83" (UID: "53a26546-ac0e-47d2-b1da-c1d08799ce83"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:54:59.928150 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:59.928130    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53a26546-ac0e-47d2-b1da-c1d08799ce83-metrics-certs" pod "53a26546-ac0e-47d2-b1da-c1d08799ce83" (UID: "53a26546-ac0e-47d2-b1da-c1d08799ce83"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:54:59.928631 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:59.928599    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53a26546-ac0e-47d2-b1da-c1d08799ce83-maas-api-tls" pod "53a26546-ac0e-47d2-b1da-c1d08799ce83" (UID: "53a26546-ac0e-47d2-b1da-c1d08799ce83"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:54:59.928721 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:54:59.928636    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53a26546-ac0e-47d2-b1da-c1d08799ce83-kube-api-access-dpwkp" pod "53a26546-ac0e-47d2-b1da-c1d08799ce83" (UID: "53a26546-ac0e-47d2-b1da-c1d08799ce83"). InnerVolumeSpecName "kube-api-access-dpwkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:55:00.027627 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:00.027586    4522 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a26546-ac0e-47d2-b1da-c1d08799ce83-metrics-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:00.027627 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:00.027623    4522 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53a26546-ac0e-47d2-b1da-c1d08799ce83-openshift-service-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:00.027627 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:00.027632    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53a26546-ac0e-47d2-b1da-c1d08799ce83-maas-api-tls\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:00.027627 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:00.027641    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpwkp\" (UniqueName: \"kubernetes.io/projected/53a26546-ac0e-47d2-b1da-c1d08799ce83-kube-api-access-dpwkp\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:00.302896 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:00.302864    4522 generic.go:356] "Generic (PLEG): container finished" podID="53a26546-ac0e-47d2-b1da-c1d08799ce83" containerID="c4947de6f9bdfab93f31d052606f24fe7728d0a8d243a7cfb1a3b494881b63f5" exitCode=0
Oct 30 21:55:00.303085 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:00.302906    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"
Oct 30 21:55:00.303085 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:00.302911    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq" event={"ID":"53a26546-ac0e-47d2-b1da-c1d08799ce83","Type":"ContainerDied","Data":"c4947de6f9bdfab93f31d052606f24fe7728d0a8d243a7cfb1a3b494881b63f5"}
Oct 30 21:55:00.303085 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:00.302966    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq" event={"ID":"53a26546-ac0e-47d2-b1da-c1d08799ce83","Type":"ContainerDied","Data":"c757b5efb92bb4cbbb8fcd7a2aaf896a98f056d6e3fcefc44984c6b762ebab9d"}
Oct 30 21:55:00.303085 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:00.302994    4522 scope.go:122] "RemoveContainer" containerID="c4947de6f9bdfab93f31d052606f24fe7728d0a8d243a7cfb1a3b494881b63f5"
Oct 30 21:55:00.312093 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:00.312078    4522 scope.go:122] "RemoveContainer" containerID="c4947de6f9bdfab93f31d052606f24fe7728d0a8d243a7cfb1a3b494881b63f5"
Oct 30 21:55:00.312366 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:55:00.312344    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4947de6f9bdfab93f31d052606f24fe7728d0a8d243a7cfb1a3b494881b63f5\": container with ID starting with c4947de6f9bdfab93f31d052606f24fe7728d0a8d243a7cfb1a3b494881b63f5 not found: ID does not exist" containerID="c4947de6f9bdfab93f31d052606f24fe7728d0a8d243a7cfb1a3b494881b63f5"
Oct 30 21:55:00.312409 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:00.312374    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4947de6f9bdfab93f31d052606f24fe7728d0a8d243a7cfb1a3b494881b63f5"} err="failed to get container status \"c4947de6f9bdfab93f31d052606f24fe7728d0a8d243a7cfb1a3b494881b63f5\": rpc error: code = NotFound desc = could not find container \"c4947de6f9bdfab93f31d052606f24fe7728d0a8d243a7cfb1a3b494881b63f5\": container with ID starting with c4947de6f9bdfab93f31d052606f24fe7728d0a8d243a7cfb1a3b494881b63f5 not found: ID does not exist"
Oct 30 21:55:00.464753 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:00.464729    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"]
Oct 30 21:55:00.468136 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:00.468112    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-8ce31a-6fbcccb667-2zbtq"]
Oct 30 21:55:01.191641 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:01.191602    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="53a26546-ac0e-47d2-b1da-c1d08799ce83" path="/var/lib/kubelet/pods/53a26546-ac0e-47d2-b1da-c1d08799ce83/volumes"
Oct 30 21:55:01.207710 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:01.207672    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:01.478913 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:01.478843    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:02.090721 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:02.090693    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:06.312296 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:06.312263    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:55:07.987443 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:55:07.987408    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:55:08.674786 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:08.674759    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:08.868336 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:08.868310    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:09.067503 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:09.067408    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:09.254634 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:09.254595    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"]
Oct 30 21:55:09.254852 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:09.254826    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz" podUID="c332502d-bb95-46fb-abfa-a8f25dcf6932" containerName="istio-proxy" containerID="cri-o://7ab959d6cc5b7c7c3b314fdffa0f8f30dd9de97037a3c0b4b51e096876b620c2" gracePeriod=30
Oct 30 21:55:09.284937 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:09.284912    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:14.496503 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.496476    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:55:14.558353 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.558295    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-podinfo\") pod \"c332502d-bb95-46fb-abfa-a8f25dcf6932\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") "
Oct 30 21:55:14.558353 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.558339    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-workload-certs\") pod \"c332502d-bb95-46fb-abfa-a8f25dcf6932\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") "
Oct 30 21:55:14.558519 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.558368    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-data\") pod \"c332502d-bb95-46fb-abfa-a8f25dcf6932\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") "
Oct 30 21:55:14.558519 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.558476    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-credential-socket\") pod \"c332502d-bb95-46fb-abfa-a8f25dcf6932\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") "
Oct 30 21:55:14.558600 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.558533    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-workload-socket\") pod \"c332502d-bb95-46fb-abfa-a8f25dcf6932\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") "
Oct 30 21:55:14.558654 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.558591    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-workload-certs" pod "c332502d-bb95-46fb-abfa-a8f25dcf6932" (UID: "c332502d-bb95-46fb-abfa-a8f25dcf6932"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:55:14.558654 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.558607    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c332502d-bb95-46fb-abfa-a8f25dcf6932-kube-api-access-fjhp5\" (UniqueName: \"kubernetes.io/projected/c332502d-bb95-46fb-abfa-a8f25dcf6932-kube-api-access-fjhp5\") pod \"c332502d-bb95-46fb-abfa-a8f25dcf6932\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") "
Oct 30 21:55:14.558766 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.558654    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-data" pod "c332502d-bb95-46fb-abfa-a8f25dcf6932" (UID: "c332502d-bb95-46fb-abfa-a8f25dcf6932"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:55:14.558766 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.558700    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-token\" (UniqueName: \"kubernetes.io/projected/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-token\") pod \"c332502d-bb95-46fb-abfa-a8f25dcf6932\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") "
Oct 30 21:55:14.558766 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.558753    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-envoy\") pod \"c332502d-bb95-46fb-abfa-a8f25dcf6932\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") "
Oct 30 21:55:14.558901 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.558759    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-credential-socket" pod "c332502d-bb95-46fb-abfa-a8f25dcf6932" (UID: "c332502d-bb95-46fb-abfa-a8f25dcf6932"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:55:14.558901 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.558796    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c332502d-bb95-46fb-abfa-a8f25dcf6932-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c332502d-bb95-46fb-abfa-a8f25dcf6932-istiod-ca-cert\") pod \"c332502d-bb95-46fb-abfa-a8f25dcf6932\" (UID: \"c332502d-bb95-46fb-abfa-a8f25dcf6932\") "
Oct 30 21:55:14.558901 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.558838    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-workload-socket" pod "c332502d-bb95-46fb-abfa-a8f25dcf6932" (UID: "c332502d-bb95-46fb-abfa-a8f25dcf6932"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:55:14.559065 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.559047    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:14.559115 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.559069    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:14.559115 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.559079    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:14.559115 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.559087    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:14.559266 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.559246    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c332502d-bb95-46fb-abfa-a8f25dcf6932-istiod-ca-cert" pod "c332502d-bb95-46fb-abfa-a8f25dcf6932" (UID: "c332502d-bb95-46fb-abfa-a8f25dcf6932"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:55:14.560675 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.560648    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c332502d-bb95-46fb-abfa-a8f25dcf6932-kube-api-access-fjhp5" pod "c332502d-bb95-46fb-abfa-a8f25dcf6932" (UID: "c332502d-bb95-46fb-abfa-a8f25dcf6932"). InnerVolumeSpecName "kube-api-access-fjhp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:55:14.560793 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.560699    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-envoy" pod "c332502d-bb95-46fb-abfa-a8f25dcf6932" (UID: "c332502d-bb95-46fb-abfa-a8f25dcf6932"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:55:14.560903 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.560891    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-podinfo" pod "c332502d-bb95-46fb-abfa-a8f25dcf6932" (UID: "c332502d-bb95-46fb-abfa-a8f25dcf6932"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:55:14.561017 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.560995    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-token" pod "c332502d-bb95-46fb-abfa-a8f25dcf6932" (UID: "c332502d-bb95-46fb-abfa-a8f25dcf6932"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:55:14.660158 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.660123    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:14.660158 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.660157    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:14.660158 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.660171    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c332502d-bb95-46fb-abfa-a8f25dcf6932-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:14.660415 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.660185    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c332502d-bb95-46fb-abfa-a8f25dcf6932-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:14.660415 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.660198    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjhp5\" (UniqueName: \"kubernetes.io/projected/c332502d-bb95-46fb-abfa-a8f25dcf6932-kube-api-access-fjhp5\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:14.965469 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:14.965435    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:15.151419 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:15.151390    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:15.370343 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:15.370264    4522 generic.go:356] "Generic (PLEG): container finished" podID="c332502d-bb95-46fb-abfa-a8f25dcf6932" containerID="7ab959d6cc5b7c7c3b314fdffa0f8f30dd9de97037a3c0b4b51e096876b620c2" exitCode=0
Oct 30 21:55:15.370343 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:15.370328    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"
Oct 30 21:55:15.370343 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:15.370338    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz" event={"ID":"c332502d-bb95-46fb-abfa-a8f25dcf6932","Type":"ContainerDied","Data":"7ab959d6cc5b7c7c3b314fdffa0f8f30dd9de97037a3c0b4b51e096876b620c2"}
Oct 30 21:55:15.370625 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:15.370420    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz" event={"ID":"c332502d-bb95-46fb-abfa-a8f25dcf6932","Type":"ContainerDied","Data":"78aa6d2f0405c69745c87c2daac4cbf046eed55de403ce7b32afccd190c8e932"}
Oct 30 21:55:15.370625 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:15.370451    4522 scope.go:122] "RemoveContainer" containerID="7ab959d6cc5b7c7c3b314fdffa0f8f30dd9de97037a3c0b4b51e096876b620c2"
Oct 30 21:55:15.379092 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:15.378898    4522 scope.go:122] "RemoveContainer" containerID="7ab959d6cc5b7c7c3b314fdffa0f8f30dd9de97037a3c0b4b51e096876b620c2"
Oct 30 21:55:15.379230 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:55:15.379209    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ab959d6cc5b7c7c3b314fdffa0f8f30dd9de97037a3c0b4b51e096876b620c2\": container with ID starting with 7ab959d6cc5b7c7c3b314fdffa0f8f30dd9de97037a3c0b4b51e096876b620c2 not found: ID does not exist" containerID="7ab959d6cc5b7c7c3b314fdffa0f8f30dd9de97037a3c0b4b51e096876b620c2"
Oct 30 21:55:15.379289 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:15.379241    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ab959d6cc5b7c7c3b314fdffa0f8f30dd9de97037a3c0b4b51e096876b620c2"} err="failed to get container status \"7ab959d6cc5b7c7c3b314fdffa0f8f30dd9de97037a3c0b4b51e096876b620c2\": rpc error: code = NotFound desc = could not find container \"7ab959d6cc5b7c7c3b314fdffa0f8f30dd9de97037a3c0b4b51e096876b620c2\": container with ID starting with 7ab959d6cc5b7c7c3b314fdffa0f8f30dd9de97037a3c0b4b51e096876b620c2 not found: ID does not exist"
Oct 30 21:55:15.581388 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:15.581351    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"]
Oct 30 21:55:15.584530 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:15.584502    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-8ce31a-openshift-default-bc8b5cfb5-gsjwz"]
Oct 30 21:55:16.964021 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:16.963975    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:17.190513 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:17.190479    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c332502d-bb95-46fb-abfa-a8f25dcf6932" path="/var/lib/kubelet/pods/c332502d-bb95-46fb-abfa-a8f25dcf6932/volumes"
Oct 30 21:55:19.974624 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:19.974589    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:20.165645 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:20.165615    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:23.122219 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:23.122190    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:24.478817 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:24.478782    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bf6cbd4cd-dl7gw"]
Oct 30 21:55:24.479319 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:24.479096    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw" podUID="e03c184a-e3e5-4902-b0c7-e7e16c042713" containerName="manager" containerID="cri-o://757b6f67304936c51f197ca57e3dff7ef8c35214dacd96ca8dc4d8c2a6c9a71e" gracePeriod=30
Oct 30 21:55:24.721095 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:24.721073    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw"
Oct 30 21:55:24.742383 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:24.742333    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e03c184a-e3e5-4902-b0c7-e7e16c042713-metrics-certs\" (UniqueName: \"kubernetes.io/secret/e03c184a-e3e5-4902-b0c7-e7e16c042713-metrics-certs\") pod \"e03c184a-e3e5-4902-b0c7-e7e16c042713\" (UID: \"e03c184a-e3e5-4902-b0c7-e7e16c042713\") "
Oct 30 21:55:24.742492 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:24.742414    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e03c184a-e3e5-4902-b0c7-e7e16c042713-kube-api-access-9dd88\" (UniqueName: \"kubernetes.io/projected/e03c184a-e3e5-4902-b0c7-e7e16c042713-kube-api-access-9dd88\") pod \"e03c184a-e3e5-4902-b0c7-e7e16c042713\" (UID: \"e03c184a-e3e5-4902-b0c7-e7e16c042713\") "
Oct 30 21:55:24.742492 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:24.742454    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e03c184a-e3e5-4902-b0c7-e7e16c042713-webhook-cert\" (UniqueName: \"kubernetes.io/secret/e03c184a-e3e5-4902-b0c7-e7e16c042713-webhook-cert\") pod \"e03c184a-e3e5-4902-b0c7-e7e16c042713\" (UID: \"e03c184a-e3e5-4902-b0c7-e7e16c042713\") "
Oct 30 21:55:24.744284 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:24.744254    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e03c184a-e3e5-4902-b0c7-e7e16c042713-metrics-certs" pod "e03c184a-e3e5-4902-b0c7-e7e16c042713" (UID: "e03c184a-e3e5-4902-b0c7-e7e16c042713"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:55:24.744391 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:24.744347    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e03c184a-e3e5-4902-b0c7-e7e16c042713-kube-api-access-9dd88" pod "e03c184a-e3e5-4902-b0c7-e7e16c042713" (UID: "e03c184a-e3e5-4902-b0c7-e7e16c042713"). InnerVolumeSpecName "kube-api-access-9dd88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:55:24.744391 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:24.744362    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e03c184a-e3e5-4902-b0c7-e7e16c042713-webhook-cert" pod "e03c184a-e3e5-4902-b0c7-e7e16c042713" (UID: "e03c184a-e3e5-4902-b0c7-e7e16c042713"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:55:24.843160 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:24.843131    4522 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e03c184a-e3e5-4902-b0c7-e7e16c042713-webhook-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:24.843160 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:24.843162    4522 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e03c184a-e3e5-4902-b0c7-e7e16c042713-metrics-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:24.843351 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:24.843177    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dd88\" (UniqueName: \"kubernetes.io/projected/e03c184a-e3e5-4902-b0c7-e7e16c042713-kube-api-access-9dd88\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:25.413618 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:25.413578    4522 generic.go:356] "Generic (PLEG): container finished" podID="e03c184a-e3e5-4902-b0c7-e7e16c042713" containerID="757b6f67304936c51f197ca57e3dff7ef8c35214dacd96ca8dc4d8c2a6c9a71e" exitCode=0
Oct 30 21:55:25.413763 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:25.413629    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw"
Oct 30 21:55:25.413763 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:25.413661    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw" event={"ID":"e03c184a-e3e5-4902-b0c7-e7e16c042713","Type":"ContainerDied","Data":"757b6f67304936c51f197ca57e3dff7ef8c35214dacd96ca8dc4d8c2a6c9a71e"}
Oct 30 21:55:25.413763 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:25.413714    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bf6cbd4cd-dl7gw" event={"ID":"e03c184a-e3e5-4902-b0c7-e7e16c042713","Type":"ContainerDied","Data":"d5f609513340fadaaa43225b94a087e8a2556ffcce6e109b679c3489ad7eaf32"}
Oct 30 21:55:25.413763 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:25.413736    4522 scope.go:122] "RemoveContainer" containerID="757b6f67304936c51f197ca57e3dff7ef8c35214dacd96ca8dc4d8c2a6c9a71e"
Oct 30 21:55:25.421847 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:25.421831    4522 scope.go:122] "RemoveContainer" containerID="757b6f67304936c51f197ca57e3dff7ef8c35214dacd96ca8dc4d8c2a6c9a71e"
Oct 30 21:55:25.422088 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:55:25.422069    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"757b6f67304936c51f197ca57e3dff7ef8c35214dacd96ca8dc4d8c2a6c9a71e\": container with ID starting with 757b6f67304936c51f197ca57e3dff7ef8c35214dacd96ca8dc4d8c2a6c9a71e not found: ID does not exist" containerID="757b6f67304936c51f197ca57e3dff7ef8c35214dacd96ca8dc4d8c2a6c9a71e"
Oct 30 21:55:25.422138 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:25.422100    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"757b6f67304936c51f197ca57e3dff7ef8c35214dacd96ca8dc4d8c2a6c9a71e"} err="failed to get container status \"757b6f67304936c51f197ca57e3dff7ef8c35214dacd96ca8dc4d8c2a6c9a71e\": rpc error: code = NotFound desc = could not find container \"757b6f67304936c51f197ca57e3dff7ef8c35214dacd96ca8dc4d8c2a6c9a71e\": container with ID starting with 757b6f67304936c51f197ca57e3dff7ef8c35214dacd96ca8dc4d8c2a6c9a71e not found: ID does not exist"
Oct 30 21:55:25.575333 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:25.575248    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bf6cbd4cd-dl7gw"]
Oct 30 21:55:25.624665 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:25.624636    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6bf6cbd4cd-dl7gw"]
Oct 30 21:55:27.193511 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:27.193447    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e03c184a-e3e5-4902-b0c7-e7e16c042713" path="/var/lib/kubelet/pods/e03c184a-e3e5-4902-b0c7-e7e16c042713/volumes"
Oct 30 21:55:31.174434 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:55:31.174406    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:37.987627 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:55:37.987589    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:56:02.450913 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:56:02.450879    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:07.987211 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:56:07.987168    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:56:13.864639 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:56:13.864609    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:31.532663 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:56:31.532631    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:31.875007 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:56:31.874935    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:56:31.880448 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:56:31.880427    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 21:56:37.988942 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:56:37.988901    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:56:51.707737 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:56:51.707698    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:57:07.986855 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:57:07.986818    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:57:12.946304 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:12.946269    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:57:14.280199 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:14.280117    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:19.871110 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:19.871076    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"]
Oct 30 21:57:19.871539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:19.871365    4522 cpu_manager.go:414] "containerMap: removing container" podUID="c332502d-bb95-46fb-abfa-a8f25dcf6932" containerName="istio-proxy"
Oct 30 21:57:19.871539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:19.871376    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c332502d-bb95-46fb-abfa-a8f25dcf6932" containerName="istio-proxy"
Oct 30 21:57:19.871539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:19.871391    4522 cpu_manager.go:414] "containerMap: removing container" podUID="e03c184a-e3e5-4902-b0c7-e7e16c042713" containerName="manager"
Oct 30 21:57:19.871539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:19.871396    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e03c184a-e3e5-4902-b0c7-e7e16c042713" containerName="manager"
Oct 30 21:57:19.871539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:19.871408    4522 cpu_manager.go:414] "containerMap: removing container" podUID="174c4004-d6e9-46c8-a05a-ec295d4eff67" containerName="istio-proxy"
Oct 30 21:57:19.871539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:19.871413    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="174c4004-d6e9-46c8-a05a-ec295d4eff67" containerName="istio-proxy"
Oct 30 21:57:19.871539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:19.871421    4522 cpu_manager.go:414] "containerMap: removing container" podUID="5870207c-906d-47f0-bb38-ca1020a0dccb" containerName="main"
Oct 30 21:57:19.871539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:19.871426    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5870207c-906d-47f0-bb38-ca1020a0dccb" containerName="main"
Oct 30 21:57:19.871539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:19.871432    4522 cpu_manager.go:414] "containerMap: removing container" podUID="53a26546-ac0e-47d2-b1da-c1d08799ce83" containerName="maas-api"
Oct 30 21:57:19.871539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:19.871437    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="53a26546-ac0e-47d2-b1da-c1d08799ce83" containerName="maas-api"
Oct 30 21:57:19.871539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:19.871444    4522 cpu_manager.go:414] "containerMap: removing container" podUID="2867e1d0-1d95-45f5-84fb-58477298f4a0" containerName="test-curl-7196-a2cb71"
Oct 30 21:57:19.871539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:19.871448    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2867e1d0-1d95-45f5-84fb-58477298f4a0" containerName="test-curl-7196-a2cb71"
Oct 30 21:57:19.871539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:19.871527    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="5870207c-906d-47f0-bb38-ca1020a0dccb" containerName="main"
Oct 30 21:57:19.871539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:19.871535    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="53a26546-ac0e-47d2-b1da-c1d08799ce83" containerName="maas-api"
Oct 30 21:57:19.871539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:19.871541    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="2867e1d0-1d95-45f5-84fb-58477298f4a0" containerName="test-curl-7196-a2cb71"
Oct 30 21:57:19.871539 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:19.871550    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="c332502d-bb95-46fb-abfa-a8f25dcf6932" containerName="istio-proxy"
Oct 30 21:57:19.872064 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:19.871556    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="e03c184a-e3e5-4902-b0c7-e7e16c042713" containerName="manager"
Oct 30 21:57:19.872064 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:19.871579    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="174c4004-d6e9-46c8-a05a-ec295d4eff67" containerName="istio-proxy"
Oct 30 21:57:19.874550 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:19.874523    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.063826 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.063792    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81ba7cf9-cd64-464a-bc49-36eaec127105-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.063826 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.063831    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.064091 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.063862    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9chd\" (UniqueName: \"kubernetes.io/projected/81ba7cf9-cd64-464a-bc49-36eaec127105-kube-api-access-b9chd\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.064091 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.064004    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.064091 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.064054    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.064091 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.064071    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.064330 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.064116    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.064330 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.064172    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.064330 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.064224    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.095244 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.095214    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"]
Oct 30 21:57:20.165104 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.165026    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.165104 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.165070    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.165104 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.165086    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.165104 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.165101    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.165450 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.165117    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.165544 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.165505    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.165544 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.165519    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.165544 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.165521    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.165712 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.165605    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81ba7cf9-cd64-464a-bc49-36eaec127105-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.165712 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.165633    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.165712 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.165650    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9chd\" (UniqueName: \"kubernetes.io/projected/81ba7cf9-cd64-464a-bc49-36eaec127105-kube-api-access-b9chd\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.165889 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.165753    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.165948 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.165934    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.166358 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.166324    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81ba7cf9-cd64-464a-bc49-36eaec127105-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.167825 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.167801    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.168172 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.168149    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.222756 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.222728    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9chd\" (UniqueName: \"kubernetes.io/projected/81ba7cf9-cd64-464a-bc49-36eaec127105-kube-api-access-b9chd\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.223039 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.223015    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-xpsmc\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.486020 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.485992    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:20.919766 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.919727    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"]
Oct 30 21:57:20.956932 ip-10-0-142-237 kubenswrapper[4522]: W1030 21:57:20.956898    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81ba7cf9_cd64_464a_bc49_36eaec127105.slice/crio-9d1713830f3a529538da5604bfa67d244884ad4a705a2b87e64aa29d57b336e7 WatchSource:0}: Error finding container 9d1713830f3a529538da5604bfa67d244884ad4a705a2b87e64aa29d57b336e7: Status 404 returned error can't find the container with id 9d1713830f3a529538da5604bfa67d244884ad4a705a2b87e64aa29d57b336e7
Oct 30 21:57:20.958949 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.958918    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:57:20.959017 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.958984    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:57:20.959017 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:20.959013    4522 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Oct 30 21:57:21.922808 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:21.922776    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:57:21.923372 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:21.923346    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc" event={"ID":"81ba7cf9-cd64-464a-bc49-36eaec127105","Type":"ContainerStarted","Data":"d250af69f518d2ffebd5efe8102805b4467beb9d5141d6bee877ee5817429901"}
Oct 30 21:57:21.923525 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:21.923394    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc" event={"ID":"81ba7cf9-cd64-464a-bc49-36eaec127105","Type":"ContainerStarted","Data":"9d1713830f3a529538da5604bfa67d244884ad4a705a2b87e64aa29d57b336e7"}
Oct 30 21:57:22.040062 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:22.040007    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc" podStartSLOduration=3.039993035 podStartE2EDuration="3.039993035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:57:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:57:22.039155161 +0000 UTC m=+2750.984100513" watchObservedRunningTime="2026-10-30 21:57:22.039993035 +0000 UTC m=+2750.984938395"
Oct 30 21:57:22.496943 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:22.496909    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:22.498088 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:22.498060    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-xpsmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:57:22.498297 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:22.498271    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc" podUID="81ba7cf9-cd64-464a-bc49-36eaec127105" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Oct 30 21:57:23.499245 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:23.498809    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-xpsmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:57:23.499245 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:23.498868    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc" podUID="81ba7cf9-cd64-464a-bc49-36eaec127105" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Oct 30 21:57:24.494487 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:24.489809    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-xpsmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:57:24.494487 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:24.489868    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc" podUID="81ba7cf9-cd64-464a-bc49-36eaec127105" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Oct 30 21:57:25.498482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:25.489891    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-xpsmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:57:25.498482 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:25.489954    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc" podUID="81ba7cf9-cd64-464a-bc49-36eaec127105" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Oct 30 21:57:26.487350 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:26.486878    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-xpsmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:57:26.487350 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:26.486941    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc" podUID="81ba7cf9-cd64-464a-bc49-36eaec127105" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Oct 30 21:57:27.486920 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:27.486884    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-xpsmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:57:27.487314 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:27.486960    4522 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc" podUID="81ba7cf9-cd64-464a-bc49-36eaec127105" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Oct 30 21:57:28.627329 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:28.627292    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:29.042553 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:29.042521    4522 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:29.044895 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:29.043223    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:29.050076 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:29.050051    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 21:57:31.875093 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:31.875066    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:37.987867 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:57:37.987831    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:57:41.307928 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:41.307896    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:57:58.141121 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:57:58.141081    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:58:07.986835 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:58:07.986802    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:58:32.204870 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:58:32.204840    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:37.987215 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:58:37.987171    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:58:39.015608 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:58:39.015572    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:58:49.648351 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:58:49.648281    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:58:51.199027 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:58:51.198563    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-hdwzw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:58:51.199027 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:58:51.198636    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw" podUID="e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:59:02.109737 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:59:02.109704    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:02.436074 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:59:02.436037    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:59:03.497821 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:59:03.497789    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:07.987171 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:59:07.987133    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 21:59:27.334505 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:59:27.334472    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:59:32.552260 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:59:32.552216    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:36.839540 ip-10-0-142-237 kubenswrapper[4522]: I1030 21:59:36.839506    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 21:59:37.986711 ip-10-0-142-237 kubenswrapper[4522]: E1030 21:59:37.986671    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:00:05.322796 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:00:05.322761    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:00:07.988133 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:00:07.988096    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:00:17.639753 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:00:17.639673    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:00:32.989071 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:00:32.989034    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:37.988048 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:00:37.988014    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:00:38.359435 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:00:38.359362    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:01:07.986765 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:01:07.986730    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:01:17.333201 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:01:17.333166    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:01:28.640895 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:01:28.640864    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:01:31.901702 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:01:31.901670    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 22:01:31.908188 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:01:31.908168    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 22:01:33.359062 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:01:33.359014    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:36.202591 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:01:36.202552    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-hdwzw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:01:36.203189 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:01:36.203156    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw" podUID="e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:01:37.986616 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:01:37.986584    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:01:38.254859 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:01:38.254794    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:01:58.547268 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:01:58.547191    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:59.396387 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:01:59.396355    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:01.064931 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:02:01.064898    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:02:07.988200 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:02:07.988167    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:02:11.122885 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:02:11.122853    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:02:25.333006 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:02:25.332972    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:02:33.625802 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:02:33.625766    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:37.987194 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:02:37.987160    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:02:58.924825 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:02:58.924788    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:03:07.987791 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:03:07.987754    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:03:09.833913 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:03:09.833873    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:03:29.130160 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:03:29.130124    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:03:33.919841 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:03:33.919802    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:37.987396 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:03:37.987360    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:03:39.914151 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:03:39.914113    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:03:46.274551 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:03:46.274511    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:46.880672 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:03:46.880625    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:47.252637 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:03:47.252603    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:50.958428 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:03:50.958391    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:51.169826 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:03:51.169791    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:54.151651 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:03:54.151620    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:54.365099 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:03:54.365066    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:57.207145 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:03:57.207108    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:57.399045 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:03:57.398963    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:57.589762 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:03:57.589680    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:02.172077 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:02.172046    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:05.219415 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:05.219379    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:04:07.090541 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:07.090510    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:07.987505 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:04:07.987445    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:04:11.877746 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:11.877711    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:15.728467 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:15.728435    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:16.208144 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:16.208106    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:16.412093 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:16.412060    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:16.978677 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:16.978642    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:18.806373 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:18.806332    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:21.973511 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:21.973475    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:23.405792 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:23.405759    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:04:25.028716 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:25.028681    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:26.871870 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:26.871825    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:31.671873 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:31.671818    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:34.257778 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:34.257741    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:34.445074 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:34.445040    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:36.493918 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:36.493884    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:37.988646 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:04:37.988609    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:04:41.575846 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:41.575808    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:46.475297 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:46.475220    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:49.539039 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:49.539004    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:04:51.427837 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:51.427807    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:56.220693 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:04:56.220657    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:00.880264 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:00.880227    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:05.672773 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:05.672738    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:07.987512 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:05:07.987450    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:05:10.516707 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:10.516663    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:15.288958 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:15.288922    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:15.512205 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:15.512161    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:18.545255 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:18.545222    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:05:20.433212 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:20.433181    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:20.630173 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:20.630121    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:25.361989 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:25.361946    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:27.756565 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:27.756533    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:27.951855 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:27.951760    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:30.066045 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:30.066017    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:32.718641 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:32.718608    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:34.313336 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:34.313305    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:34.596297 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:34.596219    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:35.846693 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:35.846659    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:36.134869 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:36.134791    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:37.987862 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:05:37.987826    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:05:38.937100 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:38.937061    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:05:44.765293 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:44.765251    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:46.876704 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:46.876670    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:53.083761 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:53.083726    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:53.276886 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:53.276853    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:53.466325 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:53.466289    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:57.468869 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:57.468831    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:57.989162 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:05:57.989129    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:04.216496 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:06:04.216445    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:06.348707 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:06:06.348679    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:07.987590 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:06:07.987554    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:06:19.634054 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:06:19.634016    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:06:21.206483 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:06:21.201575    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-hdwzw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:06:21.206483 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:06:21.201657    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hdwzw" podUID="e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:06:30.002510 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:06:30.002444    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:06:31.926719 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:06:31.926689    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 22:06:31.932755 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:06:31.932735    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 22:06:34.947476 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:06:34.947419    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:37.986970 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:06:37.986936    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:06:40.652872 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:06:40.652838    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:42.044567 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:06:42.044531    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:49.844576 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:06:49.844542    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:06.409838 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:07:06.409806    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:07.442583 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:07:07.442546    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:07.986867 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:07:07.986829    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:07:15.905271 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:07:15.905237    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:35.345113 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:07:35.345077    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:37.987495 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:07:37.987447    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:08:07.987255 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:08:07.987178    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:08:18.200329 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:08:18.200292    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:08:35.644063 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:08:35.644030    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:37.987251 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:08:37.987211    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:08:40.347065 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:08:40.347031    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:41.141901 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:08:41.141866    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:08:50.560712 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:08:50.560678    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:08:51.717482 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:08:51.717427    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:01.834307 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:01.834276    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:02.084749 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:02.084676    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:07.986840 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:09:07.986798    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:09:10.035572 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:10.035533    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:09:19.637391 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:19.637317    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:20.275490 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:20.275416    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:20.563648 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:20.563565    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:24.625934 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:24.625901    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:24.835002 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:24.834967    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:25.035694 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:25.035656    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:27.889085 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:27.889057    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:28.078785 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:28.078708    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:30.917726 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:30.917694    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:31.123649 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:31.123621    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:35.865376 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:35.865293    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:36.069505 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:36.069467    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:37.987233 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:09:37.987197    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:09:38.822285 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:38.822231    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:09:40.760285 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:40.760249    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:45.585705 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:45.585670    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:49.484279 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:49.484246    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:50.775578 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:50.775542    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:55.675856 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:09:55.675823    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:00.078145 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:10:00.078111    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:00.294905 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:10:00.294873    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:00.546471 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:10:00.546435    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:04.905854 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:10:04.905815    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:05.266050 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:10:05.266013    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:07.987655 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:10:07.987622    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:10:09.345519 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:10:09.345481    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:10:10.083941 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:10:10.083898    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:14.873342 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:10:14.873302    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:19.804061 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:10:19.803983    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:24.579684 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:10:24.579651    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:29.472365 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:10:29.472324    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:33.554136 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:10:33.554100    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:10:34.177245 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:10:34.177201    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:36.306626 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:10:36.306590    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:37.987755 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:10:37.987720    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:10:38.981260 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:10:38.981213    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:43.773060 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:10:43.772986    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:48.680822 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:10:48.680789    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:53.457737 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:10:53.457702    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:58.365705 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:10:58.365669    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:03.202171 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:03.202142    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:05.485538 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:05.485501    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:07.366274 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:07.366239    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:11:07.987071 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:11:07.987037    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:11:08.372136 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:08.372038    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:10.534936 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:10.534905    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:13.284441 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:13.284407    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:17.535391 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:17.535357    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:17.816544 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:17.814230    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:18.007912 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:18.007868    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:21.797601 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:21.797571    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:22.082143 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:22.082049    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:22.138971 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:22.138938    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:11:22.859425 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:22.859393    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:29.367749 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:29.367709    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:29.567146 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:29.567114    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:29.780725 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:29.780690    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:31.951581 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:31.951552    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 22:11:31.959562 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:31.959542    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 22:11:36.455123 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:36.455086    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:36.665760 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:36.665727    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:37.987855 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:11:37.987815    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:11:40.918004 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:40.917970    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:11:41.488317 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:41.488277    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:47.003327 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:47.003296    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:49.274910 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:11:49.274879    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:05.081694 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:12:05.081644    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:07.987617 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:12:07.987583    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:12:18.560750 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:12:18.560678    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:23.154501 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:12:23.154448    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:12:37.065240 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:12:37.065200    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:37.986804 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:12:37.986769    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:12:54.158117 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:12:54.158074    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:12:59.649041 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:12:59.648976    4522 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal" podUID="f52de7228915512f349d24482d38315b" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": context deadline exceeded"
Oct 30 22:13:07.949031 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:13:07.948996    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:13:07.986538 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:13:07.986502    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:13:14.473862 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:13:14.473828    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:15.586166 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:13:15.586132    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:20.815003 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:13:20.814950    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:13:22.161173 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:13:22.161121    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:30.085650 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:13:30.085609    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-xpsmc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:13:30.086257 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:13:30.086223    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc" podUID="81ba7cf9-cd64-464a-bc49-36eaec127105" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:13:34.521698 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:13:34.521659    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:13:37.384921 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:13:37.384881    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:37.988453 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:13:37.988414    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:13:44.340493 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:13:44.340401    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:14:07.986858 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:14:07.986817    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:14:08.568164 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:08.568131    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:14:15.515894 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:15.515867    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:16.118762 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:16.118729    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:16.550871 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:16.550842    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:19.398224 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:19.398191    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:19.604434 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:19.604398    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:22.651512 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:22.651451    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:22.844652 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:22.844621    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:24.554996 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:24.554962    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:24.760045 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:24.760016    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:24.957614 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:24.957579    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:25.230976 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:25.230901    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"]
Oct 30 22:14:25.231137 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:25.231091    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6" podUID="7b53a976-2bc6-4cfb-8549-4a45213ed9f1" containerName="maas-api" containerID="cri-o://f3d29c6982db748d6907406a25f8890639cbe6e522b31f20b1fc27b4fb4aead6" gracePeriod=30
Oct 30 22:14:26.476235 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:26.476209    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"
Oct 30 22:14:26.530561 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:26.530530    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-openshift-service-ca\") pod \"7b53a976-2bc6-4cfb-8549-4a45213ed9f1\" (UID: \"7b53a976-2bc6-4cfb-8549-4a45213ed9f1\") "
Oct 30 22:14:26.530732 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:26.530577    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-maas-api-tls\") pod \"7b53a976-2bc6-4cfb-8549-4a45213ed9f1\" (UID: \"7b53a976-2bc6-4cfb-8549-4a45213ed9f1\") "
Oct 30 22:14:26.530732 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:26.530622    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-kube-api-access-lq727\" (UniqueName: \"kubernetes.io/projected/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-kube-api-access-lq727\") pod \"7b53a976-2bc6-4cfb-8549-4a45213ed9f1\" (UID: \"7b53a976-2bc6-4cfb-8549-4a45213ed9f1\") "
Oct 30 22:14:26.530732 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:26.530678    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-metrics-certs\") pod \"7b53a976-2bc6-4cfb-8549-4a45213ed9f1\" (UID: \"7b53a976-2bc6-4cfb-8549-4a45213ed9f1\") "
Oct 30 22:14:26.530942 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:26.530915    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-openshift-service-ca" pod "7b53a976-2bc6-4cfb-8549-4a45213ed9f1" (UID: "7b53a976-2bc6-4cfb-8549-4a45213ed9f1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:14:26.531054 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:26.531024    4522 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-openshift-service-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:26.532861 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:26.532836    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-kube-api-access-lq727" pod "7b53a976-2bc6-4cfb-8549-4a45213ed9f1" (UID: "7b53a976-2bc6-4cfb-8549-4a45213ed9f1"). InnerVolumeSpecName "kube-api-access-lq727". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:26.532955 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:26.532834    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-maas-api-tls" pod "7b53a976-2bc6-4cfb-8549-4a45213ed9f1" (UID: "7b53a976-2bc6-4cfb-8549-4a45213ed9f1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:14:26.533140 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:26.533120    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-metrics-certs" pod "7b53a976-2bc6-4cfb-8549-4a45213ed9f1" (UID: "7b53a976-2bc6-4cfb-8549-4a45213ed9f1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:14:26.631794 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:26.631723    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-maas-api-tls\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:26.631794 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:26.631750    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq727\" (UniqueName: \"kubernetes.io/projected/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-kube-api-access-lq727\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:26.631794 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:26.631761    4522 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b53a976-2bc6-4cfb-8549-4a45213ed9f1-metrics-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:27.306126 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:27.306093    4522 generic.go:356] "Generic (PLEG): container finished" podID="7b53a976-2bc6-4cfb-8549-4a45213ed9f1" containerID="f3d29c6982db748d6907406a25f8890639cbe6e522b31f20b1fc27b4fb4aead6" exitCode=0
Oct 30 22:14:27.306324 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:27.306135    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"
Oct 30 22:14:27.306324 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:27.306180    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6" event={"ID":"7b53a976-2bc6-4cfb-8549-4a45213ed9f1","Type":"ContainerDied","Data":"f3d29c6982db748d6907406a25f8890639cbe6e522b31f20b1fc27b4fb4aead6"}
Oct 30 22:14:27.306324 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:27.306237    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f994fb758-4gct6" event={"ID":"7b53a976-2bc6-4cfb-8549-4a45213ed9f1","Type":"ContainerDied","Data":"25af1d3275522f63ffe5ed8c1f43d42cf856e20d6f9b4edf9f702806bae79d53"}
Oct 30 22:14:27.306324 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:27.306264    4522 scope.go:122] "RemoveContainer" containerID="f3d29c6982db748d6907406a25f8890639cbe6e522b31f20b1fc27b4fb4aead6"
Oct 30 22:14:27.314866 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:27.314845    4522 scope.go:122] "RemoveContainer" containerID="f3d29c6982db748d6907406a25f8890639cbe6e522b31f20b1fc27b4fb4aead6"
Oct 30 22:14:27.315146 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:14:27.315126    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3d29c6982db748d6907406a25f8890639cbe6e522b31f20b1fc27b4fb4aead6\": container with ID starting with f3d29c6982db748d6907406a25f8890639cbe6e522b31f20b1fc27b4fb4aead6 not found: ID does not exist" containerID="f3d29c6982db748d6907406a25f8890639cbe6e522b31f20b1fc27b4fb4aead6"
Oct 30 22:14:27.315209 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:27.315155    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3d29c6982db748d6907406a25f8890639cbe6e522b31f20b1fc27b4fb4aead6"} err="failed to get container status \"f3d29c6982db748d6907406a25f8890639cbe6e522b31f20b1fc27b4fb4aead6\": rpc error: code = NotFound desc = could not find container \"f3d29c6982db748d6907406a25f8890639cbe6e522b31f20b1fc27b4fb4aead6\": container with ID starting with f3d29c6982db748d6907406a25f8890639cbe6e522b31f20b1fc27b4fb4aead6 not found: ID does not exist"
Oct 30 22:14:27.467491 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:27.467393    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"]
Oct 30 22:14:27.519194 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:27.519154    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f994fb758-4gct6"]
Oct 30 22:14:29.192034 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:29.191997    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7b53a976-2bc6-4cfb-8549-4a45213ed9f1" path="/var/lib/kubelet/pods/7b53a976-2bc6-4cfb-8549-4a45213ed9f1/volumes"
Oct 30 22:14:29.679278 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:29.679240    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:32.607225 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:32.607192    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:14:34.557575 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:34.557543    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:37.751338 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:37.751305    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:37.987994 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:14:37.987955    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:14:39.361314 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:39.361241    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:44.538256 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:44.538213    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:45.547745 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:45.547714    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl"]
Oct 30 22:14:45.548119 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:45.548042    4522 cpu_manager.go:414] "containerMap: removing container" podUID="7b53a976-2bc6-4cfb-8549-4a45213ed9f1" containerName="maas-api"
Oct 30 22:14:45.548119 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:45.548055    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b53a976-2bc6-4cfb-8549-4a45213ed9f1" containerName="maas-api"
Oct 30 22:14:45.548119 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:45.548109    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b53a976-2bc6-4cfb-8549-4a45213ed9f1" containerName="maas-api"
Oct 30 22:14:45.550929 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:45.550912    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl"
Oct 30 22:14:45.602764 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:45.602730    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:14:45.652181 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:45.652147    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:14:45.652181 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:45.652152    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:14:45.652396 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:45.652181    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-crcdl\""
Oct 30 22:14:45.653564 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:45.653545    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl"]
Oct 30 22:14:45.702885 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:45.702855    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9047621e-b50f-4aa2-8e07-5192b5eebcca-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl\" (UID: \"9047621e-b50f-4aa2-8e07-5192b5eebcca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl"
Oct 30 22:14:45.703053 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:45.702889    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfxs6\" (UniqueName: \"kubernetes.io/projected/9047621e-b50f-4aa2-8e07-5192b5eebcca-kube-api-access-lfxs6\") pod \"maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl\" (UID: \"9047621e-b50f-4aa2-8e07-5192b5eebcca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl"
Oct 30 22:14:45.703053 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:45.703016    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9047621e-b50f-4aa2-8e07-5192b5eebcca-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl\" (UID: \"9047621e-b50f-4aa2-8e07-5192b5eebcca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl"
Oct 30 22:14:45.803724 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:45.803634    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9047621e-b50f-4aa2-8e07-5192b5eebcca-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl\" (UID: \"9047621e-b50f-4aa2-8e07-5192b5eebcca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl"
Oct 30 22:14:45.803724 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:45.803672    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfxs6\" (UniqueName: \"kubernetes.io/projected/9047621e-b50f-4aa2-8e07-5192b5eebcca-kube-api-access-lfxs6\") pod \"maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl\" (UID: \"9047621e-b50f-4aa2-8e07-5192b5eebcca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl"
Oct 30 22:14:45.803724 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:45.803728    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9047621e-b50f-4aa2-8e07-5192b5eebcca-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl\" (UID: \"9047621e-b50f-4aa2-8e07-5192b5eebcca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl"
Oct 30 22:14:45.804373 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:45.804354    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9047621e-b50f-4aa2-8e07-5192b5eebcca-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl\" (UID: \"9047621e-b50f-4aa2-8e07-5192b5eebcca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl"
Oct 30 22:14:45.805969 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:45.805944    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9047621e-b50f-4aa2-8e07-5192b5eebcca-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl\" (UID: \"9047621e-b50f-4aa2-8e07-5192b5eebcca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl"
Oct 30 22:14:45.862534 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:45.862507    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfxs6\" (UniqueName: \"kubernetes.io/projected/9047621e-b50f-4aa2-8e07-5192b5eebcca-kube-api-access-lfxs6\") pod \"maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl\" (UID: \"9047621e-b50f-4aa2-8e07-5192b5eebcca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl"
Oct 30 22:14:46.162567 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:46.162482    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl"
Oct 30 22:14:46.550807 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:46.550775    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl"]
Oct 30 22:14:46.554321 ip-10-0-142-237 kubenswrapper[4522]: W1030 22:14:46.554288    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9047621e_b50f_4aa2_8e07_5192b5eebcca.slice/crio-1ff988a52b545a017aaef2ddbac3190f6e1b4f168c76e102898788aa18029a8e WatchSource:0}: Error finding container 1ff988a52b545a017aaef2ddbac3190f6e1b4f168c76e102898788aa18029a8e: Status 404 returned error can't find the container with id 1ff988a52b545a017aaef2ddbac3190f6e1b4f168c76e102898788aa18029a8e
Oct 30 22:14:47.390785 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:47.390756    4522 generic.go:356] "Generic (PLEG): container finished" podID="9047621e-b50f-4aa2-8e07-5192b5eebcca" containerID="20433d4ab251a3881446da2e7a3a1d72ee05960ca71f54f741827f58710f6083" exitCode=0
Oct 30 22:14:47.390937 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:47.390797    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl" event={"ID":"9047621e-b50f-4aa2-8e07-5192b5eebcca","Type":"ContainerDied","Data":"20433d4ab251a3881446da2e7a3a1d72ee05960ca71f54f741827f58710f6083"}
Oct 30 22:14:47.390937 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:47.390836    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl" event={"ID":"9047621e-b50f-4aa2-8e07-5192b5eebcca","Type":"ContainerStarted","Data":"1ff988a52b545a017aaef2ddbac3190f6e1b4f168c76e102898788aa18029a8e"}
Oct 30 22:14:48.523280 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:48.523257    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl"
Oct 30 22:14:48.627116 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:48.627085    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9047621e-b50f-4aa2-8e07-5192b5eebcca-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9047621e-b50f-4aa2-8e07-5192b5eebcca-maas-api-xks-ca\") pod \"9047621e-b50f-4aa2-8e07-5192b5eebcca\" (UID: \"9047621e-b50f-4aa2-8e07-5192b5eebcca\") "
Oct 30 22:14:48.627299 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:48.627130    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9047621e-b50f-4aa2-8e07-5192b5eebcca-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9047621e-b50f-4aa2-8e07-5192b5eebcca-maas-api-openshift-ca\") pod \"9047621e-b50f-4aa2-8e07-5192b5eebcca\" (UID: \"9047621e-b50f-4aa2-8e07-5192b5eebcca\") "
Oct 30 22:14:48.627299 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:48.627193    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9047621e-b50f-4aa2-8e07-5192b5eebcca-kube-api-access-lfxs6\" (UniqueName: \"kubernetes.io/projected/9047621e-b50f-4aa2-8e07-5192b5eebcca-kube-api-access-lfxs6\") pod \"9047621e-b50f-4aa2-8e07-5192b5eebcca\" (UID: \"9047621e-b50f-4aa2-8e07-5192b5eebcca\") "
Oct 30 22:14:48.627693 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:48.627658    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9047621e-b50f-4aa2-8e07-5192b5eebcca-maas-api-openshift-ca" pod "9047621e-b50f-4aa2-8e07-5192b5eebcca" (UID: "9047621e-b50f-4aa2-8e07-5192b5eebcca"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:14:48.629370 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:48.629348    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9047621e-b50f-4aa2-8e07-5192b5eebcca-kube-api-access-lfxs6" pod "9047621e-b50f-4aa2-8e07-5192b5eebcca" (UID: "9047621e-b50f-4aa2-8e07-5192b5eebcca"). InnerVolumeSpecName "kube-api-access-lfxs6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:48.629475 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:48.629352    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9047621e-b50f-4aa2-8e07-5192b5eebcca-maas-api-xks-ca" pod "9047621e-b50f-4aa2-8e07-5192b5eebcca" (UID: "9047621e-b50f-4aa2-8e07-5192b5eebcca"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:14:48.728259 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:48.728227    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfxs6\" (UniqueName: \"kubernetes.io/projected/9047621e-b50f-4aa2-8e07-5192b5eebcca-kube-api-access-lfxs6\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:48.728259 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:48.728258    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9047621e-b50f-4aa2-8e07-5192b5eebcca-maas-api-xks-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:48.728259 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:48.728267    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9047621e-b50f-4aa2-8e07-5192b5eebcca-maas-api-openshift-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:49.399574 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:49.399536    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl" event={"ID":"9047621e-b50f-4aa2-8e07-5192b5eebcca","Type":"ContainerDied","Data":"1ff988a52b545a017aaef2ddbac3190f6e1b4f168c76e102898788aa18029a8e"}
Oct 30 22:14:49.399574 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:49.399570    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl"
Oct 30 22:14:49.399782 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:49.399590    4522 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ff988a52b545a017aaef2ddbac3190f6e1b4f168c76e102898788aa18029a8e"
Oct 30 22:14:49.834187 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:49.834151    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:54.948005 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:54.947968    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:57.532595 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:57.532565    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:57.755586 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:57.755558    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:59.624812 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:14:59.624782    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:00.168579 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:00.168550    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8"]
Oct 30 22:15:00.168891 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:00.168878    4522 cpu_manager.go:414] "containerMap: removing container" podUID="9047621e-b50f-4aa2-8e07-5192b5eebcca" containerName="revoke-keys"
Oct 30 22:15:00.168943 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:00.168895    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9047621e-b50f-4aa2-8e07-5192b5eebcca" containerName="revoke-keys"
Oct 30 22:15:00.168981 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:00.168969    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="9047621e-b50f-4aa2-8e07-5192b5eebcca" containerName="revoke-keys"
Oct 30 22:15:00.172234 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:00.172218    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8"
Oct 30 22:15:00.227098 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:00.227064    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pp7m\" (UniqueName: \"kubernetes.io/projected/b01f59a5-1952-4b6c-9d40-878aa99bc14e-kube-api-access-6pp7m\") pod \"maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8\" (UID: \"b01f59a5-1952-4b6c-9d40-878aa99bc14e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8"
Oct 30 22:15:00.227286 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:00.227255    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b01f59a5-1952-4b6c-9d40-878aa99bc14e-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8\" (UID: \"b01f59a5-1952-4b6c-9d40-878aa99bc14e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8"
Oct 30 22:15:00.273757 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:00.273728    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:15:00.273961 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:00.273944    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:15:00.273961 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:00.273958    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-crcdl\""
Oct 30 22:15:00.275424 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:00.275396    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8"]
Oct 30 22:15:00.328509 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:00.328455    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pp7m\" (UniqueName: \"kubernetes.io/projected/b01f59a5-1952-4b6c-9d40-878aa99bc14e-kube-api-access-6pp7m\") pod \"maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8\" (UID: \"b01f59a5-1952-4b6c-9d40-878aa99bc14e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8"
Oct 30 22:15:00.328657 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:00.328570    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b01f59a5-1952-4b6c-9d40-878aa99bc14e-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8\" (UID: \"b01f59a5-1952-4b6c-9d40-878aa99bc14e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8"
Oct 30 22:15:00.329176 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:00.329157    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b01f59a5-1952-4b6c-9d40-878aa99bc14e-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8\" (UID: \"b01f59a5-1952-4b6c-9d40-878aa99bc14e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8"
Oct 30 22:15:00.386074 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:00.386040    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pp7m\" (UniqueName: \"kubernetes.io/projected/b01f59a5-1952-4b6c-9d40-878aa99bc14e-kube-api-access-6pp7m\") pod \"maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8\" (UID: \"b01f59a5-1952-4b6c-9d40-878aa99bc14e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8"
Oct 30 22:15:00.484277 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:00.484186    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8"
Oct 30 22:15:00.854094 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:00.854012    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8"]
Oct 30 22:15:00.856863 ip-10-0-142-237 kubenswrapper[4522]: W1030 22:15:00.856831    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb01f59a5_1952_4b6c_9d40_878aa99bc14e.slice/crio-9316fff6782ee5ab1b06d411ef575c6aeda21debf067f2c7e1109977b46b4ae3 WatchSource:0}: Error finding container 9316fff6782ee5ab1b06d411ef575c6aeda21debf067f2c7e1109977b46b4ae3: Status 404 returned error can't find the container with id 9316fff6782ee5ab1b06d411ef575c6aeda21debf067f2c7e1109977b46b4ae3
Oct 30 22:15:01.448907 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:01.448876    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8" event={"ID":"b01f59a5-1952-4b6c-9d40-878aa99bc14e","Type":"ContainerStarted","Data":"10755cfabe0a30051bfbdb6a3fcce51f95cfe0d8b55833a0b59d98b7d6e5e6c3"}
Oct 30 22:15:01.449093 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:01.448924    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8" event={"ID":"b01f59a5-1952-4b6c-9d40-878aa99bc14e","Type":"ContainerStarted","Data":"9316fff6782ee5ab1b06d411ef575c6aeda21debf067f2c7e1109977b46b4ae3"}
Oct 30 22:15:01.567024 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:01.566975    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8" podStartSLOduration=1.566958084 podStartE2EDuration="1.566958084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:01.565014558 +0000 UTC m=+3810.509959916" watchObservedRunningTime="2026-10-30 22:15:01.566958084 +0000 UTC m=+3810.511903444"
Oct 30 22:15:02.454886 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:02.454853    4522 generic.go:356] "Generic (PLEG): container finished" podID="b01f59a5-1952-4b6c-9d40-878aa99bc14e" containerID="10755cfabe0a30051bfbdb6a3fcce51f95cfe0d8b55833a0b59d98b7d6e5e6c3" exitCode=60
Oct 30 22:15:02.455272 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:02.454935    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8" event={"ID":"b01f59a5-1952-4b6c-9d40-878aa99bc14e","Type":"ContainerDied","Data":"10755cfabe0a30051bfbdb6a3fcce51f95cfe0d8b55833a0b59d98b7d6e5e6c3"}
Oct 30 22:15:02.455272 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:02.455109    4522 scope.go:122] "RemoveContainer" containerID="10755cfabe0a30051bfbdb6a3fcce51f95cfe0d8b55833a0b59d98b7d6e5e6c3"
Oct 30 22:15:03.460795 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:03.460713    4522 generic.go:356] "Generic (PLEG): container finished" podID="b01f59a5-1952-4b6c-9d40-878aa99bc14e" containerID="9a5756d743e4b7ebadc4dcce149035fa8b43a3cc88180347bea2c82ff2cb23e8" exitCode=60
Oct 30 22:15:03.461159 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:03.460796    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8" event={"ID":"b01f59a5-1952-4b6c-9d40-878aa99bc14e","Type":"ContainerDied","Data":"9a5756d743e4b7ebadc4dcce149035fa8b43a3cc88180347bea2c82ff2cb23e8"}
Oct 30 22:15:03.461159 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:03.460849    4522 scope.go:122] "RemoveContainer" containerID="10755cfabe0a30051bfbdb6a3fcce51f95cfe0d8b55833a0b59d98b7d6e5e6c3"
Oct 30 22:15:03.461159 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:03.461052    4522 scope.go:122] "RemoveContainer" containerID="9a5756d743e4b7ebadc4dcce149035fa8b43a3cc88180347bea2c82ff2cb23e8"
Oct 30 22:15:03.461344 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:15:03.461300    4522 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8_odh-ai-gateway-infra(b01f59a5-1952-4b6c-9d40-878aa99bc14e)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8" podUID="b01f59a5-1952-4b6c-9d40-878aa99bc14e"
Oct 30 22:15:03.990714 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:03.990669    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:04.011669 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:04.011640    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8"]
Oct 30 22:15:04.466575 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:04.466543    4522 scope.go:122] "RemoveContainer" containerID="9a5756d743e4b7ebadc4dcce149035fa8b43a3cc88180347bea2c82ff2cb23e8"
Oct 30 22:15:04.466955 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:15:04.466752    4522 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8_odh-ai-gateway-infra(b01f59a5-1952-4b6c-9d40-878aa99bc14e)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8" podUID="b01f59a5-1952-4b6c-9d40-878aa99bc14e"
Oct 30 22:15:05.478055 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:05.478028    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:05.591778 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:05.591751    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8"
Oct 30 22:15:05.669944 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:05.669913    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b01f59a5-1952-4b6c-9d40-878aa99bc14e-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b01f59a5-1952-4b6c-9d40-878aa99bc14e-maas-api-service-ca\") pod \"b01f59a5-1952-4b6c-9d40-878aa99bc14e\" (UID: \"b01f59a5-1952-4b6c-9d40-878aa99bc14e\") "
Oct 30 22:15:05.670093 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:05.669951    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b01f59a5-1952-4b6c-9d40-878aa99bc14e-kube-api-access-6pp7m\" (UniqueName: \"kubernetes.io/projected/b01f59a5-1952-4b6c-9d40-878aa99bc14e-kube-api-access-6pp7m\") pod \"b01f59a5-1952-4b6c-9d40-878aa99bc14e\" (UID: \"b01f59a5-1952-4b6c-9d40-878aa99bc14e\") "
Oct 30 22:15:05.670251 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:05.670229    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b01f59a5-1952-4b6c-9d40-878aa99bc14e-maas-api-service-ca" pod "b01f59a5-1952-4b6c-9d40-878aa99bc14e" (UID: "b01f59a5-1952-4b6c-9d40-878aa99bc14e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:05.671962 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:05.671944    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b01f59a5-1952-4b6c-9d40-878aa99bc14e-kube-api-access-6pp7m" pod "b01f59a5-1952-4b6c-9d40-878aa99bc14e" (UID: "b01f59a5-1952-4b6c-9d40-878aa99bc14e"). InnerVolumeSpecName "kube-api-access-6pp7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:05.771175 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:05.771093    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b01f59a5-1952-4b6c-9d40-878aa99bc14e-maas-api-service-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:05.771175 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:05.771125    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pp7m\" (UniqueName: \"kubernetes.io/projected/b01f59a5-1952-4b6c-9d40-878aa99bc14e-kube-api-access-6pp7m\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:05.837676 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:05.837641    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:05.944252 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:05.944212    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl"]
Oct 30 22:15:05.946919 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:05.946894    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-87bd1eb1-wphhl"]
Oct 30 22:15:06.475757 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:06.475730    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8"
Oct 30 22:15:06.475952 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:06.475730    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8" event={"ID":"b01f59a5-1952-4b6c-9d40-878aa99bc14e","Type":"ContainerDied","Data":"9316fff6782ee5ab1b06d411ef575c6aeda21debf067f2c7e1109977b46b4ae3"}
Oct 30 22:15:06.475952 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:06.475868    4522 scope.go:122] "RemoveContainer" containerID="9a5756d743e4b7ebadc4dcce149035fa8b43a3cc88180347bea2c82ff2cb23e8"
Oct 30 22:15:06.637441 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:06.637405    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8"]
Oct 30 22:15:06.647419 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:06.647389    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-87bd1eb1-29889975-xstj8"]
Oct 30 22:15:07.190795 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:07.190755    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9047621e-b50f-4aa2-8e07-5192b5eebcca" path="/var/lib/kubelet/pods/9047621e-b50f-4aa2-8e07-5192b5eebcca/volumes"
Oct 30 22:15:07.191196 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:07.191175    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b01f59a5-1952-4b6c-9d40-878aa99bc14e" path="/var/lib/kubelet/pods/b01f59a5-1952-4b6c-9d40-878aa99bc14e/volumes"
Oct 30 22:15:07.987765 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:15:07.987725    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:15:08.250972 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:08.250889    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:15:11.737944 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:11.737907    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:12.878347 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:12.878309    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:13.520167 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:13.520030    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:13.719847 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:13.719807    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:17.363723 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:17.363688    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:17.587672 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:17.587640    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:20.601696 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:20.601638    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:20.802110 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:20.802077    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:23.756332 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:23.756295    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:23.971182 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:23.971151    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:24.181221 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:24.181193    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:28.981770 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:28.981737    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:31.860763 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:31.860730    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:15:33.934296 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:33.934257    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:37.987327 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:15:37.987289    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:15:38.028754 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:38.028706    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:38.774629 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:38.774581    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:39.364215 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:39.364185    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:40.105599 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:40.105569    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:42.109237 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:42.109204    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:43.863052 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:43.863007    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:48.771217 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:48.771117    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:53.699581 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:53.699542    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:58.789775 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:15:58.789742    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:03.673674 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:16:03.673584    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:07.986880 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:16:07.986841    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:16:08.618325 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:16:08.618289    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:13.478155 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:16:13.478119    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:18.379953 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:16:18.379919    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:23.289813 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:16:23.289777    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:27.136684 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:16:27.136647    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:28.087879 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:16:28.087781    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:31.981961 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:16:31.981931    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 22:16:31.988535 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:16:31.988511    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 22:16:33.024700 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:16:33.024666    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:37.784811 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:16:37.784781    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:37.987869 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:16:37.987835    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:16:38.421355 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:16:38.421323    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:42.687679 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:16:42.687645    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:47.580756 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:16:47.580680    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:52.452173 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:16:52.452143    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:57.146174 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:16:57.146140    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:01.987697 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:01.987665    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:05.461287 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.461250    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh"]
Oct 30 22:17:05.461696 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.461592    4522 cpu_manager.go:414] "containerMap: removing container" podUID="b01f59a5-1952-4b6c-9d40-878aa99bc14e" containerName="cleanup"
Oct 30 22:17:05.461696 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.461605    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b01f59a5-1952-4b6c-9d40-878aa99bc14e" containerName="cleanup"
Oct 30 22:17:05.461696 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.461621    4522 cpu_manager.go:414] "containerMap: removing container" podUID="b01f59a5-1952-4b6c-9d40-878aa99bc14e" containerName="cleanup"
Oct 30 22:17:05.461696 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.461629    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b01f59a5-1952-4b6c-9d40-878aa99bc14e" containerName="cleanup"
Oct 30 22:17:05.461696 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.461693    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="b01f59a5-1952-4b6c-9d40-878aa99bc14e" containerName="cleanup"
Oct 30 22:17:05.464584 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.464568    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh"
Oct 30 22:17:05.536803 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.536771    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh\" (UID: \"7c23a18f-fe92-4259-84cf-0dca4a0c5f06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh"
Oct 30 22:17:05.536986 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.536880    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh\" (UID: \"7c23a18f-fe92-4259-84cf-0dca4a0c5f06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh"
Oct 30 22:17:05.536986 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.536914    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkbrp\" (UniqueName: \"kubernetes.io/projected/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-kube-api-access-vkbrp\") pod \"maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh\" (UID: \"7c23a18f-fe92-4259-84cf-0dca4a0c5f06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh"
Oct 30 22:17:05.565685 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.565655    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:17:05.565685 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.565676    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:17:05.565871 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.565724    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-crcdl\""
Oct 30 22:17:05.565871 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.565771    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:17:05.567052 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.567033    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh"]
Oct 30 22:17:05.638195 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.638164    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh\" (UID: \"7c23a18f-fe92-4259-84cf-0dca4a0c5f06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh"
Oct 30 22:17:05.638391 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.638209    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkbrp\" (UniqueName: \"kubernetes.io/projected/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-kube-api-access-vkbrp\") pod \"maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh\" (UID: \"7c23a18f-fe92-4259-84cf-0dca4a0c5f06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh"
Oct 30 22:17:05.638391 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.638310    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh\" (UID: \"7c23a18f-fe92-4259-84cf-0dca4a0c5f06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh"
Oct 30 22:17:05.638987 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.638957    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh\" (UID: \"7c23a18f-fe92-4259-84cf-0dca4a0c5f06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh"
Oct 30 22:17:05.640572 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.640546    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh\" (UID: \"7c23a18f-fe92-4259-84cf-0dca4a0c5f06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh"
Oct 30 22:17:05.694474 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.694434    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkbrp\" (UniqueName: \"kubernetes.io/projected/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-kube-api-access-vkbrp\") pod \"maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh\" (UID: \"7c23a18f-fe92-4259-84cf-0dca4a0c5f06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh"
Oct 30 22:17:05.776552 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:05.776483    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh"
Oct 30 22:17:06.155186 ip-10-0-142-237 kubenswrapper[4522]: W1030 22:17:06.155158    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c23a18f_fe92_4259_84cf_0dca4a0c5f06.slice/crio-d64cdb582818f49592caa5ed124a82272b9b67177b42158a12cfa794e2b3060a WatchSource:0}: Error finding container d64cdb582818f49592caa5ed124a82272b9b67177b42158a12cfa794e2b3060a: Status 404 returned error can't find the container with id d64cdb582818f49592caa5ed124a82272b9b67177b42158a12cfa794e2b3060a
Oct 30 22:17:06.155417 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:06.155396    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh"]
Oct 30 22:17:06.960184 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:06.960152    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh" event={"ID":"7c23a18f-fe92-4259-84cf-0dca4a0c5f06","Type":"ContainerStarted","Data":"25c4c7dd2003f3d333bfcf6a7d48de6470c1ad31073068da0369977c18aaa0ea"}
Oct 30 22:17:06.960552 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:06.960204    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh" event={"ID":"7c23a18f-fe92-4259-84cf-0dca4a0c5f06","Type":"ContainerStarted","Data":"d64cdb582818f49592caa5ed124a82272b9b67177b42158a12cfa794e2b3060a"}
Oct 30 22:17:07.061853 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:07.061816    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:07.969348 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:07.969311    4522 generic.go:356] "Generic (PLEG): container finished" podID="7c23a18f-fe92-4259-84cf-0dca4a0c5f06" containerID="25c4c7dd2003f3d333bfcf6a7d48de6470c1ad31073068da0369977c18aaa0ea" exitCode=0
Oct 30 22:17:07.969766 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:07.969389    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh" event={"ID":"7c23a18f-fe92-4259-84cf-0dca4a0c5f06","Type":"ContainerDied","Data":"25c4c7dd2003f3d333bfcf6a7d48de6470c1ad31073068da0369977c18aaa0ea"}
Oct 30 22:17:07.988802 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:17:07.988765    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:17:08.094082 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:08.094059    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh"
Oct 30 22:17:08.163021 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:08.162985    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-maas-api-xks-ca\") pod \"7c23a18f-fe92-4259-84cf-0dca4a0c5f06\" (UID: \"7c23a18f-fe92-4259-84cf-0dca4a0c5f06\") "
Oct 30 22:17:08.163163 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:08.163117    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-maas-api-openshift-ca\") pod \"7c23a18f-fe92-4259-84cf-0dca4a0c5f06\" (UID: \"7c23a18f-fe92-4259-84cf-0dca4a0c5f06\") "
Oct 30 22:17:08.163163 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:08.163142    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-kube-api-access-vkbrp\" (UniqueName: \"kubernetes.io/projected/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-kube-api-access-vkbrp\") pod \"7c23a18f-fe92-4259-84cf-0dca4a0c5f06\" (UID: \"7c23a18f-fe92-4259-84cf-0dca4a0c5f06\") "
Oct 30 22:17:08.163497 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:08.163439    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-maas-api-openshift-ca" pod "7c23a18f-fe92-4259-84cf-0dca4a0c5f06" (UID: "7c23a18f-fe92-4259-84cf-0dca4a0c5f06"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:17:08.165032 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:08.165011    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-kube-api-access-vkbrp" pod "7c23a18f-fe92-4259-84cf-0dca4a0c5f06" (UID: "7c23a18f-fe92-4259-84cf-0dca4a0c5f06"). InnerVolumeSpecName "kube-api-access-vkbrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:17:08.165102 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:08.165033    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-maas-api-xks-ca" pod "7c23a18f-fe92-4259-84cf-0dca4a0c5f06" (UID: "7c23a18f-fe92-4259-84cf-0dca4a0c5f06"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:17:08.264270 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:08.264193    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkbrp\" (UniqueName: \"kubernetes.io/projected/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-kube-api-access-vkbrp\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:08.264270 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:08.264218    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-maas-api-xks-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:08.264270 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:08.264231    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7c23a18f-fe92-4259-84cf-0dca4a0c5f06-maas-api-openshift-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:08.974432 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:08.974400    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh"
Oct 30 22:17:08.974952 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:08.974429    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh" event={"ID":"7c23a18f-fe92-4259-84cf-0dca4a0c5f06","Type":"ContainerDied","Data":"d64cdb582818f49592caa5ed124a82272b9b67177b42158a12cfa794e2b3060a"}
Oct 30 22:17:08.974952 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:08.974490    4522 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d64cdb582818f49592caa5ed124a82272b9b67177b42158a12cfa794e2b3060a"
Oct 30 22:17:12.278759 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:12.278722    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:17.099369 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:17.099329    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:17.407492 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:17.407370    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:17.614168 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:17.614135    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:26.392715 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:26.392680    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:27.885979 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:27.885946    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:28.178992 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:28.178948    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:28.466386 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:28.466300    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh"]
Oct 30 22:17:28.515431 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:28.515389    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6e7187-9l7dh"]
Oct 30 22:17:28.939333 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:28.939302    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:29.190572 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:29.190491    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7c23a18f-fe92-4259-84cf-0dca4a0c5f06" path="/var/lib/kubelet/pods/7c23a18f-fe92-4259-84cf-0dca4a0c5f06/volumes"
Oct 30 22:17:31.123775 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:31.123743    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:17:35.482526 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:35.482454    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:35.677879 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:35.677841    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:35.875000 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:35.874917    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:37.987734 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:17:37.987698    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:17:38.769028 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:38.768997    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:50.627726 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:17:50.627687    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:18:01.908534 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:01.908497    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:18:07.986308 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:18:07.986273    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:18:09.955838 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:09.955805    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62"]
Oct 30 22:18:09.956207 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:09.956124    4522 cpu_manager.go:414] "containerMap: removing container" podUID="7c23a18f-fe92-4259-84cf-0dca4a0c5f06" containerName="revoke-keys"
Oct 30 22:18:09.956207 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:09.956136    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7c23a18f-fe92-4259-84cf-0dca4a0c5f06" containerName="revoke-keys"
Oct 30 22:18:09.956282 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:09.956209    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="7c23a18f-fe92-4259-84cf-0dca4a0c5f06" containerName="revoke-keys"
Oct 30 22:18:09.956282 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:09.956220    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="b01f59a5-1952-4b6c-9d40-878aa99bc14e" containerName="cleanup"
Oct 30 22:18:09.959091 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:09.959074    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62"
Oct 30 22:18:10.010995 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:10.010972    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:18:10.011109 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:10.011018    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:18:10.041521 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:10.041483    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k8vb\" (UniqueName: \"kubernetes.io/projected/feced3a4-3483-4937-bfb8-9928215db000-kube-api-access-5k8vb\") pod \"maas-api-revoke-sub-f03629db-2wm62\" (UID: \"feced3a4-3483-4937-bfb8-9928215db000\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62"
Oct 30 22:18:10.041648 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:10.041563    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/feced3a4-3483-4937-bfb8-9928215db000-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f03629db-2wm62\" (UID: \"feced3a4-3483-4937-bfb8-9928215db000\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62"
Oct 30 22:18:10.041648 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:10.041595    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/feced3a4-3483-4937-bfb8-9928215db000-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f03629db-2wm62\" (UID: \"feced3a4-3483-4937-bfb8-9928215db000\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62"
Oct 30 22:18:10.060300 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:10.060274    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:18:10.060396 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:10.060333    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-crcdl\""
Oct 30 22:18:10.061646 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:10.061629    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62"]
Oct 30 22:18:10.142128 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:10.142090    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k8vb\" (UniqueName: \"kubernetes.io/projected/feced3a4-3483-4937-bfb8-9928215db000-kube-api-access-5k8vb\") pod \"maas-api-revoke-sub-f03629db-2wm62\" (UID: \"feced3a4-3483-4937-bfb8-9928215db000\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62"
Oct 30 22:18:10.142309 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:10.142164    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/feced3a4-3483-4937-bfb8-9928215db000-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f03629db-2wm62\" (UID: \"feced3a4-3483-4937-bfb8-9928215db000\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62"
Oct 30 22:18:10.142309 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:10.142192    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/feced3a4-3483-4937-bfb8-9928215db000-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f03629db-2wm62\" (UID: \"feced3a4-3483-4937-bfb8-9928215db000\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62"
Oct 30 22:18:10.142966 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:10.142942    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/feced3a4-3483-4937-bfb8-9928215db000-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f03629db-2wm62\" (UID: \"feced3a4-3483-4937-bfb8-9928215db000\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62"
Oct 30 22:18:10.144477 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:10.144449    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/feced3a4-3483-4937-bfb8-9928215db000-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f03629db-2wm62\" (UID: \"feced3a4-3483-4937-bfb8-9928215db000\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62"
Oct 30 22:18:10.198469 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:10.198436    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k8vb\" (UniqueName: \"kubernetes.io/projected/feced3a4-3483-4937-bfb8-9928215db000-kube-api-access-5k8vb\") pod \"maas-api-revoke-sub-f03629db-2wm62\" (UID: \"feced3a4-3483-4937-bfb8-9928215db000\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62"
Oct 30 22:18:10.271190 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:10.271104    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62"
Oct 30 22:18:10.641048 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:10.640956    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62"]
Oct 30 22:18:10.645287 ip-10-0-142-237 kubenswrapper[4522]: W1030 22:18:10.645257    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeced3a4_3483_4937_bfb8_9928215db000.slice/crio-9cd026d4a2d1617e038c5dc93005541fa0c17044366b0817b996943142e2c1de WatchSource:0}: Error finding container 9cd026d4a2d1617e038c5dc93005541fa0c17044366b0817b996943142e2c1de: Status 404 returned error can't find the container with id 9cd026d4a2d1617e038c5dc93005541fa0c17044366b0817b996943142e2c1de
Oct 30 22:18:11.278708 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:11.278668    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62" event={"ID":"feced3a4-3483-4937-bfb8-9928215db000","Type":"ContainerStarted","Data":"97d45861f3bf37bc06d3c45bcf8e9a0a2219326ea805faf1489ed551ff91cc43"}
Oct 30 22:18:11.279156 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:11.278746    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62" event={"ID":"feced3a4-3483-4937-bfb8-9928215db000","Type":"ContainerStarted","Data":"9cd026d4a2d1617e038c5dc93005541fa0c17044366b0817b996943142e2c1de"}
Oct 30 22:18:11.393704 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:11.393655    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62" podStartSLOduration=2.393639674 podStartE2EDuration="2.393639674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:18:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:18:11.392676059 +0000 UTC m=+4000.337621420" watchObservedRunningTime="2026-10-30 22:18:11.393639674 +0000 UTC m=+4000.338585033"
Oct 30 22:18:12.284302 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:12.284267    4522 generic.go:356] "Generic (PLEG): container finished" podID="feced3a4-3483-4937-bfb8-9928215db000" containerID="97d45861f3bf37bc06d3c45bcf8e9a0a2219326ea805faf1489ed551ff91cc43" exitCode=0
Oct 30 22:18:12.284692 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:12.284313    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62" event={"ID":"feced3a4-3483-4937-bfb8-9928215db000","Type":"ContainerDied","Data":"97d45861f3bf37bc06d3c45bcf8e9a0a2219326ea805faf1489ed551ff91cc43"}
Oct 30 22:18:13.412876 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:13.412852    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62"
Oct 30 22:18:13.473582 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:13.473528    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/feced3a4-3483-4937-bfb8-9928215db000-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/feced3a4-3483-4937-bfb8-9928215db000-maas-api-openshift-ca\") pod \"feced3a4-3483-4937-bfb8-9928215db000\" (UID: \"feced3a4-3483-4937-bfb8-9928215db000\") "
Oct 30 22:18:13.473582 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:13.473577    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/feced3a4-3483-4937-bfb8-9928215db000-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/feced3a4-3483-4937-bfb8-9928215db000-maas-api-xks-ca\") pod \"feced3a4-3483-4937-bfb8-9928215db000\" (UID: \"feced3a4-3483-4937-bfb8-9928215db000\") "
Oct 30 22:18:13.473736 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:13.473691    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/feced3a4-3483-4937-bfb8-9928215db000-kube-api-access-5k8vb\" (UniqueName: \"kubernetes.io/projected/feced3a4-3483-4937-bfb8-9928215db000-kube-api-access-5k8vb\") pod \"feced3a4-3483-4937-bfb8-9928215db000\" (UID: \"feced3a4-3483-4937-bfb8-9928215db000\") "
Oct 30 22:18:13.473846 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:13.473824    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feced3a4-3483-4937-bfb8-9928215db000-maas-api-openshift-ca" pod "feced3a4-3483-4937-bfb8-9928215db000" (UID: "feced3a4-3483-4937-bfb8-9928215db000"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:18:13.475636 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:13.475617    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feced3a4-3483-4937-bfb8-9928215db000-kube-api-access-5k8vb" pod "feced3a4-3483-4937-bfb8-9928215db000" (UID: "feced3a4-3483-4937-bfb8-9928215db000"). InnerVolumeSpecName "kube-api-access-5k8vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:18:13.475730 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:13.475646    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/feced3a4-3483-4937-bfb8-9928215db000-maas-api-xks-ca" pod "feced3a4-3483-4937-bfb8-9928215db000" (UID: "feced3a4-3483-4937-bfb8-9928215db000"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:18:13.575281 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:13.575212    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k8vb\" (UniqueName: \"kubernetes.io/projected/feced3a4-3483-4937-bfb8-9928215db000-kube-api-access-5k8vb\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:18:13.575281 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:13.575240    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/feced3a4-3483-4937-bfb8-9928215db000-maas-api-openshift-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:18:13.575281 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:13.575249    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/feced3a4-3483-4937-bfb8-9928215db000-maas-api-xks-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:18:14.294419 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:14.294393    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62"
Oct 30 22:18:14.294419 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:14.294403    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62" event={"ID":"feced3a4-3483-4937-bfb8-9928215db000","Type":"ContainerDied","Data":"9cd026d4a2d1617e038c5dc93005541fa0c17044366b0817b996943142e2c1de"}
Oct 30 22:18:14.294636 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:14.294450    4522 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9cd026d4a2d1617e038c5dc93005541fa0c17044366b0817b996943142e2c1de"
Oct 30 22:18:14.421948 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:14.421915    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:22.746339 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:22.746300    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:18:30.086641 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:30.086590    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-xpsmc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:18:30.087161 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:30.086666    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc" podUID="81ba7cf9-cd64-464a-bc49-36eaec127105" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:30.765920 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:30.765882    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx"]
Oct 30 22:18:30.766223 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:30.766206    4522 cpu_manager.go:414] "containerMap: removing container" podUID="feced3a4-3483-4937-bfb8-9928215db000" containerName="revoke-keys"
Oct 30 22:18:30.766352 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:30.766223    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="feced3a4-3483-4937-bfb8-9928215db000" containerName="revoke-keys"
Oct 30 22:18:30.766352 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:30.766325    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="feced3a4-3483-4937-bfb8-9928215db000" containerName="revoke-keys"
Oct 30 22:18:30.769772 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:30.769752    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx"
Oct 30 22:18:30.870498 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:30.870449    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:18:30.870498 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:30.870472    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:18:30.870498 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:30.870494    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:18:30.870728 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:30.870529    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-crcdl\""
Oct 30 22:18:30.871946 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:30.871929    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx"]
Oct 30 22:18:30.962235 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:30.962205    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6af36994-cd99-4f2a-95a8-067e4421f093-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0165d7d2-p2gbx\" (UID: \"6af36994-cd99-4f2a-95a8-067e4421f093\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx"
Oct 30 22:18:30.962235 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:30.962238    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkv7c\" (UniqueName: \"kubernetes.io/projected/6af36994-cd99-4f2a-95a8-067e4421f093-kube-api-access-lkv7c\") pod \"maas-api-revoke-sub-0165d7d2-p2gbx\" (UID: \"6af36994-cd99-4f2a-95a8-067e4421f093\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx"
Oct 30 22:18:30.962413 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:30.962359    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6af36994-cd99-4f2a-95a8-067e4421f093-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0165d7d2-p2gbx\" (UID: \"6af36994-cd99-4f2a-95a8-067e4421f093\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx"
Oct 30 22:18:31.063393 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:31.063321    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6af36994-cd99-4f2a-95a8-067e4421f093-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0165d7d2-p2gbx\" (UID: \"6af36994-cd99-4f2a-95a8-067e4421f093\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx"
Oct 30 22:18:31.063393 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:31.063352    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkv7c\" (UniqueName: \"kubernetes.io/projected/6af36994-cd99-4f2a-95a8-067e4421f093-kube-api-access-lkv7c\") pod \"maas-api-revoke-sub-0165d7d2-p2gbx\" (UID: \"6af36994-cd99-4f2a-95a8-067e4421f093\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx"
Oct 30 22:18:31.063611 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:31.063413    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6af36994-cd99-4f2a-95a8-067e4421f093-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0165d7d2-p2gbx\" (UID: \"6af36994-cd99-4f2a-95a8-067e4421f093\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx"
Oct 30 22:18:31.064029 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:31.064005    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6af36994-cd99-4f2a-95a8-067e4421f093-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0165d7d2-p2gbx\" (UID: \"6af36994-cd99-4f2a-95a8-067e4421f093\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx"
Oct 30 22:18:31.065671 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:31.065648    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6af36994-cd99-4f2a-95a8-067e4421f093-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0165d7d2-p2gbx\" (UID: \"6af36994-cd99-4f2a-95a8-067e4421f093\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx"
Oct 30 22:18:31.123243 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:31.123212    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkv7c\" (UniqueName: \"kubernetes.io/projected/6af36994-cd99-4f2a-95a8-067e4421f093-kube-api-access-lkv7c\") pod \"maas-api-revoke-sub-0165d7d2-p2gbx\" (UID: \"6af36994-cd99-4f2a-95a8-067e4421f093\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx"
Oct 30 22:18:31.432762 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:31.432737    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-crcdl\""
Oct 30 22:18:31.442512 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:31.442484    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx"
Oct 30 22:18:31.809596 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:31.809525    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx"]
Oct 30 22:18:31.812946 ip-10-0-142-237 kubenswrapper[4522]: W1030 22:18:31.812920    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6af36994_cd99_4f2a_95a8_067e4421f093.slice/crio-663323c95a592171de7e21648871513a4fe9b5d15ab20c094165ff539770186b WatchSource:0}: Error finding container 663323c95a592171de7e21648871513a4fe9b5d15ab20c094165ff539770186b: Status 404 returned error can't find the container with id 663323c95a592171de7e21648871513a4fe9b5d15ab20c094165ff539770186b
Oct 30 22:18:32.371065 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:32.371031    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx" event={"ID":"6af36994-cd99-4f2a-95a8-067e4421f093","Type":"ContainerStarted","Data":"74a76203c81fc940ebd037d779e3535e8283ca59f5fe9fe7ed742b3dd02c2086"}
Oct 30 22:18:32.371440 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:32.371080    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx" event={"ID":"6af36994-cd99-4f2a-95a8-067e4421f093","Type":"ContainerStarted","Data":"663323c95a592171de7e21648871513a4fe9b5d15ab20c094165ff539770186b"}
Oct 30 22:18:32.485054 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:32.485003    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx" podStartSLOduration=2.484987507 podStartE2EDuration="2.484987507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:18:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:18:32.483699191 +0000 UTC m=+4021.428644552" watchObservedRunningTime="2026-10-30 22:18:32.484987507 +0000 UTC m=+4021.429932866"
Oct 30 22:18:33.383436 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:33.383400    4522 generic.go:356] "Generic (PLEG): container finished" podID="6af36994-cd99-4f2a-95a8-067e4421f093" containerID="74a76203c81fc940ebd037d779e3535e8283ca59f5fe9fe7ed742b3dd02c2086" exitCode=0
Oct 30 22:18:33.383809 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:33.383475    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx" event={"ID":"6af36994-cd99-4f2a-95a8-067e4421f093","Type":"ContainerDied","Data":"74a76203c81fc940ebd037d779e3535e8283ca59f5fe9fe7ed742b3dd02c2086"}
Oct 30 22:18:34.513913 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:34.513889    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx"
Oct 30 22:18:34.592828 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:34.592800    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6af36994-cd99-4f2a-95a8-067e4421f093-kube-api-access-lkv7c\" (UniqueName: \"kubernetes.io/projected/6af36994-cd99-4f2a-95a8-067e4421f093-kube-api-access-lkv7c\") pod \"6af36994-cd99-4f2a-95a8-067e4421f093\" (UID: \"6af36994-cd99-4f2a-95a8-067e4421f093\") "
Oct 30 22:18:34.592955 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:34.592868    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6af36994-cd99-4f2a-95a8-067e4421f093-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6af36994-cd99-4f2a-95a8-067e4421f093-maas-api-xks-ca\") pod \"6af36994-cd99-4f2a-95a8-067e4421f093\" (UID: \"6af36994-cd99-4f2a-95a8-067e4421f093\") "
Oct 30 22:18:34.592955 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:34.592927    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6af36994-cd99-4f2a-95a8-067e4421f093-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6af36994-cd99-4f2a-95a8-067e4421f093-maas-api-openshift-ca\") pod \"6af36994-cd99-4f2a-95a8-067e4421f093\" (UID: \"6af36994-cd99-4f2a-95a8-067e4421f093\") "
Oct 30 22:18:34.593281 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:34.593258    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6af36994-cd99-4f2a-95a8-067e4421f093-maas-api-openshift-ca" pod "6af36994-cd99-4f2a-95a8-067e4421f093" (UID: "6af36994-cd99-4f2a-95a8-067e4421f093"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:18:34.594856 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:34.594837    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6af36994-cd99-4f2a-95a8-067e4421f093-kube-api-access-lkv7c" pod "6af36994-cd99-4f2a-95a8-067e4421f093" (UID: "6af36994-cd99-4f2a-95a8-067e4421f093"). InnerVolumeSpecName "kube-api-access-lkv7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:18:34.594943 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:34.594872    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6af36994-cd99-4f2a-95a8-067e4421f093-maas-api-xks-ca" pod "6af36994-cd99-4f2a-95a8-067e4421f093" (UID: "6af36994-cd99-4f2a-95a8-067e4421f093"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:18:34.693717 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:34.693682    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6af36994-cd99-4f2a-95a8-067e4421f093-maas-api-openshift-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:18:34.693717 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:34.693713    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkv7c\" (UniqueName: \"kubernetes.io/projected/6af36994-cd99-4f2a-95a8-067e4421f093-kube-api-access-lkv7c\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:18:34.693911 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:34.693723    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6af36994-cd99-4f2a-95a8-067e4421f093-maas-api-xks-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:18:35.393151 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:35.393119    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx" event={"ID":"6af36994-cd99-4f2a-95a8-067e4421f093","Type":"ContainerDied","Data":"663323c95a592171de7e21648871513a4fe9b5d15ab20c094165ff539770186b"}
Oct 30 22:18:35.393151 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:35.393144    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx"
Oct 30 22:18:35.393353 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:35.393172    4522 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="663323c95a592171de7e21648871513a4fe9b5d15ab20c094165ff539770186b"
Oct 30 22:18:37.987103 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:18:37.987070    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:18:39.089259 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:39.089227    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:42.477156 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:42.477122    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn"]
Oct 30 22:18:42.477568 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:42.477453    4522 cpu_manager.go:414] "containerMap: removing container" podUID="6af36994-cd99-4f2a-95a8-067e4421f093" containerName="revoke-keys"
Oct 30 22:18:42.477568 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:42.477480    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6af36994-cd99-4f2a-95a8-067e4421f093" containerName="revoke-keys"
Oct 30 22:18:42.477568 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:42.477539    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="6af36994-cd99-4f2a-95a8-067e4421f093" containerName="revoke-keys"
Oct 30 22:18:42.480347 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:42.480326    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn"
Oct 30 22:18:42.532189 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:42.532161    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:18:42.552946 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:42.552913    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnc2k\" (UniqueName: \"kubernetes.io/projected/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-kube-api-access-bnc2k\") pod \"maas-api-revoke-sub-6b19338f-s26bn\" (UID: \"fb3f6da8-296c-46cd-a94f-1f357dea7cfe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn"
Oct 30 22:18:42.553105 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:42.552960    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6b19338f-s26bn\" (UID: \"fb3f6da8-296c-46cd-a94f-1f357dea7cfe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn"
Oct 30 22:18:42.553171 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:42.553093    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6b19338f-s26bn\" (UID: \"fb3f6da8-296c-46cd-a94f-1f357dea7cfe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn"
Oct 30 22:18:42.581478 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:42.581439    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:18:42.581609 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:42.581494    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:18:42.581609 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:42.581507    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-crcdl\""
Oct 30 22:18:42.583144 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:42.583124    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn"]
Oct 30 22:18:42.653528 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:42.653500    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6b19338f-s26bn\" (UID: \"fb3f6da8-296c-46cd-a94f-1f357dea7cfe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn"
Oct 30 22:18:42.653660 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:42.653567    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6b19338f-s26bn\" (UID: \"fb3f6da8-296c-46cd-a94f-1f357dea7cfe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn"
Oct 30 22:18:42.653660 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:42.653607    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnc2k\" (UniqueName: \"kubernetes.io/projected/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-kube-api-access-bnc2k\") pod \"maas-api-revoke-sub-6b19338f-s26bn\" (UID: \"fb3f6da8-296c-46cd-a94f-1f357dea7cfe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn"
Oct 30 22:18:42.654259 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:42.654238    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6b19338f-s26bn\" (UID: \"fb3f6da8-296c-46cd-a94f-1f357dea7cfe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn"
Oct 30 22:18:42.655755 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:42.655733    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6b19338f-s26bn\" (UID: \"fb3f6da8-296c-46cd-a94f-1f357dea7cfe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn"
Oct 30 22:18:42.710050 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:42.710025    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnc2k\" (UniqueName: \"kubernetes.io/projected/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-kube-api-access-bnc2k\") pod \"maas-api-revoke-sub-6b19338f-s26bn\" (UID: \"fb3f6da8-296c-46cd-a94f-1f357dea7cfe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn"
Oct 30 22:18:42.792877 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:42.792804    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn"
Oct 30 22:18:43.160044 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:43.159962    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn"]
Oct 30 22:18:43.162953 ip-10-0-142-237 kubenswrapper[4522]: W1030 22:18:43.162923    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb3f6da8_296c_46cd_a94f_1f357dea7cfe.slice/crio-0a211a2b056952e163d1db487e0413b340f36d840a6cdffde5ac209fdc40b46b WatchSource:0}: Error finding container 0a211a2b056952e163d1db487e0413b340f36d840a6cdffde5ac209fdc40b46b: Status 404 returned error can't find the container with id 0a211a2b056952e163d1db487e0413b340f36d840a6cdffde5ac209fdc40b46b
Oct 30 22:18:43.425854 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:43.425827    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn" event={"ID":"fb3f6da8-296c-46cd-a94f-1f357dea7cfe","Type":"ContainerStarted","Data":"13c4daa5cd59b5bc3e53f7c4664574a5835306006b13e01f2ff8580610f33826"}
Oct 30 22:18:43.425958 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:43.425882    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn" event={"ID":"fb3f6da8-296c-46cd-a94f-1f357dea7cfe","Type":"ContainerStarted","Data":"0a211a2b056952e163d1db487e0413b340f36d840a6cdffde5ac209fdc40b46b"}
Oct 30 22:18:43.539641 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:43.539589    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn" podStartSLOduration=1.539576533 podStartE2EDuration="1.539576533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:18:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:18:43.539125396 +0000 UTC m=+4032.484070758" watchObservedRunningTime="2026-10-30 22:18:43.539576533 +0000 UTC m=+4032.484521893"
Oct 30 22:18:44.431911 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:44.431875    4522 generic.go:356] "Generic (PLEG): container finished" podID="fb3f6da8-296c-46cd-a94f-1f357dea7cfe" containerID="13c4daa5cd59b5bc3e53f7c4664574a5835306006b13e01f2ff8580610f33826" exitCode=0
Oct 30 22:18:44.432098 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:44.431967    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn" event={"ID":"fb3f6da8-296c-46cd-a94f-1f357dea7cfe","Type":"ContainerDied","Data":"13c4daa5cd59b5bc3e53f7c4664574a5835306006b13e01f2ff8580610f33826"}
Oct 30 22:18:45.563165 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:45.563141    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn"
Oct 30 22:18:45.580394 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:45.580371    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-maas-api-xks-ca\") pod \"fb3f6da8-296c-46cd-a94f-1f357dea7cfe\" (UID: \"fb3f6da8-296c-46cd-a94f-1f357dea7cfe\") "
Oct 30 22:18:45.580534 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:45.580422    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-maas-api-openshift-ca\") pod \"fb3f6da8-296c-46cd-a94f-1f357dea7cfe\" (UID: \"fb3f6da8-296c-46cd-a94f-1f357dea7cfe\") "
Oct 30 22:18:45.580534 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:45.580494    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-kube-api-access-bnc2k\" (UniqueName: \"kubernetes.io/projected/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-kube-api-access-bnc2k\") pod \"fb3f6da8-296c-46cd-a94f-1f357dea7cfe\" (UID: \"fb3f6da8-296c-46cd-a94f-1f357dea7cfe\") "
Oct 30 22:18:45.581251 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:45.581206    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-maas-api-openshift-ca" pod "fb3f6da8-296c-46cd-a94f-1f357dea7cfe" (UID: "fb3f6da8-296c-46cd-a94f-1f357dea7cfe"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:18:45.583171 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:45.583143    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-maas-api-xks-ca" pod "fb3f6da8-296c-46cd-a94f-1f357dea7cfe" (UID: "fb3f6da8-296c-46cd-a94f-1f357dea7cfe"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:18:45.583377 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:45.583343    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-kube-api-access-bnc2k" pod "fb3f6da8-296c-46cd-a94f-1f357dea7cfe" (UID: "fb3f6da8-296c-46cd-a94f-1f357dea7cfe"). InnerVolumeSpecName "kube-api-access-bnc2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:18:45.682025 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:45.681989    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-maas-api-openshift-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:18:45.682025 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:45.682022    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnc2k\" (UniqueName: \"kubernetes.io/projected/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-kube-api-access-bnc2k\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:18:45.682211 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:45.682063    4522 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fb3f6da8-296c-46cd-a94f-1f357dea7cfe-maas-api-xks-ca\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:18:46.441811 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:46.441770    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn" event={"ID":"fb3f6da8-296c-46cd-a94f-1f357dea7cfe","Type":"ContainerDied","Data":"0a211a2b056952e163d1db487e0413b340f36d840a6cdffde5ac209fdc40b46b"}
Oct 30 22:18:46.441975 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:46.441827    4522 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a211a2b056952e163d1db487e0413b340f36d840a6cdffde5ac209fdc40b46b"
Oct 30 22:18:46.441975 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:46.441787    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn"
Oct 30 22:18:55.338557 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:18:55.338521    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vpk6s"]
Oct 30 22:19:06.642846 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:19:06.642805    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:07.987546 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:19:07.987510    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:19:22.441761 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:19:22.441707    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:36.671784 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:19:36.671753    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-85kvs_eedac110-0230-4206-a0da-baef13d54fbe/manager/0.log"
Oct 30 22:19:37.987286 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:19:37.987249    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:19:38.173820 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:19:38.173785    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-r7n5t_32a19305-ede1-481d-a456-4bee53be8a3e/proxy/0.log"
Oct 30 22:19:39.433439 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:19:39.433403    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:39.788748 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:19:39.788662    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-0165d7d2-p2gbx_6af36994-cd99-4f2a-95a8-067e4421f093/revoke-keys/0.log"
Oct 30 22:19:40.005520 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:19:40.005489    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-6b19338f-s26bn_fb3f6da8-296c-46cd-a94f-1f357dea7cfe/revoke-keys/0.log"
Oct 30 22:19:40.147543 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:19:40.147437    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:40.240903 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:19:40.240872    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-f03629db-2wm62_feced3a4-3483-4937-bfb8-9928215db000/revoke-keys/0.log"
Oct 30 22:19:40.822506 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:19:40.822452    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:51.484239 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:19:51.484115    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:52.412323 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:19:52.412287    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:52.976317 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:19:52.976289    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-jbzwc_3bd9a54f-808e-4306-804a-fb1d899bf32f/kuadrant-console-plugin/0.log"
Oct 30 22:19:53.613877 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:19:53.613846    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-vpk6s_aeb594b9-93a8-4065-9295-68e278f7e83f/limitador/0.log"
Oct 30 22:20:01.516664 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:01.516583    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:01.813263 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:01.813130    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:05.522005 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:05.521975    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55c8944d49-zpwlv_b7566874-33cb-47cf-a623-93e32673e869/kube-auth-proxy/0.log"
Oct 30 22:20:06.595222 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:06.595190    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-8vhtw_a71a4dcb-4c6d-4846-a804-69032ee0c726/istio-proxy/0.log"
Oct 30 22:20:06.827018 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:06.826986    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-hdwzw_e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d/istio-proxy/0.log"
Oct 30 22:20:07.677645 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:07.677615    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-xpsmc_81ba7cf9-cd64-464a-bc49-36eaec127105/istio-proxy/0.log"
Oct 30 22:20:07.987226 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:20:07.987138    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:20:33.343477 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:33.343433    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-85kvs_eedac110-0230-4206-a0da-baef13d54fbe/manager/0.log"
Oct 30 22:20:34.704298 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:34.704259    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-r7n5t_32a19305-ede1-481d-a456-4bee53be8a3e/proxy/0.log"
Oct 30 22:20:35.771626 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:35.771582    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:35.798160 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:35.798132    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-0165d7d2-p2gbx_6af36994-cd99-4f2a-95a8-067e4421f093/revoke-keys/0.log"
Oct 30 22:20:35.969180 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:35.969142    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:36.030528 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:36.030424    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-6b19338f-s26bn_fb3f6da8-296c-46cd-a94f-1f357dea7cfe/revoke-keys/0.log"
Oct 30 22:20:36.252617 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:36.252588    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-f03629db-2wm62_feced3a4-3483-4937-bfb8-9928215db000/revoke-keys/0.log"
Oct 30 22:20:37.986121 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:20:37.986090    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:20:38.699297 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:38.699271    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-jbzwc_3bd9a54f-808e-4306-804a-fb1d899bf32f/kuadrant-console-plugin/0.log"
Oct 30 22:20:39.267056 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:39.267028    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-vpk6s_aeb594b9-93a8-4065-9295-68e278f7e83f/limitador/0.log"
Oct 30 22:20:39.741517 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:39.741447    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:40.990490 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:40.990446    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55c8944d49-zpwlv_b7566874-33cb-47cf-a623-93e32673e869/kube-auth-proxy/0.log"
Oct 30 22:20:41.963505 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:41.963468    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-8vhtw_a71a4dcb-4c6d-4846-a804-69032ee0c726/istio-proxy/0.log"
Oct 30 22:20:42.176946 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:42.176902    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-hdwzw_e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d/istio-proxy/0.log"
Oct 30 22:20:42.995294 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:42.995267    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-xpsmc_81ba7cf9-cd64-464a-bc49-36eaec127105/istio-proxy/0.log"
Oct 30 22:20:59.649239 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:20:59.649195    4522 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal" podUID="f52de7228915512f349d24482d38315b" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:21:04.823201 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:21:04.823154    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:07.986730 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:21:07.986695    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:21:32.018185 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:21:32.018154    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 22:21:32.020805 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:21:32.020376    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8vk2q_886735ce-b78e-4b99-898d-35d295a1b059/ovn-acl-logging/0.log"
Oct 30 22:21:32.087173 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:21:32.087144    4522 scope.go:122] "RemoveContainer" containerID="20433d4ab251a3881446da2e7a3a1d72ee05960ca71f54f741827f58710f6083"
Oct 30 22:21:37.986186 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:21:37.986148    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:21:40.086995 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:21:40.086962    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:07.987589 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:22:07.987551    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:22:37.986684 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:22:37.986650    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:22:40.511169 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:22:40.511140    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:58.526560 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:22:58.526426    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:58.736132 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:22:58.736099    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:04.385853 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:04.385816    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:07.487862 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:07.487824    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6gs88_de7df116-a968-473a-85b7-cd508eb8edc5/global-pull-secret-syncer/0.log"
Oct 30 22:23:07.987514 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:23:07.987478    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:23:10.579640 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:10.579613    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log"
Oct 30 22:23:12.814659 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:12.814632    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-237.us-west-1.compute.internal_f52de7228915512f349d24482d38315b/haproxy/0.log"
Oct 30 22:23:14.069018 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:14.068983    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62"]
Oct 30 22:23:14.118095 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:14.118064    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-2wm62"]
Oct 30 22:23:15.192855 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:15.192818    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="feced3a4-3483-4937-bfb8-9928215db000" path="/var/lib/kubelet/pods/feced3a4-3483-4937-bfb8-9928215db000/volumes"
Oct 30 22:23:28.572578 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:28.572551    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-jbzwc_3bd9a54f-808e-4306-804a-fb1d899bf32f/kuadrant-console-plugin/0.log"
Oct 30 22:23:29.410965 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:29.410931    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-vpk6s_aeb594b9-93a8-4065-9295-68e278f7e83f/limitador/0.log"
Oct 30 22:23:32.109040 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:32.109012    4522 scope.go:122] "RemoveContainer" containerID="25c4c7dd2003f3d333bfcf6a7d48de6470c1ad31073068da0369977c18aaa0ea"
Oct 30 22:23:34.048259 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:34.048226    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx"]
Oct 30 22:23:34.097155 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:34.097130    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-p2gbx"]
Oct 30 22:23:35.190957 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:35.190923    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6af36994-cd99-4f2a-95a8-067e4421f093" path="/var/lib/kubelet/pods/6af36994-cd99-4f2a-95a8-067e4421f093/volumes"
Oct 30 22:23:37.285018 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.284987    4522 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"]
Oct 30 22:23:37.285409 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.285301    4522 cpu_manager.go:414] "containerMap: removing container" podUID="fb3f6da8-296c-46cd-a94f-1f357dea7cfe" containerName="revoke-keys"
Oct 30 22:23:37.285409 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.285311    4522 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fb3f6da8-296c-46cd-a94f-1f357dea7cfe" containerName="revoke-keys"
Oct 30 22:23:37.285409 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.285383    4522 memory_manager.go:365] "RemoveStaleState removing state" podUID="fb3f6da8-296c-46cd-a94f-1f357dea7cfe" containerName="revoke-keys"
Oct 30 22:23:37.289632 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.289614    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"
Oct 30 22:23:37.312385 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.312367    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3b2d65f-d127-4a8f-b21b-e87a8db52df2-lib-modules\") pod \"perf-node-gather-daemonset-z6nkp\" (UID: \"c3b2d65f-d127-4a8f-b21b-e87a8db52df2\") " pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"
Oct 30 22:23:37.312478 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.312406    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn52h\" (UniqueName: \"kubernetes.io/projected/c3b2d65f-d127-4a8f-b21b-e87a8db52df2-kube-api-access-xn52h\") pod \"perf-node-gather-daemonset-z6nkp\" (UID: \"c3b2d65f-d127-4a8f-b21b-e87a8db52df2\") " pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"
Oct 30 22:23:37.312478 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.312426    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3b2d65f-d127-4a8f-b21b-e87a8db52df2-proc\") pod \"perf-node-gather-daemonset-z6nkp\" (UID: \"c3b2d65f-d127-4a8f-b21b-e87a8db52df2\") " pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"
Oct 30 22:23:37.312553 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.312521    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3b2d65f-d127-4a8f-b21b-e87a8db52df2-sys\") pod \"perf-node-gather-daemonset-z6nkp\" (UID: \"c3b2d65f-d127-4a8f-b21b-e87a8db52df2\") " pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"
Oct 30 22:23:37.312553 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.312539    4522 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3b2d65f-d127-4a8f-b21b-e87a8db52df2-podres\") pod \"perf-node-gather-daemonset-z6nkp\" (UID: \"c3b2d65f-d127-4a8f-b21b-e87a8db52df2\") " pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"
Oct 30 22:23:37.391086 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.391043    4522 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pfnpp\"/\"default-dockercfg-k28w6\""
Oct 30 22:23:37.391086 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.391039    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pfnpp\"/\"openshift-service-ca.crt\""
Oct 30 22:23:37.391086 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.391064    4522 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pfnpp\"/\"kube-root-ca.crt\""
Oct 30 22:23:37.392541 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.392518    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"]
Oct 30 22:23:37.413719 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.413695    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3b2d65f-d127-4a8f-b21b-e87a8db52df2-lib-modules\") pod \"perf-node-gather-daemonset-z6nkp\" (UID: \"c3b2d65f-d127-4a8f-b21b-e87a8db52df2\") " pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"
Oct 30 22:23:37.413823 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.413740    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn52h\" (UniqueName: \"kubernetes.io/projected/c3b2d65f-d127-4a8f-b21b-e87a8db52df2-kube-api-access-xn52h\") pod \"perf-node-gather-daemonset-z6nkp\" (UID: \"c3b2d65f-d127-4a8f-b21b-e87a8db52df2\") " pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"
Oct 30 22:23:37.413863 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.413827    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3b2d65f-d127-4a8f-b21b-e87a8db52df2-lib-modules\") pod \"perf-node-gather-daemonset-z6nkp\" (UID: \"c3b2d65f-d127-4a8f-b21b-e87a8db52df2\") " pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"
Oct 30 22:23:37.413863 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.413843    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3b2d65f-d127-4a8f-b21b-e87a8db52df2-proc\") pod \"perf-node-gather-daemonset-z6nkp\" (UID: \"c3b2d65f-d127-4a8f-b21b-e87a8db52df2\") " pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"
Oct 30 22:23:37.413928 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.413877    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3b2d65f-d127-4a8f-b21b-e87a8db52df2-proc\") pod \"perf-node-gather-daemonset-z6nkp\" (UID: \"c3b2d65f-d127-4a8f-b21b-e87a8db52df2\") " pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"
Oct 30 22:23:37.413928 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.413886    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3b2d65f-d127-4a8f-b21b-e87a8db52df2-sys\") pod \"perf-node-gather-daemonset-z6nkp\" (UID: \"c3b2d65f-d127-4a8f-b21b-e87a8db52df2\") " pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"
Oct 30 22:23:37.413928 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.413916    4522 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3b2d65f-d127-4a8f-b21b-e87a8db52df2-podres\") pod \"perf-node-gather-daemonset-z6nkp\" (UID: \"c3b2d65f-d127-4a8f-b21b-e87a8db52df2\") " pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"
Oct 30 22:23:37.414026 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.413972    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3b2d65f-d127-4a8f-b21b-e87a8db52df2-sys\") pod \"perf-node-gather-daemonset-z6nkp\" (UID: \"c3b2d65f-d127-4a8f-b21b-e87a8db52df2\") " pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"
Oct 30 22:23:37.414069 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.414022    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3b2d65f-d127-4a8f-b21b-e87a8db52df2-podres\") pod \"perf-node-gather-daemonset-z6nkp\" (UID: \"c3b2d65f-d127-4a8f-b21b-e87a8db52df2\") " pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"
Oct 30 22:23:37.480318 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.480298    4522 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn52h\" (UniqueName: \"kubernetes.io/projected/c3b2d65f-d127-4a8f-b21b-e87a8db52df2-kube-api-access-xn52h\") pod \"perf-node-gather-daemonset-z6nkp\" (UID: \"c3b2d65f-d127-4a8f-b21b-e87a8db52df2\") " pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"
Oct 30 22:23:37.601485 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.601413    4522 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"
Oct 30 22:23:37.971376 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:37.971255    4522 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"]
Oct 30 22:23:37.973895 ip-10-0-142-237 kubenswrapper[4522]: W1030 22:23:37.973849    4522 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc3b2d65f_d127_4a8f_b21b_e87a8db52df2.slice/crio-fccdad1ed6db8291ea468a4cc163af2079bef83e5e16584afa166173faf890d0 WatchSource:0}: Error finding container fccdad1ed6db8291ea468a4cc163af2079bef83e5e16584afa166173faf890d0: Status 404 returned error can't find the container with id fccdad1ed6db8291ea468a4cc163af2079bef83e5e16584afa166173faf890d0
Oct 30 22:23:37.995490 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:23:37.995440    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:23:38.615796 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:38.615765    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55c8944d49-zpwlv_b7566874-33cb-47cf-a623-93e32673e869/kube-auth-proxy/0.log"
Oct 30 22:23:38.643417 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:38.643386    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp" event={"ID":"c3b2d65f-d127-4a8f-b21b-e87a8db52df2","Type":"ContainerStarted","Data":"63208a7d1448ef6c84ba4eb02f3582ca0e96b8471ce2a6258a766bd8613e647f"}
Oct 30 22:23:38.643570 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:38.643433    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp" event={"ID":"c3b2d65f-d127-4a8f-b21b-e87a8db52df2","Type":"ContainerStarted","Data":"fccdad1ed6db8291ea468a4cc163af2079bef83e5e16584afa166173faf890d0"}
Oct 30 22:23:38.643570 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:38.643528    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"
Oct 30 22:23:38.756495 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:38.756435    4522 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp" podStartSLOduration=1.7564230379999999 podStartE2EDuration="1.756423038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:23:38.755798338 +0000 UTC m=+4327.700743698" watchObservedRunningTime="2026-10-30 22:23:38.756423038 +0000 UTC m=+4327.701368398"
Oct 30 22:23:39.129247 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:39.129212    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qcvr5_2cdd0ed9-ecee-414f-b054-48803997e5d0/node-exporter/0.log"
Oct 30 22:23:39.466215 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:39.466189    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-8vhtw_a71a4dcb-4c6d-4846-a804-69032ee0c726/istio-proxy/0.log"
Oct 30 22:23:39.541739 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:39.541712    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qcvr5_2cdd0ed9-ecee-414f-b054-48803997e5d0/kube-rbac-proxy/0.log"
Oct 30 22:23:39.678545 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:39.678512    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-hdwzw_e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d/istio-proxy/0.log"
Oct 30 22:23:39.955256 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:39.955232    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qcvr5_2cdd0ed9-ecee-414f-b054-48803997e5d0/init-textfile/0.log"
Oct 30 22:23:40.318312 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:40.318235    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-xpsmc_81ba7cf9-cd64-464a-bc49-36eaec127105/istio-proxy/0.log"
Oct 30 22:23:40.784420 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:40.784391    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:43.025723 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:43.025692    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83d86e94-68f3-407a-9ad8-c2291703c3c5/prometheus/0.log"
Oct 30 22:23:43.438091 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:43.438057    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83d86e94-68f3-407a-9ad8-c2291703c3c5/config-reloader/0.log"
Oct 30 22:23:43.850766 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:43.850696    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83d86e94-68f3-407a-9ad8-c2291703c3c5/thanos-sidecar/0.log"
Oct 30 22:23:44.263766 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:44.263636    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83d86e94-68f3-407a-9ad8-c2291703c3c5/kube-rbac-proxy-web/0.log"
Oct 30 22:23:44.657087 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:44.657019    4522 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pfnpp/perf-node-gather-daemonset-z6nkp"
Oct 30 22:23:44.684522 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:44.684499    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83d86e94-68f3-407a-9ad8-c2291703c3c5/kube-rbac-proxy/0.log"
Oct 30 22:23:45.099598 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:45.099572    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83d86e94-68f3-407a-9ad8-c2291703c3c5/kube-rbac-proxy-thanos/0.log"
Oct 30 22:23:45.514368 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:45.514344    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83d86e94-68f3-407a-9ad8-c2291703c3c5/init-config-reloader/0.log"
Oct 30 22:23:46.059796 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:46.059769    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn"]
Oct 30 22:23:46.108919 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:46.108891    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-s26bn"]
Oct 30 22:23:47.191324 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:47.191290    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fb3f6da8-296c-46cd-a94f-1f357dea7cfe" path="/var/lib/kubelet/pods/fb3f6da8-296c-46cd-a94f-1f357dea7cfe/volumes"
Oct 30 22:23:49.009540 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:49.009509    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55c8944d49-zpwlv_b7566874-33cb-47cf-a623-93e32673e869/kube-auth-proxy/0.log"
Oct 30 22:23:49.859164 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:49.859130    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-8vhtw_a71a4dcb-4c6d-4846-a804-69032ee0c726/istio-proxy/0.log"
Oct 30 22:23:50.070588 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:50.070559    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-hdwzw_e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d/istio-proxy/0.log"
Oct 30 22:23:50.722688 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:23:50.722657    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-xpsmc_81ba7cf9-cd64-464a-bc49-36eaec127105/istio-proxy/0.log"
Oct 30 22:24:07.215611 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:07.215582    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9nf28_b0855c11-d0dc-4d51-92a9-3913d9946069/dns/0.log"
Oct 30 22:24:07.635802 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:07.635729    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9nf28_b0855c11-d0dc-4d51-92a9-3913d9946069/kube-rbac-proxy/0.log"
Oct 30 22:24:07.986702 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:24:07.986670    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:24:10.134771 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:10.134741    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lzdr5_b0f88e16-68d7-49b8-b50a-29786cf11a17/dns-node-resolver/0.log"
Oct 30 22:24:13.311180 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:13.311152    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-57db9bb55b-2qbnr_acfadece-9a24-43a4-b4bb-dda4a5fa8501/registry/0.log"
Oct 30 22:24:13.861091 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:13.861062    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5548s_47c8f18e-4ca1-413e-b665-d4b4a51dcab4/node-ca/0.log"
Oct 30 22:24:19.328411 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:19.328371    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:22.610289 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:22.610259    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55c8944d49-zpwlv_b7566874-33cb-47cf-a623-93e32673e869/kube-auth-proxy/0.log"
Oct 30 22:24:24.291822 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:24.291791    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-8vhtw_a71a4dcb-4c6d-4846-a804-69032ee0c726/istio-proxy/0.log"
Oct 30 22:24:24.710539 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:24.710512    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-hdwzw_e1cfc868-9ea4-4c20-8b8b-d9311f2f0e5d/istio-proxy/0.log"
Oct 30 22:24:25.965153 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:25.965128    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-xpsmc_81ba7cf9-cd64-464a-bc49-36eaec127105/istio-proxy/0.log"
Oct 30 22:24:31.808331 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:31.808300    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cvjpd_45d347ba-b99f-402d-92e2-db767c723fab/serve-healthcheck-canary/0.log"
Oct 30 22:24:32.126209 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:32.126133    4522 scope.go:122] "RemoveContainer" containerID="74a76203c81fc940ebd037d779e3535e8283ca59f5fe9fe7ed742b3dd02c2086"
Oct 30 22:24:32.133713 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:32.133696    4522 scope.go:122] "RemoveContainer" containerID="97d45861f3bf37bc06d3c45bcf8e9a0a2219326ea805faf1489ed551ff91cc43"
Oct 30 22:24:32.432979 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:32.432953    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"]
Oct 30 22:24:32.433159 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:32.433139    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw" podUID="a71a4dcb-4c6d-4846-a804-69032ee0c726" containerName="istio-proxy" containerID="cri-o://60ade03221fa189a442acb5c5c8e00bdebf26eba7bacd396ba9e062437899906" gracePeriod=30
Oct 30 22:24:32.482151 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:32.482117    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"]
Oct 30 22:24:32.482360 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:32.482322    4522 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc" podUID="81ba7cf9-cd64-464a-bc49-36eaec127105" containerName="istio-proxy" containerID="cri-o://d250af69f518d2ffebd5efe8102805b4467beb9d5141d6bee877ee5817429901" gracePeriod=30
Oct 30 22:24:34.373535 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:34.373501    4522 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-8vhtw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:24:34.373989 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:34.373569    4522 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw" podUID="a71a4dcb-4c6d-4846-a804-69032ee0c726" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:24:36.806067 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:36.806038    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p9vq8_6de535fe-3a22-40e2-9a24-86fcc6292b0f/kube-rbac-proxy/0.log"
Oct 30 22:24:37.219326 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.219300    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p9vq8_6de535fe-3a22-40e2-9a24-86fcc6292b0f/exporter/0.log"
Oct 30 22:24:37.632981 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.632917    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p9vq8_6de535fe-3a22-40e2-9a24-86fcc6292b0f/extractor/0.log"
Oct 30 22:24:37.710416 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.710397    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 22:24:37.738932 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.738914    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 22:24:37.790204 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.790159    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-envoy\") pod \"a71a4dcb-4c6d-4846-a804-69032ee0c726\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") "
Oct 30 22:24:37.790204 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.790187    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-data\") pod \"a71a4dcb-4c6d-4846-a804-69032ee0c726\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") "
Oct 30 22:24:37.790204 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.790208    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a71a4dcb-4c6d-4846-a804-69032ee0c726-kube-api-access-kgtmj\" (UniqueName: \"kubernetes.io/projected/a71a4dcb-4c6d-4846-a804-69032ee0c726-kube-api-access-kgtmj\") pod \"a71a4dcb-4c6d-4846-a804-69032ee0c726\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") "
Oct 30 22:24:37.790429 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.790226    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-podinfo\") pod \"81ba7cf9-cd64-464a-bc49-36eaec127105\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") "
Oct 30 22:24:37.790429 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.790255    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-data\") pod \"81ba7cf9-cd64-464a-bc49-36eaec127105\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") "
Oct 30 22:24:37.790429 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.790303    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-workload-socket\") pod \"a71a4dcb-4c6d-4846-a804-69032ee0c726\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") "
Oct 30 22:24:37.790607 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.790473    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-data" pod "a71a4dcb-4c6d-4846-a804-69032ee0c726" (UID: "a71a4dcb-4c6d-4846-a804-69032ee0c726"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:37.790607 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.790598    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-workload-socket" pod "a71a4dcb-4c6d-4846-a804-69032ee0c726" (UID: "a71a4dcb-4c6d-4846-a804-69032ee0c726"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:37.790712 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.790608    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a71a4dcb-4c6d-4846-a804-69032ee0c726-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a71a4dcb-4c6d-4846-a804-69032ee0c726-istiod-ca-cert\") pod \"a71a4dcb-4c6d-4846-a804-69032ee0c726\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") "
Oct 30 22:24:37.790712 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.790653    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-data" pod "81ba7cf9-cd64-464a-bc49-36eaec127105" (UID: "81ba7cf9-cd64-464a-bc49-36eaec127105"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:37.790712 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.790663    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-credential-socket\") pod \"81ba7cf9-cd64-464a-bc49-36eaec127105\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") "
Oct 30 22:24:37.790872 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.790739    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-token\" (UniqueName: \"kubernetes.io/projected/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-token\") pod \"a71a4dcb-4c6d-4846-a804-69032ee0c726\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") "
Oct 30 22:24:37.790872 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.790771    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-token\" (UniqueName: \"kubernetes.io/projected/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-token\") pod \"81ba7cf9-cd64-464a-bc49-36eaec127105\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") "
Oct 30 22:24:37.790872 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.790832    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-podinfo\") pod \"a71a4dcb-4c6d-4846-a804-69032ee0c726\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") "
Oct 30 22:24:37.790872 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.790861    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-credential-socket" pod "81ba7cf9-cd64-464a-bc49-36eaec127105" (UID: "81ba7cf9-cd64-464a-bc49-36eaec127105"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:37.791075 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.790864    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-workload-certs\") pod \"a71a4dcb-4c6d-4846-a804-69032ee0c726\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") "
Oct 30 22:24:37.791075 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.790929    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/81ba7cf9-cd64-464a-bc49-36eaec127105-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81ba7cf9-cd64-464a-bc49-36eaec127105-istiod-ca-cert\") pod \"81ba7cf9-cd64-464a-bc49-36eaec127105\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") "
Oct 30 22:24:37.791075 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.790964    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/81ba7cf9-cd64-464a-bc49-36eaec127105-kube-api-access-b9chd\" (UniqueName: \"kubernetes.io/projected/81ba7cf9-cd64-464a-bc49-36eaec127105-kube-api-access-b9chd\") pod \"81ba7cf9-cd64-464a-bc49-36eaec127105\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") "
Oct 30 22:24:37.791075 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.791033    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-envoy\") pod \"81ba7cf9-cd64-464a-bc49-36eaec127105\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") "
Oct 30 22:24:37.791292 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.791072    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-workload-certs" pod "a71a4dcb-4c6d-4846-a804-69032ee0c726" (UID: "a71a4dcb-4c6d-4846-a804-69032ee0c726"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:37.791292 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.791077    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-workload-socket\") pod \"81ba7cf9-cd64-464a-bc49-36eaec127105\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") "
Oct 30 22:24:37.791292 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.791090    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a71a4dcb-4c6d-4846-a804-69032ee0c726-istiod-ca-cert" pod "a71a4dcb-4c6d-4846-a804-69032ee0c726" (UID: "a71a4dcb-4c6d-4846-a804-69032ee0c726"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:37.791292 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.791124    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-workload-certs\") pod \"81ba7cf9-cd64-464a-bc49-36eaec127105\" (UID: \"81ba7cf9-cd64-464a-bc49-36eaec127105\") "
Oct 30 22:24:37.791292 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.791156    4522 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-credential-socket\") pod \"a71a4dcb-4c6d-4846-a804-69032ee0c726\" (UID: \"a71a4dcb-4c6d-4846-a804-69032ee0c726\") "
Oct 30 22:24:37.791292 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.791274    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-workload-socket" pod "81ba7cf9-cd64-464a-bc49-36eaec127105" (UID: "81ba7cf9-cd64-464a-bc49-36eaec127105"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:37.791626 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.791534    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:37.791626 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.791557    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:37.791626 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.791559    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81ba7cf9-cd64-464a-bc49-36eaec127105-istiod-ca-cert" pod "81ba7cf9-cd64-464a-bc49-36eaec127105" (UID: "81ba7cf9-cd64-464a-bc49-36eaec127105"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:37.791626 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.791573    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:37.791626 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.791587    4522 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-data\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:37.791626 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.791600    4522 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-workload-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:37.791626 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.791613    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a71a4dcb-4c6d-4846-a804-69032ee0c726-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:37.791626 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.791627    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:37.792039 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.791835    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-credential-socket" pod "a71a4dcb-4c6d-4846-a804-69032ee0c726" (UID: "a71a4dcb-4c6d-4846-a804-69032ee0c726"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:37.792148 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.792117    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-workload-certs" pod "81ba7cf9-cd64-464a-bc49-36eaec127105" (UID: "81ba7cf9-cd64-464a-bc49-36eaec127105"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:37.792647 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.792608    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-envoy" pod "a71a4dcb-4c6d-4846-a804-69032ee0c726" (UID: "a71a4dcb-4c6d-4846-a804-69032ee0c726"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:37.792965 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.792847    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-podinfo" pod "81ba7cf9-cd64-464a-bc49-36eaec127105" (UID: "81ba7cf9-cd64-464a-bc49-36eaec127105"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:24:37.792965 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.792935    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a71a4dcb-4c6d-4846-a804-69032ee0c726-kube-api-access-kgtmj" pod "a71a4dcb-4c6d-4846-a804-69032ee0c726" (UID: "a71a4dcb-4c6d-4846-a804-69032ee0c726"). InnerVolumeSpecName "kube-api-access-kgtmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:37.793238 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.793209    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-token" pod "81ba7cf9-cd64-464a-bc49-36eaec127105" (UID: "81ba7cf9-cd64-464a-bc49-36eaec127105"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:37.793429 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.793415    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-podinfo" pod "a71a4dcb-4c6d-4846-a804-69032ee0c726" (UID: "a71a4dcb-4c6d-4846-a804-69032ee0c726"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:24:37.793818 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.793801    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81ba7cf9-cd64-464a-bc49-36eaec127105-kube-api-access-b9chd" pod "81ba7cf9-cd64-464a-bc49-36eaec127105" (UID: "81ba7cf9-cd64-464a-bc49-36eaec127105"). InnerVolumeSpecName "kube-api-access-b9chd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:37.793904 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.793892    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-token" pod "a71a4dcb-4c6d-4846-a804-69032ee0c726" (UID: "a71a4dcb-4c6d-4846-a804-69032ee0c726"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:37.794134 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.794112    4522 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-envoy" pod "81ba7cf9-cd64-464a-bc49-36eaec127105" (UID: "81ba7cf9-cd64-464a-bc49-36eaec127105"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:37.886240 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.886210    4522 generic.go:356] "Generic (PLEG): container finished" podID="81ba7cf9-cd64-464a-bc49-36eaec127105" containerID="d250af69f518d2ffebd5efe8102805b4467beb9d5141d6bee877ee5817429901" exitCode=0
Oct 30 22:24:37.886600 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.886254    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"
Oct 30 22:24:37.886600 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.886301    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc" event={"ID":"81ba7cf9-cd64-464a-bc49-36eaec127105","Type":"ContainerDied","Data":"d250af69f518d2ffebd5efe8102805b4467beb9d5141d6bee877ee5817429901"}
Oct 30 22:24:37.886600 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.886356    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc" event={"ID":"81ba7cf9-cd64-464a-bc49-36eaec127105","Type":"ContainerDied","Data":"9d1713830f3a529538da5604bfa67d244884ad4a705a2b87e64aa29d57b336e7"}
Oct 30 22:24:37.886600 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.886385    4522 scope.go:122] "RemoveContainer" containerID="d250af69f518d2ffebd5efe8102805b4467beb9d5141d6bee877ee5817429901"
Oct 30 22:24:37.887885 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.887866    4522 generic.go:356] "Generic (PLEG): container finished" podID="a71a4dcb-4c6d-4846-a804-69032ee0c726" containerID="60ade03221fa189a442acb5c5c8e00bdebf26eba7bacd396ba9e062437899906" exitCode=0
Oct 30 22:24:37.887998 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.887902    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw" event={"ID":"a71a4dcb-4c6d-4846-a804-69032ee0c726","Type":"ContainerDied","Data":"60ade03221fa189a442acb5c5c8e00bdebf26eba7bacd396ba9e062437899906"}
Oct 30 22:24:37.887998 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.887920    4522 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"
Oct 30 22:24:37.887998 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.887936    4522 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw" event={"ID":"a71a4dcb-4c6d-4846-a804-69032ee0c726","Type":"ContainerDied","Data":"768be2cc6cb73ad77d3d367619cc650d842b63fe29c1d99773890120e80dd968"}
Oct 30 22:24:37.893450 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.893424    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:37.893561 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.893490    4522 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-token\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:37.893630 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.893554    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:37.893630 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.893585    4522 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81ba7cf9-cd64-464a-bc49-36eaec127105-istiod-ca-cert\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:37.893630 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.893604    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9chd\" (UniqueName: \"kubernetes.io/projected/81ba7cf9-cd64-464a-bc49-36eaec127105-kube-api-access-b9chd\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:37.893630 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.893621    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:37.893817 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.893644    4522 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81ba7cf9-cd64-464a-bc49-36eaec127105-workload-certs\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:37.893817 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.893660    4522 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-credential-socket\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:37.893817 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.893675    4522 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a71a4dcb-4c6d-4846-a804-69032ee0c726-istio-envoy\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:37.893817 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.893690    4522 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgtmj\" (UniqueName: \"kubernetes.io/projected/a71a4dcb-4c6d-4846-a804-69032ee0c726-kube-api-access-kgtmj\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:37.893817 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.893710    4522 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81ba7cf9-cd64-464a-bc49-36eaec127105-istio-podinfo\") on node \"ip-10-0-142-237.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:37.900141 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.896585    4522 scope.go:122] "RemoveContainer" containerID="d250af69f518d2ffebd5efe8102805b4467beb9d5141d6bee877ee5817429901"
Oct 30 22:24:37.900635 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:24:37.900433    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d250af69f518d2ffebd5efe8102805b4467beb9d5141d6bee877ee5817429901\": container with ID starting with d250af69f518d2ffebd5efe8102805b4467beb9d5141d6bee877ee5817429901 not found: ID does not exist" containerID="d250af69f518d2ffebd5efe8102805b4467beb9d5141d6bee877ee5817429901"
Oct 30 22:24:37.900635 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.900537    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d250af69f518d2ffebd5efe8102805b4467beb9d5141d6bee877ee5817429901"} err="failed to get container status \"d250af69f518d2ffebd5efe8102805b4467beb9d5141d6bee877ee5817429901\": rpc error: code = NotFound desc = could not find container \"d250af69f518d2ffebd5efe8102805b4467beb9d5141d6bee877ee5817429901\": container with ID starting with d250af69f518d2ffebd5efe8102805b4467beb9d5141d6bee877ee5817429901 not found: ID does not exist"
Oct 30 22:24:37.900635 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.900557    4522 scope.go:122] "RemoveContainer" containerID="60ade03221fa189a442acb5c5c8e00bdebf26eba7bacd396ba9e062437899906"
Oct 30 22:24:37.910663 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.910646    4522 scope.go:122] "RemoveContainer" containerID="60ade03221fa189a442acb5c5c8e00bdebf26eba7bacd396ba9e062437899906"
Oct 30 22:24:37.910916 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:24:37.910896    4522 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60ade03221fa189a442acb5c5c8e00bdebf26eba7bacd396ba9e062437899906\": container with ID starting with 60ade03221fa189a442acb5c5c8e00bdebf26eba7bacd396ba9e062437899906 not found: ID does not exist" containerID="60ade03221fa189a442acb5c5c8e00bdebf26eba7bacd396ba9e062437899906"
Oct 30 22:24:37.910968 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:37.910924    4522 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60ade03221fa189a442acb5c5c8e00bdebf26eba7bacd396ba9e062437899906"} err="failed to get container status \"60ade03221fa189a442acb5c5c8e00bdebf26eba7bacd396ba9e062437899906\": rpc error: code = NotFound desc = could not find container \"60ade03221fa189a442acb5c5c8e00bdebf26eba7bacd396ba9e062437899906\": container with ID starting with 60ade03221fa189a442acb5c5c8e00bdebf26eba7bacd396ba9e062437899906 not found: ID does not exist"
Oct 30 22:24:37.989706 ip-10-0-142-237 kubenswrapper[4522]: E1030 22:24:37.989671    4522 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-p9vq8" containerName="extractor"
Oct 30 22:24:38.059552 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:38.059485    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"]
Oct 30 22:24:38.068024 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:38.068002    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-xpsmc"]
Oct 30 22:24:38.175319 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:38.175295    4522 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"]
Oct 30 22:24:38.183051 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:38.183029    4522 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vhtw"]
Oct 30 22:24:39.190891 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:39.190859    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="81ba7cf9-cd64-464a-bc49-36eaec127105" path="/var/lib/kubelet/pods/81ba7cf9-cd64-464a-bc49-36eaec127105/volumes"
Oct 30 22:24:39.191278 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:39.191265    4522 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a71a4dcb-4c6d-4846-a804-69032ee0c726" path="/var/lib/kubelet/pods/a71a4dcb-4c6d-4846-a804-69032ee0c726/volumes"
Oct 30 22:24:41.109026 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:41.108984    4522 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ttsq4_6626e30d-3f05-406c-8ea5-5329ea58dd07/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:45.756216 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:45.756186    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-6c776cd74c-wpzsh_5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd/manager/0.log"
Oct 30 22:24:46.298870 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:46.298843    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-6c776cd74c-wpzsh_5f32d2b7-d5c3-4b13-8a80-fe8cc978a7cd/copy-manifests/0.log"
Oct 30 22:24:49.643203 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:49.643171    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-674cd59dc5-c5rhc_f1b2dc54-7e37-4408-877f-ca01b896b4d8/jobset-operator/0.log"
Oct 30 22:24:54.003927 ip-10-0-142-237 kubenswrapper[4522]: I1030 22:24:54.003895    4522 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-85kvs_eedac110-0230-4206-a0da-baef13d54fbe/manager/0.log"